00000001:02000400:1.0F:1790740009.241129:0:3297:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg403-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1790740028.994922:0:3517:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg403-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1790740031.010384:0:3558:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 456 MB/s 00000001:01000000:3.0:1790740031.260681:0:3558:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 767 MB/s 00000001:01000000:0.0F:1790740031.510177:0:3558:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 2955 MB/s 00000020:02000000:3.0:1790740032.617651:0:3607:0:(class_obd.c:846:obdclass_init()) Lustre: Build Version: 2.17.59_3_g21e240e 00000400:02000000:3.0:1790740034.100551:0:3622:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.204.103@tcp [8/256/0/180] 00008000:02000000:2.0:1790740038.112840:0:3772:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1790740115.089625:0:5762:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg403-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1790740131.148430:0:6512:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790740131.148435:0:6512:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1790740131.148436:0:6512:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1790740131.154210:0:6512:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000750a312b 00000080:02000400:0.0:1790740131.154229:0:6512:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' or install '{/usr}/sbin/mount.lustre_tgt' 00000020:01000004:0.0:1790740131.173865:0:6512:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1790740131.173880:0:6512:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1790740131.173908:0:6512:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000dd15979a) 00000020:00000080:0.0:1790740131.173925:0:6512:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1790740131.258532:0:6512:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1790740131.258653:0:6512:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:0.0:1790740131.292322:0:6512:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1790740131.292720:0:6512:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1790740131.292728:0:6512:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:0.0:1790740131.292740:0:6512:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb25dda4f4e92d61e 00000020:01000004:0.0:1790740131.292747:0:6512:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1790740131.292751:0:6512:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1790740131.292756:0:6512:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000750a312b from MGS 00000020:01000004:0.0:1790740131.292760:0:6512:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1790740131.292771:0:6512:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000060799fd7) 00000020:00000080:0.0:1790740131.292780:0:6512:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1790740131.292835:0:6512:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000750a312b from MGS, refs=2 00080000:01000000:0.0:1790740131.292841:0:6512:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:0.0:1790740131.292845:0:6512:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb25dda4f4e92d62c 00000100:00100000:0.0:1790740131.292940:0:6512:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1790740131.293120:0:6512:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1790740131.293127:0:6512:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1790740131.293745:0:6512:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1790740131.293753:0:6512:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1790740131.295757:0:6512:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790740131.295944:0:6512:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1790740131.295950:0:6512:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1790740131.296930:0:6512:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1790740131.296938:0:6512:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1790740131.297450:0:6512:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1790740131.297535:0:6512:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1790740131.298185:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740131.298189:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740131.298190:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740131.298438:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740131.298441:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740131.298442:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740131.299214:0:6512:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1790740131.306806:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1790740131.549082:0:6512:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2303 MB/s 00000001:01000000:1.0:1790740131.800251:0:6512:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2494 MB/s 00000001:01000000:2.0:1790740132.051463:0:6512:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 533 MB/s 00000001:01000000:0.0:1790740132.301163:0:6512:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 775 MB/s 00080000:10000000:1.0:1790740132.311963:0:6512:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:1.0:1790740132.321800:0:6512:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1790740132.323719:0:6526:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1790740132.323781:0:6512:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1790740132.323820:0:6512:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1790740132.324012:0:6512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1790740132.328509:0:6512:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1790740132.328868:0:6512:0:(service.c:173:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00010000:00010000:0.0:1790740132.331488:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740132.333115:0:6512:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1790740132.333130:0:6512:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1790740132.334823:0:6512:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1790740132.334835:0:6512:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1790740132.335190:0:6512:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1790740132.335197:0:6512:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1790740132.335919:0:6512:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1790740132.335944:0:6512:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.103@tcp' 00000020:01000004:0.0:1790740132.335946:0:6512:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000100:00080000:3.0:1790740132.336115:0:6531:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:01000004:3.0:1790740132.336226:0:6512:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.103@tcp (typ=mgc) 00000020:00000080:3.0:1790740132.336246:0:6512:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.103@tcp (000000002627ae7d) 00000020:00000080:3.0:1790740132.336262:0:6512:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1790740132.336407:0:6512:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000b9705270@MGC192.168.204.103@tcp: add connection 192.168.204.103@tcp at head 00010000:00010000:3.0:1790740132.336581:0:6512:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.103@tcp-0 is initialized 00000040:01000000:3.0:1790740132.336590:0:6512:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.103@tcp ctxt 1 is initialized 10000000:01000000:2.0:1790740132.340510:0:6532:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1790740132.340602:0:6512:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.103@tcp (uuid ad8ddc53-446f-4b77-85d5-90ebc88dfa76) 00000020:00000080:3.0:1790740132.340626:0:6512:0:(genops.c:1384:class_connect()) connect: client ad8ddc53-446f-4b77-85d5-90ebc88dfa76, cookie 0xb25dda4f4e92d63a 00000100:00080000:3.0:1790740132.340638:0:6512:0:(import.c:545:import_select_connection()) MGC192.168.204.103@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790740132.340648:0:6512:0:(import.c:666:import_select_connection()) MGC192.168.204.103@tcp: import 00000000b9705270 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:3.0:1790740132.340690:0:6512:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000db079912 x1877727021891712/t0(0) o250->MGC192.168.204.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790740132.340718:0:6512:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import ad8ddc53-446f-4b77-85d5-90ebc88dfa76->MGS 00000020:01000004:3.0:1790740132.340739:0:6512:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1790740132.340745:0:6512:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1790740132.340759:0:6512:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000006d1effd1) 00000020:00000080:3.0:1790740132.340771:0:6512:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1790740132.341451:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000db079912 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3637:1877727021891712:0@lo:250: 00000100:00100000:2.0:1790740132.341539:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740132.343452:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021891712 00000100:00100000:0.0:1790740132.343467:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021891712 00000100:00100000:0.0:1790740132.343513:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790740132.343521:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000008e960a92 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3637:x1877727021891712:12345-0@lo:250: 00010000:00080000:0.0:1790740132.343558:0:6528:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from ad8ddc53-446f-4b77-85d5-90ebc88dfa76@0@lo t0 exp 0000000000000000 cur 203 last 0 00000020:00000080:0.0:1790740132.343609:0:6528:0:(genops.c:1384:class_connect()) connect: client ad8ddc53-446f-4b77-85d5-90ebc88dfa76, cookie 0xb25dda4f4e92d648 00000100:00080000:0.0:1790740132.343759:0:6528:0:(import.c:65:import_set_state_nolock()) 000000008cb93c61 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790740132.343868:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000008e960a92 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+5:3637:x1877727021891712:12345-0@lo:250: Request processed in 346us (2328us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740132.343875:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790740132.343921:0:3637:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.103@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1790740132.343930:0:3637:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.204.103@tcp: connect to target with instance 0 00000100:00080000:0.0:1790740132.343936:0:3637:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.204.103@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1790740132.343941:0:3637:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1790740132.343943:0:3637:0:(import.c:65:import_set_state_nolock()) 00000000b9705270 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1790740132.343946:0:3637:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1790740132.343954:0:3637:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1790740132.343959:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000db079912 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3637:1877727021891712:0@lo:250: 00000100:00100000:3.0:1790740132.367256:0:6512:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790740132.367780:0:6512:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1790740132.367786:0:6512:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1790740132.368790:0:6512:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1790740132.368799:0:6512:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1790740132.373957:0:6512:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1790740132.377447:0:6512:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1790740132.378542:0:6512:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790740132.378745:0:6512:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1790740132.378751:0:6512:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1790740132.381736:0:6512:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1790740132.381752:0:6512:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1790740132.417811:0:6512:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790740132.418023:0:6512:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1790740132.418126:0:6512:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1790740132.419520:0:6512:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1790740132.419535:0:6512:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1790740132.420176:0:6512:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790740132.420360:0:6512:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790740132.420365:0:6512:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1790740132.422431:0:6512:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790740132.422442:0:6512:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1790740132.423237:0:6512:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790740132.423557:0:6512:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790740132.423563:0:6512:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1790740132.424781:0:6512:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790740132.424790:0:6512:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1790740132.425649:0:6512:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790740132.425833:0:6512:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790740132.425838:0:6512:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1790740132.426719:0:6512:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790740132.426728:0:6512:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1790740132.446781:0:6512:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790740132.446971:0:6512:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1790740132.446978:0:6512:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1790740132.448835:0:6512:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1790740132.448849:0:6512:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1790740132.450728:0:6512:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1790740132.450740:0:6512:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1790740132.452237:0:6512:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1790740132.452270:0:6512:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1790740132.452277:0:6512:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.103@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1790740132.452525:0:6512:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.103@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790740132.452560:0:6512:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.103@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1790740132.452565:0:6512:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790740132.452566:0:6512:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790740132.452568:0:6512:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790740132.452569:0:6512:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790740132.452570:0:6512:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790740132.452571:0:6512:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790740132.452573:0:6512:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790740132.452574:0:6512:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790740132.452575:0:6512:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790740132.452577:0:6512:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790740132.452578:0:6512:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790740132.452580:0:6512:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790740132.452582:0:6512:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1790740132.452584:0:6512:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790740132.452585:0:6512:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790740132.452586:0:6512:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790740132.452587:0:6512:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790740132.452589:0:6512:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790740132.452590:0:6512:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790740132.452591:0:6512:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790740132.452591:0:6512:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790740132.452592:0:6512:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790740132.452593:0:6512:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790740132.452594:0:6512:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790740132.452595:0:6512:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790740132.452641:0:6512:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1790740132.452660:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003dfa2a44 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6512:1877727021891840:0@lo:253: 00000100:00100000:2.0:1790740132.452735:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740132.452834:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 000000004fd80d60 going to sleep for 11 seconds 00000100:00100000:3.0:1790740132.452892:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021891840 00000100:00100000:3.0:1790740132.452899:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021891840 00000100:00100000:3.0:1790740132.452992:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790740132.453001:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000a7863fd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+5:6512:x1877727021891840:12345-0@lo:253: 20000000:01000000:3.0:1790740132.453179:0:6530:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1790740132.453182:0:6530:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1790740132.453567:0:6551:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1790740132.453620:0:6530:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1790740132.453915:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790740132.455102:0:6552:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1790740132.455466:0:6530:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1790740132.455470:0:6530:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1790740132.455476:0:6530:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1790740132.455479:0:6530:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1790740132.455491:0:6530:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1790740132.455699:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790740132.455900:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1790740132.455915:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1790740132.455932:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1790740132.455947:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1790740132.455960:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1790740132.456010:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1790740132.456018:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1790740132.457438:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1790740132.457472:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1790740132.457499:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1790740132.457505:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1790740132.457519:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1790740132.457537:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1790740132.457593:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1790740132.457599:0:6530:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1790740132.457608:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790740132.457736:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1790740132.457747:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1790740132.457763:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1790740132.457778:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1790740132.457791:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1790740132.457800:0:6530:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1790740132.457826:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1790740132.457835:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1790740132.457847:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1790740132.457861:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1790740132.457893:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1790740132.457905:0:6530:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1790740132.457930:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1790740132.457938:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1790740132.457950:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1790740132.457963:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1790740132.458016:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1790740132.458919:0:6530:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1790740132.458929:0:6530:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1790740132.460415:0:6553:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1790740132.460708:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1790740132.460737:0:6530:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.103@tcp for mdt 20000000:01000000:2.0:1790740132.460740:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.103@tcp (null) (null) (null) 00000040:00080000:2.0:1790740132.460755:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1790740132.460763:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1790740132.460775:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1790740132.460780:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.103@tcp (null) (null) 00000040:00080000:2.0:1790740132.460790:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1790740132.460798:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1790740132.460810:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1790740132.460838:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1790740132.460870:0:6530:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1790740132.460874:0:6530:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1790740132.460878:0:6530:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1790740132.460933:0:6530:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1790740132.460935:0:6530:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1790740132.461444:0:6554:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1790740132.461601:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1790740132.461622:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1790740132.461638:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:2.0:1790740132.461648:0:6530:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1790740132.461650:0:6530:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1790740132.462023:0:6555:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1790740132.462422:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1790740132.462449:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1790740132.462465:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1790740132.462474:0:6530:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790740132.462477:0:6530:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1790740132.462481:0:6530:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1790740132.462484:0:6530:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1790740132.462488:0:6530:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1790740132.462494:0:6530:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1790740132.462817:0:6556:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1790740132.463228:0:6530:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1790740132.482854:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1790740132.482890:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1790740132.482908:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1790740132.482931:0:6530:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1790740132.482953:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000009fd80866/0xb25dda4f4e92d64f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740132.482972:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009fd80866/0xb25dda4f4e92d64f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740132.482982:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009fd80866/0xb25dda4f4e92d64f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740132.482988:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009fd80866/0xb25dda4f4e92d64f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740132.482995:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000009fd80866/0xb25dda4f4e92d64f lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740132.483001:0:6530:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000009fd80866/0xb25dda4f4e92d64f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740132.483007:0:6530:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock 000000009fd80866 already unused, calling callback (0000000006bfcbe5) 00010000:00010000:2.0:1790740132.483010:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000009fd80866/0xb25dda4f4e92d64f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740132.483017:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000009fd80866/0xb25dda4f4e92d64f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740132.483133:0:6530:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000009fd80866/0xb25dda4f4e92d64f lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740132.483157:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000009fd80866/0xb25dda4f4e92d64f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740132.483164:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009fd80866/0xb25dda4f4e92d64f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790740132.483181:0:6530:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1790740132.530836:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000a7863fd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+5:6512:x1877727021891840:12345-0@lo:253: Request processed in 77827us (78092us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740132.530853:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790740132.531621:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003dfa2a44 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6512:1877727021891840:0@lo:253: 10000000:01000000:0.0:1790740132.531639:0:6512:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1790740132.531643:0:6512:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790740132.531645:0:6512:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790740132.531646:0:6512:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790740132.531647:0:6512:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1790740132.531648:0:6512:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790740132.531649:0:6512:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790740132.531650:0:6512:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790740132.531652:0:6512:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790740132.531653:0:6512:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1790740132.531654:0:6512:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790740132.531656:0:6512:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1790740132.531676:0:6512:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000750a312b from lustre-MDT0000 10000000:01000000:0.0:1790740132.531707:0:6512:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1790740132.531709:0:6512:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1790740132.531714:0:6512:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff98dc992499c0 10000000:01000000:0.0:1790740132.531717:0:6512:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790740132.531726:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98dc992499c0 from 1 10000000:01000000:0.0:1790740132.531728:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790740132.531778:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: 00000000e5f2e4ec/0xb25dda4f4e92d656 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740132.531789:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: 00000000e5f2e4ec/0xb25dda4f4e92d656 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740132.531797:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: 00000000e5f2e4ec/0xb25dda4f4e92d656 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740132.531817:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003c3ae9c2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6512:1877727021891968:0@lo:101: 00000100:00100000:0.0:1790740132.531857:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740132.531970:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 000000000b916c5c going to sleep for 11 seconds 00000100:00100000:1.0:1790740132.532262:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021891968 00000100:00100000:1.0:1790740132.532272:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021891968 00000100:00100000:1.0:1790740132.536813:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790740132.536835:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000aa897040 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+5:6512:x1877727021891968:12345-0@lo:101: 00010000:00010000:1.0:1790740132.536855:0:6529:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740132.536879:0:6529:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e1a44156/0xb25dda4f4e92d65d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92d656 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740132.536910:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e1a44156/0xb25dda4f4e92d65d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92d656 expref: 6 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740132.536922:0:6529:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e1a44156/0xb25dda4f4e92d65d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d656 expref: 6 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740132.536933:0:6529:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e1a44156, rc 0) 00000100:00100000:1.0:1790740132.538524:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000aa897040 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+6:6512:x1877727021891968:12345-0@lo:101: Request processed in 1693us (6661us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740132.538548:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790740132.539236:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003c3ae9c2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6512:1877727021891968:0@lo:101: 00010000:00010000:2.0:1790740132.539262:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: 00000000e5f2e4ec/0xb25dda4f4e92d656 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d65d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740132.539273:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: 00000000e5f2e4ec/0xb25dda4f4e92d656 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92d65d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740132.539469:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001b7fe394 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6512:1877727021892096:0@lo:501: 00000100:00100000:3.0:1790740132.539519:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740132.539579:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 0000000075c0a542 going to sleep for 11 seconds 00000100:00100000:2.0:1790740132.539591:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021892096 00000100:00100000:2.0:1790740132.539598:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021892096 00000100:00100000:2.0:1790740132.539705:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790740132.539714:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000b0b7e89b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+6:6512:x1877727021892096:12345-0@lo:501: 00000100:00100000:2.0:1790740132.539807:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000b0b7e89b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+6:6512:x1877727021892096:12345-0@lo:501: Request processed in 94us (287us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790740132.539815:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790740132.540079:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001b7fe394 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6512:1877727021892096:0@lo:501: 10000000:01000000:3.0:1790740132.540106:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1790740132.540128:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: 00000000e5f2e4ec/0xb25dda4f4e92d656 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d65d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740132.540137:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: 00000000e5f2e4ec/0xb25dda4f4e92d656 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d65d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740132.540146:0:6512:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98dc82d23800 10000000:01000000:3.0:1790740132.540151:0:6512:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790740132.540156:0:6512:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff98dc82d23800 10000000:01000000:3.0:1790740132.540157:0:6512:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1790740132.540160:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff98dc82d23800 from 1 10000000:01000000:3.0:1790740132.540163:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1790740132.540188:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: 0000000035ee1859/0xb25dda4f4e92d664 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740132.540195:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: 0000000035ee1859/0xb25dda4f4e92d664 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740132.540203:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: 0000000035ee1859/0xb25dda4f4e92d664 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740132.540215:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001b7fe394 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6512:1877727021892224:0@lo:101: 00000100:00100000:3.0:1790740132.540241:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740132.540259:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 0000000075c0a542 going to sleep for 11 seconds 00000100:00100000:1.0:1790740132.540262:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021892224 00000100:00100000:1.0:1790740132.540266:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021892224 00000100:00100000:1.0:1790740132.540299:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790740132.540305:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000067c61414 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+6:6512:x1877727021892224:12345-0@lo:101: 00010000:00010000:1.0:1790740132.540314:0:6529:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740132.540326:0:6529:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b1f7da00/0xb25dda4f4e92d66b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92d664 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740132.540345:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b1f7da00/0xb25dda4f4e92d66b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92d664 expref: 7 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740132.540353:0:6529:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b1f7da00/0xb25dda4f4e92d66b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d664 expref: 7 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740132.540361:0:6529:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b1f7da00, rc 0) 00000100:00100000:1.0:1790740132.540463:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000067c61414 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+7:6512:x1877727021892224:12345-0@lo:101: Request processed in 157us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740132.540469:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790740132.541395:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001b7fe394 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6512:1877727021892224:0@lo:101: 00010000:00010000:3.0:1790740132.541411:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: 0000000035ee1859/0xb25dda4f4e92d664 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d66b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740132.541435:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: 0000000035ee1859/0xb25dda4f4e92d664 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92d66b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740132.541450:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1790740132.541468:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: 0000000035ee1859/0xb25dda4f4e92d664 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d66b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740132.541475:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: 0000000035ee1859/0xb25dda4f4e92d664 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d66b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740132.541482:0:6512:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1790740132.541485:0:6512:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790740132.541491:0:6512:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff98dc82d23800 10000000:01000000:3.0:1790740132.541493:0:6512:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1790740132.541496:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1790740132.541498:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1790740132.541520:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: 00000000cf9530c0/0xb25dda4f4e92d672 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740132.541526:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: 00000000cf9530c0/0xb25dda4f4e92d672 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740132.541533:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: 00000000cf9530c0/0xb25dda4f4e92d672 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740132.541549:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001b7fe394 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6512:1877727021892352:0@lo:101: 00000100:00100000:3.0:1790740132.541591:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740132.541628:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 0000000075c0a542 going to sleep for 11 seconds 00000100:00100000:2.0:1790740132.541781:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021892352 00000100:00100000:2.0:1790740132.541788:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021892352 00000100:00100000:2.0:1790740132.541829:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790740132.541837:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000f0918674 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+7:6512:x1877727021892352:12345-0@lo:101: 00010000:00010000:2.0:1790740132.541849:0:6530:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740132.541858:0:6530:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009fd80866/0xb25dda4f4e92d679 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92d672 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740132.541880:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009fd80866/0xb25dda4f4e92d679 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92d672 expref: 8 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740132.541888:0:6530:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009fd80866/0xb25dda4f4e92d679 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d672 expref: 8 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740132.541895:0:6530:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009fd80866, rc 0) 00000100:00100000:2.0:1790740132.541935:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000f0918674 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+8:6512:x1877727021892352:12345-0@lo:101: Request processed in 100us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740132.541942:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790740132.542533:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001b7fe394 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6512:1877727021892352:0@lo:101: 00010000:00010000:3.0:1790740132.542547:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: 00000000cf9530c0/0xb25dda4f4e92d672 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d679 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740132.542556:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: 00000000cf9530c0/0xb25dda4f4e92d672 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92d679 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740132.542617:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001b7fe394 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6512:1877727021892480:0@lo:501: 00000100:00100000:3.0:1790740132.542647:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740132.542682:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 0000000075c0a542 going to sleep for 11 seconds 00000100:00100000:1.0:1790740132.542745:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021892480 00000100:00100000:1.0:1790740132.542750:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021892480 00000100:00100000:1.0:1790740132.542790:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790740132.542797:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000007d8c1e57 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+8:6512:x1877727021892480:12345-0@lo:501: 00000100:00100000:1.0:1790740132.542925:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000007d8c1e57 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+9:6512:x1877727021892480:12345-0@lo:501: Request processed in 128us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740132.542932:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790740132.544643:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001b7fe394 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6512:1877727021892480:0@lo:501: 00000100:00100000:3.0:1790740132.544697:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001b7fe394 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6512:1877727021892608:0@lo:503: 00000100:00100000:3.0:1790740132.544766:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740132.544813:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 0000000075c0a542 going to sleep for 11 seconds 00000100:00100000:0.0:1790740132.544899:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021892608 00000100:00100000:0.0:1790740132.544906:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021892608 00000100:00100000:0.0:1790740132.544954:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790740132.544962:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000a59e75f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+9:6512:x1877727021892608:12345-0@lo:503: 00000100:00100000:0.0:1790740132.545120:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000a59e75f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+9:6512:x1877727021892608:12345-0@lo:503: Request processed in 159us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740132.545128:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790740132.545334:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001b7fe394 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6512:1877727021892608:0@lo:503: 00000100:00100000:3.0:1790740132.546329:0:6557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001b7fe394 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6557:1877727021892736:0@lo:502: 00000100:00100000:3.0:1790740132.546381:0:6557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740132.546410:0:6557:0:(client.c:2716:ptlrpc_set_wait()) set 000000005514aea6 going to sleep for 11 seconds 00000100:00100000:2.0:1790740132.546577:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021892736 00000100:00100000:2.0:1790740132.546585:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021892736 00000100:00100000:3.0:1790740132.550351:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790740132.550364:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000067d46b00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+9:6557:x1877727021892736:12345-0@lo:502: 00000100:00100000:3.0:1790740132.550561:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000067d46b00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+9:6557:x1877727021892736:12345-0@lo:502: Request processed in 199us (4180us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740132.550569:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790740132.550999:0:6557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001b7fe394 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6557:1877727021892736:0@lo:502: 00000020:01000000:1.0:1790740132.551081:0:6557:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790740132.551092:0:6557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740132.551094:0:6557:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1790740132.551101:0:6557:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1790740132.551104:0:6557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790740132.551128:0:6557:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000b6efd1b8) 00000020:00000080:1.0:1790740132.551147:0:6557:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1790740132.551155:0:6557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1790740132.551273:0:6557:0:(osd_handler.c:8931:osd_obd_connect()) connect #2 00000020:00000080:1.0:1790740132.551280:0:6557:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb25dda4f4e92d687 00000020:00000080:1.0:1790740132.551487:0:6557:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1790740132.551492:0:6557:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790740132.551496:0:6557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740132.551497:0:6557:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1790740132.551499:0:6557:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790740132.551503:0:6557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740132.551504:0:6557:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1790740132.551507:0:6557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790740132.551513:0:6557:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000008b615742) 00000020:00000080:1.0:1790740132.551523:0:6557:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1790740132.551527:0:6557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1790740132.551529:0:6557:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1790740132.551532:0:6557:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1790740132.551537:0:6557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790740132.551573:0:6557:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000750a312b from lustre-MDT0000, refs=3 00000020:00000080:1.0:1790740132.551585:0:6557:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000084740e3f) 00000020:00000080:1.0:1790740132.551593:0:6557:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1790740132.551672:0:6557:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1790740132.551678:0:6557:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb25dda4f4e92d69c 00000020:00000080:1.0:1790740132.551776:0:6557:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1790740132.551783:0:6557:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1790740132.551788:0:6557:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xb25dda4f4e92d6a3 00080000:01000000:1.0:1790740132.551792:0:6557:0:(osd_handler.c:8931:osd_obd_connect()) connect #3 00000020:00000080:1.0:1790740132.551802:0:6557:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb25dda4f4e92d6aa 00080000:10000000:1.0:1790740132.552362:0:6557:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1790740132.552506:0:6557:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1790740132.566094:0:6557:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:0.0:1790740132.692507:0:6557:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1790740132.692885:0:6557:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1790740132.696530:0:6557:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1790740132.697237:0:6557:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1790740132.700729:0:6557:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000e181e87b) 00000020:00000080:0.0:1790740132.700752:0:6557:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1790740132.700859:0:6557:0:(osd_handler.c:8931:osd_obd_connect()) connect #4 00000020:00000080:0.0:1790740132.700867:0:6557:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb25dda4f4e92d6b8 00000020:00000080:3.0:1790740132.701767:0:6557:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1790740132.703838:0:6557:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:3.0:1790740132.712777:0:6557:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:3.0:1790740132.715295:0:6557:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:3.0:1790740132.717583:0:6557:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:2.0:1790740132.720844:0:6557:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:2.0:1790740132.723781:0:6557:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:2.0:1790740132.726158:0:6557:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xb25dda4f4e92d6bf 00000020:00000080:2.0:1790740132.726804:0:6557:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1790740132.726816:0:6557:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790740132.726822:0:6557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740132.726825:0:6557:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1790740132.726828:0:6557:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790740132.726832:0:6557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740132.726834:0:6557:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790740132.726837:0:6557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790740132.726839:0:6557:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790740132.726841:0:6557:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790740132.726844:0:6557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740132.726845:0:6557:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:2.0:1790740132.726847:0:6557:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790740132.726851:0:6557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740132.726853:0:6557:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1790740132.726863:0:6557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1790740132.726900:0:6557:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1790740132.726953:0:6557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b68d749a pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6557:1877727021892864:0@lo:502: 00000100:00100000:2.0:1790740132.727076:0:6557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740132.727122:0:6557:0:(client.c:2716:ptlrpc_set_wait()) set 00000000016e36c4 going to sleep for 11 seconds 00000100:00100000:1.0:1790740132.727219:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021892864 00000100:00100000:1.0:1790740132.727228:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021892864 00000100:00100000:1.0:1790740132.727278:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790740132.727286:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000b9229b32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+9:6557:x1877727021892864:12345-0@lo:502: 00000100:00100000:1.0:1790740132.727501:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000b9229b32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+9:6557:x1877727021892864:12345-0@lo:502: Request processed in 217us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740132.727508:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790740132.727646:0:6557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b68d749a pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6557:1877727021892864:0@lo:502: 00000020:01000000:2.0:1790740132.727670:0:6557:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790740132.727674:0:6557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740132.727675:0:6557:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1790740132.727678:0:6557:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1790740132.727860:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1790740132.727880:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1790740132.727897:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: 00000000cf9530c0/0xb25dda4f4e92d672 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d679 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740132.727907:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: 00000000cf9530c0/0xb25dda4f4e92d672 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d679 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740132.727915:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98dc82d23800 from 1 10000000:01000000:3.0:1790740132.727917:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790740132.727940:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: 0000000046e7bb73/0xb25dda4f4e92d6c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740132.727947:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: 0000000046e7bb73/0xb25dda4f4e92d6c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740132.727955:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: 0000000046e7bb73/0xb25dda4f4e92d6c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740132.727966:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000688d9552 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6512:1877727021892992:0@lo:101: 00000100:00100000:3.0:1790740132.727993:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740132.728022:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ca53c75e going to sleep for 11 seconds 00000100:00100000:2.0:1790740132.728165:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021892992 00000100:00100000:2.0:1790740132.728170:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021892992 00000100:00100000:2.0:1790740132.728224:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790740132.728231:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000de6198d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+9:6512:x1877727021892992:12345-0@lo:101: 00010000:00010000:2.0:1790740132.728240:0:6528:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740132.728254:0:6528:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003ad3af37/0xb25dda4f4e92d6cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92d6c6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740132.728273:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003ad3af37/0xb25dda4f4e92d6cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92d6c6 expref: 10 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740132.728283:0:6528:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003ad3af37/0xb25dda4f4e92d6cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d6c6 expref: 10 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740132.728291:0:6528:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003ad3af37, rc 0) 00000100:00100000:2.0:1790740132.728331:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000de6198d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+10:6512:x1877727021892992:12345-0@lo:101: Request processed in 101us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740132.728337:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790740132.728396:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000688d9552 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6512:1877727021892992:0@lo:101: 00010000:00010000:1.0:1790740132.728409:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: 0000000046e7bb73/0xb25dda4f4e92d6c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d6cd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740132.728416:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: 0000000046e7bb73/0xb25dda4f4e92d6c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92d6cd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740132.729347:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a282aacf pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6512:1877727021893120:0@lo:256: 00000100:00100000:1.0:1790740132.729706:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740132.730021:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 0000000048694aa5 going to sleep for 11 seconds 00000100:00100000:3.0:1790740132.730145:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021893120 00000100:00100000:3.0:1790740132.730153:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021893120 00000100:00100000:3.0:1790740132.730188:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790740132.730195:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000c97a8e5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+10:6512:x1877727021893120:12345-0@lo:256: 20000000:01000000:3.0:1790740132.730216:0:6530:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1790740132.730232:0:6530:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1790740132.730311:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000c97a8e5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+10:6512:x1877727021893120:12345-0@lo:256: Request processed in 116us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740132.730318:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790740132.730486:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a282aacf pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6512:1877727021893120:0@lo:256: 10000000:01000000:1.0:1790740132.731172:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790740132.731185:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: 0000000046e7bb73/0xb25dda4f4e92d6c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d6cd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740132.731196:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: 0000000046e7bb73/0xb25dda4f4e92d6c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d6cd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740132.731216:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98dc82d23800 from 1 10000000:01000000:1.0:1790740132.731219:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790740132.731248:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: 000000000cb6542f/0xb25dda4f4e92d6d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740132.731256:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: 000000000cb6542f/0xb25dda4f4e92d6d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740132.731264:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: 000000000cb6542f/0xb25dda4f4e92d6d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740132.731281:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a282aacf pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6512:1877727021893248:0@lo:101: 00000100:00100000:1.0:1790740132.731316:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740132.731339:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 0000000048694aa5 going to sleep for 11 seconds 00000100:00100000:3.0:1790740132.731484:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021893248 00000100:00100000:3.0:1790740132.731490:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021893248 00000100:00100000:3.0:1790740132.731515:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790740132.731521:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000b9e643d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+10:6512:x1877727021893248:12345-0@lo:101: 00010000:00010000:3.0:1790740132.731532:0:6530:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740132.731545:0:6530:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d6f58cc9/0xb25dda4f4e92d6db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92d6d4 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740132.731565:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d6f58cc9/0xb25dda4f4e92d6db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92d6d4 expref: 11 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740132.731574:0:6530:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d6f58cc9/0xb25dda4f4e92d6db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d6d4 expref: 11 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740132.731582:0:6530:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d6f58cc9, rc 0) 00000100:00100000:3.0:1790740132.731616:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000b9e643d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+11:6512:x1877727021893248:12345-0@lo:101: Request processed in 94us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740132.731622:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790740132.731900:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a282aacf pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6512:1877727021893248:0@lo:101: 00010000:00010000:1.0:1790740132.731912:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: 000000000cb6542f/0xb25dda4f4e92d6d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d6db expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740132.731920:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: 000000000cb6542f/0xb25dda4f4e92d6d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92d6db expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740132.731972:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a282aacf pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6512:1877727021893376:0@lo:501: 00000100:00100000:1.0:1790740132.731998:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740132.732022:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 0000000048694aa5 going to sleep for 11 seconds 00000100:00100000:2.0:1790740132.732233:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021893376 00000100:00100000:2.0:1790740132.732247:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021893376 00000100:00100000:2.0:1790740132.732270:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790740132.732276:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000005385d902 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+11:6512:x1877727021893376:12345-0@lo:501: 00000100:00100000:2.0:1790740132.732608:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000005385d902 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+11:6512:x1877727021893376:12345-0@lo:501: Request processed in 331us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740132.732616:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790740132.732778:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a282aacf pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6512:1877727021893376:0@lo:501: 00000100:00100000:1.0:1790740132.732808:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a282aacf pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6512:1877727021893504:0@lo:503: 00000100:00100000:1.0:1790740132.732853:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740132.732923:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 0000000048694aa5 going to sleep for 11 seconds 00000100:00100000:0.0:1790740132.732988:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021893504 00000100:00100000:0.0:1790740132.732994:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021893504 00000100:00100000:3.0:1790740132.733400:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790740132.733410:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000000e2b3ca0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+11:6512:x1877727021893504:12345-0@lo:503: 00000040:00080000:3.0:1790740132.733448:0:6528:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790740132.733515:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000000e2b3ca0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+11:6512:x1877727021893504:12345-0@lo:503: Request processed in 107us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740132.733523:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790740132.733719:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a282aacf pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6512:1877727021893504:0@lo:503: 00000040:00080000:2.0:1790740132.734617:0:6561:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1790740132.735254:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1790740132.735290:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790740132.735307:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: 000000000cb6542f/0xb25dda4f4e92d6d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d6db expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740132.735319:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: 000000000cb6542f/0xb25dda4f4e92d6d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d6db expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740132.735376:0:6512:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790740132.735379:0:6512:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98dc82d23800 10000000:01000000:3.0:1790740132.735382:0:6512:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98dc82d23800 10000000:01000000:3.0:1790740132.735386:0:6512:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790740132.735392:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98dc82d23800 from 1 10000000:01000000:3.0:1790740132.735394:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790740132.735438:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: 000000005ec44627/0xb25dda4f4e92d6e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740132.735446:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: 000000005ec44627/0xb25dda4f4e92d6e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740132.735455:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: 000000005ec44627/0xb25dda4f4e92d6e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740132.735481:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022981703 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6512:1877727021893632:0@lo:101: 00000100:00100000:3.0:1790740132.735533:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740132.735568:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f5923afc going to sleep for 11 seconds 00000100:00100000:3.0:1790740132.735587:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021893632 00000100:00100000:3.0:1790740132.735594:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021893632 00000100:00100000:3.0:1790740132.735631:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790740132.735639:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000019100900 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+11:6512:x1877727021893632:12345-0@lo:101: 00010000:00010000:3.0:1790740132.735652:0:6530:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740132.735670:0:6530:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000063a6c57a/0xb25dda4f4e92d6e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92d6e2 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740132.735691:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000063a6c57a/0xb25dda4f4e92d6e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92d6e2 expref: 12 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740132.735700:0:6530:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000063a6c57a/0xb25dda4f4e92d6e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d6e2 expref: 12 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740132.735708:0:6530:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000063a6c57a, rc 0) 00000100:00100000:3.0:1790740132.735743:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000019100900 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+12:6512:x1877727021893632:12345-0@lo:101: Request processed in 105us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740132.735749:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790740132.735794:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022981703 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6512:1877727021893632:0@lo:101: 00010000:00010000:3.0:1790740132.735806:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: 000000005ec44627/0xb25dda4f4e92d6e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d6e9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740132.735812:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: 000000005ec44627/0xb25dda4f4e92d6e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92d6e9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740132.735867:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022981703 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6512:1877727021893760:0@lo:501: 00000100:00100000:3.0:1790740132.735890:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740132.735902:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f5923afc going to sleep for 11 seconds 00000100:00100000:3.0:1790740132.735915:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021893760 00000100:00100000:3.0:1790740132.735918:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021893760 00000100:00100000:3.0:1790740132.735935:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790740132.735939:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000000de5b07f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+12:6512:x1877727021893760:12345-0@lo:501: 00000100:00100000:3.0:1790740132.736065:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000000de5b07f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+12:6512:x1877727021893760:12345-0@lo:501: Request processed in 90us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740132.736080:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790740132.736111:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022981703 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6512:1877727021893760:0@lo:501: 00000100:00100000:3.0:1790740132.736131:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022981703 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6512:1877727021893888:0@lo:503: 00000100:00100000:3.0:1790740132.736160:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740132.736171:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f5923afc going to sleep for 11 seconds 00000100:00100000:3.0:1790740132.736181:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021893888 00000100:00100000:3.0:1790740132.736184:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021893888 00000100:00100000:3.0:1790740132.736200:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790740132.736204:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000007bfd83fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+12:6512:x1877727021893888:12345-0@lo:503: 00000100:00100000:3.0:1790740132.736262:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000007bfd83fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+12:6512:x1877727021893888:12345-0@lo:503: Request processed in 57us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740132.736268:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790740132.736299:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022981703 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6512:1877727021893888:0@lo:503: 00000100:00100000:3.0:1790740132.736444:0:6562:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022981703 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6562:1877727021894016:0@lo:502: 00000100:00100000:3.0:1790740132.736472:0:6562:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740132.736487:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021894016 00000100:00100000:3.0:1790740132.736490:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021894016 00000100:00100000:3.0:1790740132.736505:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790740132.736510:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000a9db2056 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+12:6562:x1877727021894016:12345-0@lo:502: 00000100:00100000:3.0:1790740132.736560:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000a9db2056 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+12:6562:x1877727021894016:12345-0@lo:502: Request processed in 50us (88us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740132.736566:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790740132.736588:0:6562:0:(client.c:2716:ptlrpc_set_wait()) set 0000000068cd560a going to sleep for 11 seconds 00000100:00100000:3.0:1790740132.736596:0:6562:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022981703 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6562:1877727021894016:0@lo:502: 00000020:01000004:3.0:1790740132.736636:0:6562:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1790740132.736655:0:6562:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000999e3a14) 00000020:00000080:3.0:1790740132.736670:0:6562:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1790740132.736746:0:6562:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000750a312b from lustre-MDT0000, refs=4 00000020:01000004:3.0:1790740132.736750:0:6562:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000750a312b from lustre-MDT0000, refs=4 00000020:01000004:3.0:1790740132.736752:0:6562:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000750a312b 4 00010000:00080000:3.0:1790740132.736787:0:6562:0:(ldlm_lib.c:102:import_set_conn()) imp 000000006aa94c79@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.103@tcp at head 00010000:00010000:3.0:1790740132.739954:0:6562:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1790740132.740355:0:6562:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1790740132.740408:0:6562:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790740132.740423:0:6562:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xb25dda4f4e92d6f7 00000100:00080000:3.0:1790740132.740434:0:6562:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790740132.740445:0:6562:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000006aa94c79 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:3.0:1790740132.740560:0:6562:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000022981703 x1877727021894144/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790740132.740578:0:6562:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1790740132.740665:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022981703 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877727021894144:0@lo:38: 00000100:00100000:0.0:1790740132.740734:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740132.740799:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021894144 00000100:00100000:0.0:1790740132.740806:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021894144 00000100:00100000:0.0:1790740132.740836:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790740132.740842:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000002df1808d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1877727021894144:12345-0@lo:38: 00000100:00100000:0.0:1790740132.740892:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000002df1808d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1877727021894144:12345-0@lo:38: Request processed in 50us (159us total) trans 0 rc -11/-11 00000100:00100000:0.0:1790740132.740899:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790740132.740937:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790740132.740943:0:3637:0:(import.c:65:import_set_state_nolock()) 000000006aa94c79 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790740132.740947:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1790740132.740959:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022981703 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877727021894144:0@lo:38: 00000100:00100000:0.0:1790740132.741427:0:6562:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073e4c864 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6562:1877727021894272:0@lo:502: 00000100:00100000:0.0:1790740132.741582:0:6562:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740132.741608:0:6562:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d2ef6c0b going to sleep for 11 seconds 00000100:00100000:3.0:1790740132.741658:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021894272 00000100:00100000:3.0:1790740132.741663:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021894272 00000100:00100000:3.0:1790740132.741701:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790740132.741707:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000008559f4fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+12:6562:x1877727021894272:12345-0@lo:502: 00000100:00100000:3.0:1790740132.741807:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000008559f4fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+12:6562:x1877727021894272:12345-0@lo:502: Request processed in 100us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740132.741814:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790740132.741908:0:6562:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073e4c864 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6562:1877727021894272:0@lo:502: 00000040:00080000:3.0:1790740132.741930:0:6562:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1790740132.741978:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1790740132.741998:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790740132.742012:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: 000000005ec44627/0xb25dda4f4e92d6e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d6e9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740132.742069:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: 000000005ec44627/0xb25dda4f4e92d6e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d6e9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1790740132.742292:0:6512:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1790740132.742295:0:6512:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790740132.742296:0:6512:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790740132.742297:0:6512:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790740132.742299:0:6512:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790740132.742300:0:6512:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790740132.742302:0:6512:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790740132.742303:0:6512:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790740132.742305:0:6512:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790740132.742306:0:6512:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790740132.742307:0:6512:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790740132.742309:0:6512:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790740132.742312:0:6512:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1790740132.742314:0:6512:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790740132.742316:0:6512:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790740132.742317:0:6512:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790740132.742318:0:6512:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790740132.742319:0:6512:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790740132.742320:0:6512:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790740132.742321:0:6512:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790740132.742322:0:6512:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790740132.742323:0:6512:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790740132.742324:0:6512:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790740132.742325:0:6512:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790740132.742326:0:6512:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790740132.742339:0:6512:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1790740132.742349:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000479ad4fb pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6512:1877727021894400:0@lo:253: 00000100:00100000:3.0:1790740132.742452:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740132.742548:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fdfdf034 going to sleep for 11 seconds 00000100:00100000:0.0:1790740132.742664:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021894400 00000100:00100000:0.0:1790740132.742669:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021894400 00000100:00100000:0.0:1790740132.742697:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790740132.742702:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000312ad990 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+12:6512:x1877727021894400:12345-0@lo:253: 20000000:01000000:0.0:1790740132.742725:0:6529:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1790740132.742738:0:6529:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1790740132.754519:0:6529:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790740132.754537:0:6529:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1790740132.756009:0:6551:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1790740132.756017:0:6551:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1790740132.756072:0:6551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000007f1b7985/0xb25dda4f4e92d6fe lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740132.756090:0:6551:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003ad3af37/0xb25dda4f4e92d6cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d6c6 expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740132.756099:0:6551:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000007f1b7985/0xb25dda4f4e92d6fe lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740132.756139:0:6551:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003ad3af37/0xb25dda4f4e92d6cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92d6c6 expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740132.756158:0:6551:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003ad3af37/0xb25dda4f4e92d6cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92d6c6 expref: 12 pid: 6528 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740132.756171:0:6551:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000000761232 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6551:1877727021894528:0@lo:104: 00000100:00100000:0.0:1790740132.756231:0:6551:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740132.756279:0:6551:0:(client.c:2716:ptlrpc_set_wait()) set 00000000536af68d going to sleep for 11 seconds 00000100:00100000:1.0:1790740132.756508:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021894528 00000100:00100000:1.0:1790740132.756515:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021894528 00000100:00100000:1.0:1790740132.756553:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790740132.756560:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000008f41c709 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+3:6551:x1877727021894528:12345-0@lo:104: 00010000:00010000:1.0:1790740132.756573:0:6518:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: 0000000046e7bb73/0xb25dda4f4e92d6c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d6cd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740132.756625:0:6518:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790740132.756631:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000008f41c709 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+3:6551:x1877727021894528:12345-0@lo:104: Request processed in 71us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740132.756637:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1790740132.756661:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790740132.756666:0:6523:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: 0000000046e7bb73/0xb25dda4f4e92d6c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d6cd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740132.756673:0:6523:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock 0000000046e7bb73 already unused, calling callback (0000000092620f45) 10000000:00010000:1.0:1790740132.756676:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: 0000000046e7bb73/0xb25dda4f4e92d6c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92d6cd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740132.756683:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: 0000000046e7bb73/0xb25dda4f4e92d6c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92d6cd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790740132.756689:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: 0000000046e7bb73/0xb25dda4f4e92d6c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92d6cd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740132.756695:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790740132.756736:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: 0000000046e7bb73/0xb25dda4f4e92d6c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d6cd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740132.756744:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790740132.756758:0:6523:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: 0000000046e7bb73/0xb25dda4f4e92d6c6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d6cd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740132.756765:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: 0000000046e7bb73/0xb25dda4f4e92d6c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d6cd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740132.756783:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740132.756784:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740132.756786:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740132.756809:0:6551:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000000761232 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6551:1877727021894528:0@lo:104: 00010000:00010000:1.0:1790740132.756825:0:6551:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000007f1b7985/0xb25dda4f4e92d6fe lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740132.757526:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000312ad990 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+12:6512:x1877727021894400:12345-0@lo:253: Request processed in 14822us (15073us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740132.757536:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790740132.757551:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000930cce5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3639:1877727021894656:0@lo:103: 00000100:00100000:3.0:1790740132.757583:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740132.757663:0:6520:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021894656 00000100:00100000:0.0:1790740132.757668:0:6520:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021894656 00010000:00010000:0.0:1790740132.757687:0:6520:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003ad3af37/0xb25dda4f4e92d6cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d6c6 expref: 12 pid: 6528 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740132.757707:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790740132.757713:0:6520:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000c5c97e1f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+12:3639:x1877727021894656:12345-0@lo:103: 00010000:00010000:0.0:1790740132.757723:0:6520:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740132.757727:0:6520:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003ad3af37/0xb25dda4f4e92d6cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d6c6 expref: 12 pid: 6528 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740132.757737:0:6520:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003ad3af37/0xb25dda4f4e92d6cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92d6c6 expref: 12 pid: 6528 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740132.757749:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003ad3af37/0xb25dda4f4e92d6cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92d6c6 expref: 12 pid: 6528 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740132.757761:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000007f1b7985/0xb25dda4f4e92d6fe lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740132.757768:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007f1b7985/0xb25dda4f4e92d6fe lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790740132.757782:0:6520:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001764752s 00010000:00010000:0.0:1790740132.757785:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007f1b7985/0xb25dda4f4e92d6fe lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740132.757791:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007f1b7985/0xb25dda4f4e92d6fe lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740132.757803:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000007f1b7985/0xb25dda4f4e92d6fe lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740132.757809:0:6520:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000007f1b7985/0xb25dda4f4e92d6fe lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740132.757814:0:6520:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock 000000007f1b7985 already unused, calling callback (0000000006bfcbe5) 00010000:00010000:0.0:1790740132.757817:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000007f1b7985/0xb25dda4f4e92d6fe lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740132.757823:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000007f1b7985/0xb25dda4f4e92d6fe lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740132.757838:0:6520:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000007f1b7985/0xb25dda4f4e92d6fe lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740132.757845:0:6551:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000007f1b7985/0xb25dda4f4e92d6fe lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740132.757847:0:6520:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790740132.757852:0:6551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000007f1b7985/0xb25dda4f4e92d6fe lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740132.757857:0:6551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007f1b7985/0xb25dda4f4e92d6fe lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740132.757874:0:6520:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000c5c97e1f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+11:3639:x1877727021894656:12345-0@lo:103: Request processed in 162us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740132.757880:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790740132.757882:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000930cce5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3639:1877727021894656:0@lo:103: 00000100:00100000:1.0:1790740132.758144:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000479ad4fb pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6512:1877727021894400:0@lo:253: 10000000:01000000:1.0:1790740132.758154:0:6512:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1790740132.758157:0:6512:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790740132.758159:0:6512:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790740132.758160:0:6512:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790740132.758161:0:6512:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790740132.758162:0:6512:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790740132.758164:0:6512:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790740132.758165:0:6512:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790740132.758166:0:6512:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790740132.758167:0:6512:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790740132.758169:0:6512:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790740132.758170:0:6512:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790740132.758171:0:6512:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1790740132.758180:0:6512:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1790740132.766376:0:6512:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:1.0:1790740132.769465:0:6512:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1790740132.769974:0:6512:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:1.0:1790740132.770349:0:6512:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1790740132.770734:0:6512:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:1.0:1790740132.770864:0:6512:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:1.0:1790740132.771910:0:6512:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:1.0:1790740132.772265:0:6512:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1790740132.772598:0:6512:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:1.0:1790740132.772853:0:6512:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1790740132.773541:0:6512:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:1.0:1790740132.773798:0:6512:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:3.0:1790740132.781427:0:6512:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1790740132.793429:0:6512:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1790740132.793547:0:6567:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1790740132.793553:0:6567:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1790740132.793867:0:6568:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1790740132.795209:0:6512:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1790740132.795322:0:6512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1790740132.795906:0:6512:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1790740132.795996:0:6512:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1790740132.796274:0:6512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790740132.797623:0:6512:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1790740132.799853:0:6512:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1790740132.799924:0:6512:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1790740132.800892:0:6512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1790740132.801330:0:6512:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00000040:00080000:3.0:1790740132.801937:0:6568:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:1.0:1790740132.802951:0:6512:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1790740132.803211:0:6512:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1790740132.803376:0:6512:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1790740132.803531:0:6512:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1790740132.803754:0:6512:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1790740132.803991:0:6512:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1790740132.804165:0:6512:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1790740132.804307:0:6512:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1790740132.804417:0:6512:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1790740132.804541:0:6512:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1790740132.804921:0:6512:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1790740132.805074:0:6512:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1790740132.805229:0:6512:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1790740132.805358:0:6512:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1790740132.805521:0:6512:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1790740132.805671:0:6512:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1790740132.805941:0:6512:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1790740132.806143:0:6512:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1790740132.806318:0:6512:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1790740132.806454:0:6512:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1790740132.806585:0:6512:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1790740132.806744:0:6512:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1790740132.806872:0:6512:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1790740132.806987:0:6512:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1790740132.807231:0:6512:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1790740132.807370:0:6512:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1790740132.807522:0:6512:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1790740132.807663:0:6512:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1790740132.807791:0:6512:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1790740132.807953:0:6512:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1790740132.808478:0:6512:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1790740132.808619:0:6512:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1790740132.808816:0:6512:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1790740132.812910:0:6568:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1790740132.813015:0:6568:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1790740132.813021:0:6568:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:1.0:1790740132.818317:0:6512:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1790740132.818364:0:6512:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb5b101907988 00100000:10000000:1.0:1790740132.818387:0:6512:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1790740132.820824:0:6512:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790740132.820844:0:6512:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.103@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790740132.820866:0:6512:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1790740132.820885:0:6512:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1790740132.821558:0:6512:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790740132.821728:0:6512:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1790740133.365630:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740134.379224:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740135.402763:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740136.426473:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740137.457741:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740138.092734:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000038f8466c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727021894784:0@lo:400: 00000100:00100000:0.0:1790740138.092846:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740138.092954:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021894784 00000100:00100000:0.0:1790740138.092974:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021894784 00000100:00100000:0.0:1790740138.093059:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790740138.093068:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000002773770a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+11:3640:x1877727021894784:12345-0@lo:400: 00000100:00100000:0.0:1790740138.093135:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000002773770a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+11:3640:x1877727021894784:12345-0@lo:400: Request processed in 68us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740138.093144:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790740138.093206:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000038f8466c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727021894784:0@lo:400: 00000100:00080000:1.0:1790740138.100184:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1790740138.100204:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1790740138.100319:0:8:0:(import.c:65:import_set_state_nolock()) 000000006aa94c79 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790740138.100350:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000006aa94c79 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:1.0:1790740138.100409:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000008f8dc4ca x1877727021894912/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790740138.100927:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f8dc4ca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877727021894912:0@lo:38: 00000100:00100000:0.0:1790740138.101054:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740138.101159:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021894912 00000100:00100000:1.0:1790740138.101171:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021894912 00000100:00100000:1.0:1790740138.101242:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790740138.101251:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000006eb86f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1877727021894912:12345-0@lo:38: 00010000:00080000:1.0:1790740138.101292:0:6537:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 209 last 0 00000020:00000080:1.0:1790740138.101341:0:6537:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xb25dda4f4e92d705 00000004:00100000:1.0:1790740138.101414:0:6537:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790740138.101573:0:6537:0:(import.c:65:import_set_state_nolock()) 00000000ffa74277 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790740138.101660:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000006eb86f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1877727021894912:12345-0@lo:38: Request processed in 408us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740138.101668:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1790740138.101888:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000008f8dc4ca x1877727021894912/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790740148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790740138.101909:0:3637:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1790740138.101919:0:3637:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1790740138.101924:0:3637:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790740138.101927:0:3637:0:(import.c:65:import_set_state_nolock()) 000000006aa94c79 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790740138.101934:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f8dc4ca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877727021894912:0@lo:38: 00010000:00010000:3.0:1790740138.475288:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790740139.052701:0:6813:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg403-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1790740139.506325:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790740140.139097:0:6532:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790740140.139106:0:6532:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98dc82d23800 from 3 10000000:01000000:3.0:1790740140.139111:0:6532:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790740140.139170:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: 000000009ccfc306/0xb25dda4f4e92d70c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740140.139183:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: 000000009ccfc306/0xb25dda4f4e92d70c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740140.139223:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: 000000009ccfc306/0xb25dda4f4e92d70c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740140.139247:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000002834fa0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021895040:0@lo:101: 00000100:00100000:3.0:1790740140.139320:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740140.139393:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a8da1a46 going to sleep for 11 seconds 00000100:00100000:0.0:1790740140.139929:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021895040 00000100:00100000:0.0:1790740140.139938:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021895040 00000100:00100000:0.0:1790740140.140001:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790740140.140009:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000a67eab46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+11:6532:x1877727021895040:12345-0@lo:101: 00010000:00010000:0.0:1790740140.140024:0:6529:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740140.143717:0:6529:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a952f8de/0xb25dda4f4e92d713 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92d70c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740140.143763:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a952f8de/0xb25dda4f4e92d713 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92d70c expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740140.143791:0:6529:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a952f8de/0xb25dda4f4e92d713 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d70c expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740140.143801:0:6529:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a952f8de, rc 0) 00000100:00100000:0.0:1790740140.143888:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000a67eab46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+12:6532:x1877727021895040:12345-0@lo:101: Request processed in 3879us (4567us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740140.143897:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790740140.149841:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000002834fa0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021895040:0@lo:101: 00010000:00010000:3.0:1790740140.149876:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: 000000009ccfc306/0xb25dda4f4e92d70c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d713 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740140.149889:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: 000000009ccfc306/0xb25dda4f4e92d70c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92d713 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740140.149980:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000002834fa0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021895168:0@lo:256: 00000100:00100000:3.0:1790740140.150068:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740140.150118:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a8da1a46 going to sleep for 11 seconds 00000100:00100000:0.0:1790740140.150193:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021895168 00000100:00100000:0.0:1790740140.150200:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021895168 00000100:00100000:0.0:1790740140.150241:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790740140.150248:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000001b29e145 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+12:6532:x1877727021895168:12345-0@lo:256: 20000000:01000000:0.0:1790740140.150270:0:6530:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790740140.150285:0:6530:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790740140.150288:0:6530:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1790740140.150390:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000001b29e145 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+12:6532:x1877727021895168:12345-0@lo:256: Request processed in 142us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740140.150399:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790740140.150586:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000002834fa0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021895168:0@lo:256: 10000000:01000000:3.0:1790740140.150626:0:6532:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790740140.150633:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: 000000009ccfc306/0xb25dda4f4e92d70c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d713 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740140.150641:0:6532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: 000000009ccfc306/0xb25dda4f4e92d70c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d713 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:2.0:1790740140.409643:0:6865:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790740140.409828:0:6865:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790740140.523585:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740141.546396:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740142.581324:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740143.211805:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000050f9ec22 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727021895424:0@lo:400: 00000100:00100000:2.0:1790740143.211892:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740143.211982:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790740143.211991:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b68d749a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727021895296:0@lo:400: 00000100:00100000:1.0:1790740143.212024:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740143.212262:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021895296 00000100:00100000:2.0:1790740143.212284:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021895296 00000100:00100000:2.0:1790740143.212517:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790740143.212526:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000992478ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+12:3640:x1877727021895296:12345-0@lo:400: 00000100:00100000:2.0:1790740143.212578:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000992478ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+12:3640:x1877727021895296:12345-0@lo:400: Request processed in 54us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740143.212584:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790740143.212624:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b68d749a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727021895296:0@lo:400: 00000100:00100000:0.0:1790740143.212732:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021895424 00000100:00100000:0.0:1790740143.212737:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021895424 00000100:00100000:0.0:1790740143.212802:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790740143.212809:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000ad13fc44 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727021895424:12345-0@lo:400: 00000100:00100000:0.0:1790740143.212863:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000ad13fc44 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727021895424:12345-0@lo:400: Request processed in 55us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740143.212869:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1790740143.212918:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000050f9ec22 x1877727021895424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740143.212938:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000050f9ec22 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727021895424:0@lo:400: 00000020:00000004:1.0:1790740143.491460:0:6967:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790740143.492806:0:6967:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1790740143.594535:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740144.621183:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740145.645144:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740146.675138:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740147.693417:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740148.330240:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b68d749a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877727021895680:0@lo:400: 00000100:00100000:2.0:1790740148.330323:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740148.330421:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021895680 00000100:00100000:2.0:1790740148.330431:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021895680 00000100:00100000:2.0:1790740148.330488:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790740148.330496:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000057312d63 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877727021895680:12345-0@lo:400: 00000100:00100000:2.0:1790740148.330547:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000057312d63 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877727021895680:12345-0@lo:400: Request processed in 52us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740148.330554:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790740148.330596:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b68d749a x1877727021895680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740148.330612:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b68d749a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877727021895680:0@lo:400: 00000100:00100000:1.0:1790740148.330680:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790740148.330690:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000050f9ec22 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727021895552:0@lo:400: 00000100:00100000:1.0:1790740148.330725:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740148.330941:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021895552 00000100:00100000:2.0:1790740148.330946:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021895552 00000100:00100000:2.0:1790740148.330982:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790740148.330988:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000076a071cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+12:3638:x1877727021895552:12345-0@lo:400: 00000100:00100000:2.0:1790740148.331054:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000076a071cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+12:3638:x1877727021895552:12345-0@lo:400: Request processed in 43us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740148.331061:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790740148.331138:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000050f9ec22 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727021895552:0@lo:400: 00010000:00010000:2.0:1790740148.714438:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740149.739693:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740150.765890:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740151.787764:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740152.820830:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740153.465684:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790740153.465709:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000002834fa0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727021895808:0@lo:400: 00000100:00100000:3.0:1790740153.466201:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740153.466876:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ae89b259 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727021895936:0@lo:400: 00000100:00100000:3.0:1790740153.466925:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740153.466984:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021895808 00000100:00100000:3.0:1790740153.466991:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021895808 00000100:00100000:0.0:1790740153.467198:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021895936 00000100:00100000:0.0:1790740153.467204:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021895936 00000100:00100000:0.0:1790740153.467320:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790740153.467330:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000ce9ec059 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727021895936:12345-0@lo:400: 00000100:00100000:0.0:1790740153.467389:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000ce9ec059 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727021895936:12345-0@lo:400: Request processed in 61us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740153.467396:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1790740153.467439:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ae89b259 x1877727021895936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740153.467452:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ae89b259 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727021895936:0@lo:400: 00000100:00100000:3.0:1790740153.467835:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790740153.467847:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000901e96f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+12:3640:x1877727021895808:12345-0@lo:400: 00000100:00100000:3.0:1790740153.467902:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000901e96f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+12:3640:x1877727021895808:12345-0@lo:400: Request processed in 59us (1703us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740153.467908:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790740153.468201:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000002834fa0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727021895808:0@lo:400: 00010000:00010000:0.0:1790740153.835152:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790740154.724486:0:7465:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790740154.724490:0:7465:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1790740154.724492:0:7465:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1790740154.724634:0:7465:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000139583b4 00000020:01000004:0.0:1790740154.724651:0:7465:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:0.0:1790740154.724661:0:7465:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1790740154.724675:0:7465:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (000000009544b4b0) 00000020:00000080:0.0:1790740154.724690:0:7465:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1790740154.783754:0:7465:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:3.0:1790740154.783943:0:7465:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:3.0:1790740154.817942:0:7465:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1790740154.819824:0:7465:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1790740154.819837:0:7465:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:3.0:1790740154.819852:0:7465:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb25dda4f4e92d721 00000020:01000004:3.0:1790740154.819859:0:7465:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1790740154.819888:0:7465:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.103@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1790740154.819891:0:7465:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1790740154.819898:0:7465:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1790740154.819939:0:7465:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1790740154.819943:0:7465:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.103@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1790740154.858771:0:7465:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.103@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790740154.858816:0:7465:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.103@tcp, index=0001, flags=0x20061 00000020:01000004:2.0:1790740154.858825:0:7465:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790740154.858827:0:7465:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1790740154.858828:0:7465:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790740154.858830:0:7465:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790740154.858831:0:7465:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790740154.858832:0:7465:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790740154.858833:0:7465:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790740154.858835:0:7465:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790740154.858836:0:7465:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790740154.858837:0:7465:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790740154.858838:0:7465:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790740154.858841:0:7465:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:2.0:1790740154.858844:0:7465:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790740154.858845:0:7465:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1790740154.858846:0:7465:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790740154.858847:0:7465:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790740154.858847:0:7465:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790740154.858848:0:7465:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790740154.858849:0:7465:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790740154.858850:0:7465:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790740154.858850:0:7465:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790740154.858851:0:7465:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790740154.858852:0:7465:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790740154.858880:0:7465:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1790740154.858900:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b68d749a pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:7465:1877727021896064:0@lo:253: 00000100:00100000:2.0:1790740154.859072:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740154.859116:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 0000000094cc1679 going to sleep for 11 seconds 00000100:00100000:0.0:1790740154.859225:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021896064 00000100:00100000:0.0:1790740154.859234:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021896064 00000100:00100000:0.0:1790740154.859294:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790740154.859303:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000008df79b3f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+12:7465:x1877727021896064:12345-0@lo:253: 20000000:01000000:0.0:1790740154.859346:0:6528:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1790740154.859358:0:6528:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:0.0:1790740154.859362:0:6528:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:0.0:1790740154.859365:0:6528:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:0.0:1790740154.859406:0:6528:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:0.0:1790740154.859657:0:6528:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790740154.859790:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1790740154.859804:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1790740154.859943:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1790740154.859965:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1790740154.859982:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1790740154.860129:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:0.0:1790740154.860139:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:0.0:1790740154.860273:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:0.0:1790740154.860283:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:0.0:1790740154.860299:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:0.0:1790740154.860305:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:0.0:1790740154.860379:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1790740154.860397:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1790740154.860510:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:0.0:1790740154.860521:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.103@tcp (null) (null) (null) 00000040:00080000:0.0:1790740154.860533:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:0.0:1790740154.860539:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1790740154.860552:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:0.0:1790740154.860558:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.204.103@tcp (null) (null) 00000040:00080000:0.0:1790740154.860569:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:0.0:1790740154.860574:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1790740154.860587:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1790740154.860601:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1790740154.860610:0:6528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1790740154.860706:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:0.0:1790740154.860716:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:0.0:1790740154.860752:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1790740154.860783:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1790740154.860803:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:0.0:1790740154.860808:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:0.0:1790740154.861803:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1790740154.861867:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1790740154.861875:0:6528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:0.0:1790740154.862086:0:6528:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1790740154.862094:0:6528:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00010000:00010000:2.0:1790740154.862180:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790740154.863507:0:7471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1790740154.863852:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1790740154.863879:0:6528:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.103@tcp for mdt 20000000:01000000:2.0:1790740154.863881:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.103@tcp (null) (null) (null) 00000040:00080000:2.0:1790740154.863897:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1790740154.863904:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1790740154.863918:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1790740154.863924:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.204.103@tcp (null) (null) 00000040:00080000:2.0:1790740154.865902:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1790740154.866028:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:2.0:1790740154.866498:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:2.0:1790740154.866521:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:2.0:1790740154.866748:0:6528:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:2.0:1790740154.866760:0:6528:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:0.0:1790740154.868656:0:7472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:2.0:1790740154.868938:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1790740154.872841:0:6528:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.204.103@tcp for mdt 20000000:01000000:2.0:1790740154.872844:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.103@tcp (null) (null) (null) 00000040:00080000:2.0:1790740154.872886:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1790740154.872894:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1790740154.872908:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1790740154.872913:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.204.103@tcp (null) (null) 00000040:00080000:2.0:1790740154.872925:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1790740154.872932:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:2.0:1790740154.872964:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1790740154.872996:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:2.0:1790740154.873027:0:6528:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1790740154.873052:0:6528:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1790740154.873056:0:6528:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1790740154.873456:0:6528:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1790740154.873459:0:6528:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1790740154.874670:0:7473:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1790740154.874709:0:7473:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1790740154.874726:0:7473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1790740154.874936:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1790740154.874961:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1790740154.874990:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1790740154.875002:0:6528:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1790740154.875005:0:6528:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1790740154.876381:0:7474:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1790740154.876425:0:7474:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1790740154.876522:0:7474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1790740154.879304:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:2.0:1790740154.879337:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:2.0:1790740154.879352:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:2.0:1790740154.879362:0:6528:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1790740154.879365:0:6528:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1790740154.879842:0:7475:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1790740154.879865:0:7475:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1790740154.879879:0:7475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:2.0:1790740154.880342:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:2.0:1790740154.880375:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:2.0:1790740154.880393:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:2.0:1790740154.880407:0:6528:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1790740154.880409:0:6528:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1790740154.880415:0:6528:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1790740154.880421:0:6528:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1790740154.880917:0:7476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:2.0:1790740154.881270:0:6528:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:2.0:1790740154.906673:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1790740154.906752:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000398877b6/0xb25dda4f4e92d728 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740154.906788:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e1a44156/0xb25dda4f4e92d65d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d656 expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740154.906794:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000009fd80866/0xb25dda4f4e92d679 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d672 expref: 12 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740154.906799:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000063a6c57a/0xb25dda4f4e92d6e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d6e2 expref: 12 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740154.906806:0:6528:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000398877b6/0xb25dda4f4e92d728 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740154.906863:0:6528:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000063a6c57a/0xb25dda4f4e92d6e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92d6e2 expref: 12 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740154.906876:0:6528:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000063a6c57a/0xb25dda4f4e92d6e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92d6e2 expref: 12 pid: 6530 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740154.906891:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000449a4cf7 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6528:1877727021896192:0@lo:104: 00000100:00100000:3.0:1790740154.906957:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790740154.907021:0:6528:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000009fd80866/0xb25dda4f4e92d679 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92d672 expref: 12 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740154.907028:0:6528:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000009fd80866/0xb25dda4f4e92d679 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92d672 expref: 12 pid: 6530 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740154.907061:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000026e22c42 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6528:1877727021896320:0@lo:104: 00000100:00100000:3.0:1790740154.907082:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790740154.907107:0:6528:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e1a44156/0xb25dda4f4e92d65d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92d656 expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740154.907120:0:6528:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e1a44156/0xb25dda4f4e92d65d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92d656 expref: 12 pid: 6529 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740154.907129:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000030d2cd58 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6528:1877727021896448:0@lo:104: 00000100:00100000:0.0:1790740154.907333:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021896192 00000100:00100000:0.0:1790740154.907342:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021896192 00000100:00100000:0.0:1790740154.907382:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021896320 00000100:00100000:0.0:1790740154.907385:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021896320 00000100:00100000:0.0:1790740154.907399:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790740154.907407:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000dd2c6164 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+4:6528:x1877727021896192:12345-0@lo:104: 00010000:00010000:0.0:1790740154.907419:0:6518:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: 000000005ec44627/0xb25dda4f4e92d6e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d6e9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740154.907486:0:6518:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790740154.907491:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000dd2c6164 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+4:6528:x1877727021896192:12345-0@lo:104: Request processed in 86us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740154.907499:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790740154.907517:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790740154.907522:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000038c189f8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+3:6528:x1877727021896320:12345-0@lo:104: 00010000:00010000:0.0:1790740154.907538:0:6518:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: 00000000cf9530c0/0xb25dda4f4e92d672 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d679 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740154.907572:0:6518:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790740154.907576:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000038c189f8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+3:6528:x1877727021896320:12345-0@lo:104: Request processed in 55us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740154.907582:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1790740154.907597:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790740154.907602:0:6524:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: 000000005ec44627/0xb25dda4f4e92d6e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d6e9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740154.907610:0:6524:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock 000000005ec44627 already unused, calling callback (0000000092620f45) 10000000:00010000:0.0:1790740154.907613:0:6524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: 000000005ec44627/0xb25dda4f4e92d6e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92d6e9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740154.907620:0:6524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: 000000005ec44627/0xb25dda4f4e92d6e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92d6e9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790740154.907638:0:6524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: 000000005ec44627/0xb25dda4f4e92d6e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92d6e9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740154.907644:0:6524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790740154.907668:0:6524:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: 000000005ec44627/0xb25dda4f4e92d6e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d6e9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740154.907675:0:6524:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790740154.907692:0:6524:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: 000000005ec44627/0xb25dda4f4e92d6e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d6e9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740154.907698:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: 000000005ec44627/0xb25dda4f4e92d6e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d6e9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740154.907717:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790740154.907720:0:6524:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: 00000000cf9530c0/0xb25dda4f4e92d672 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d679 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740154.907725:0:6524:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock 00000000cf9530c0 already unused, calling callback (0000000092620f45) 10000000:00010000:0.0:1790740154.907727:0:6524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: 00000000cf9530c0/0xb25dda4f4e92d672 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92d679 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740154.907733:0:6524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: 00000000cf9530c0/0xb25dda4f4e92d672 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92d679 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790740154.907738:0:6524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: 00000000cf9530c0/0xb25dda4f4e92d672 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92d679 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740154.907743:0:6524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790740154.907754:0:6524:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: 00000000cf9530c0/0xb25dda4f4e92d672 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d679 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740154.907760:0:6524:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790740154.907771:0:6524:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: 00000000cf9530c0/0xb25dda4f4e92d672 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d679 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740154.907777:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: 00000000cf9530c0/0xb25dda4f4e92d672 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d679 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740154.907786:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740154.907788:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740154.907789:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740154.907795:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740154.907811:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a6caf131 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3639:1877727021896576:0@lo:103: 00000100:00100000:0.0:1790740154.907856:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740154.907891:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005530cf58 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727021896704:0@lo:103: 00000100:00100000:0.0:1790740154.907913:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740154.907943:0:6520:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021896576 00000100:00100000:0.0:1790740154.907946:0:6520:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021896576 00010000:00010000:0.0:1790740154.907966:0:6520:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000063a6c57a/0xb25dda4f4e92d6e9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d6e2 expref: 13 pid: 6530 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740154.907986:0:6520:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021896704 00000100:00100000:0.0:1790740154.907989:0:6520:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021896704 00010000:00010000:0.0:1790740154.907999:0:6520:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000009fd80866/0xb25dda4f4e92d679 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d672 expref: 14 pid: 6530 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740154.908010:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790740154.908016:0:6520:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000069aff066 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+14:3639:x1877727021896576:12345-0@lo:103: 00010000:00010000:0.0:1790740154.908026:0:6520:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740154.908049:0:6520:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000063a6c57a/0xb25dda4f4e92d6e9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d6e2 expref: 14 pid: 6530 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740154.908058:0:6520:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000063a6c57a/0xb25dda4f4e92d6e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92d6e2 expref: 14 pid: 6530 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740154.908074:0:6520:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740154.908100:0:6520:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000069aff066 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+14:3639:x1877727021896576:12345-0@lo:103: Request processed in 85us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740154.908107:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790740154.908121:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790740154.908127:0:6520:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000009a6def53 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+13:3640:x1877727021896704:12345-0@lo:103: 00010000:00010000:0.0:1790740154.908424:0:6520:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740154.908429:0:6520:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000009fd80866/0xb25dda4f4e92d679 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d672 expref: 13 pid: 6530 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740154.908438:0:6520:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000009fd80866/0xb25dda4f4e92d679 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92d672 expref: 13 pid: 6530 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740154.908547:0:6520:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740154.908580:0:6520:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000009a6def53 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+13:3640:x1877727021896704:12345-0@lo:103: Request processed in 454us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740154.908586:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790740154.911645:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005530cf58 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727021896704:0@lo:103: 00000100:00100000:0.0:1790740154.911729:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a6caf131 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3639:1877727021896576:0@lo:103: 00000100:00100000:3.0:1790740154.912672:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740154.912712:0:6528:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cdc6b2df going to sleep for 11 seconds 00010000:00010000:3.0:1790740154.912731:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000063a6c57a/0xb25dda4f4e92d6e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92d6e2 expref: 12 pid: 6530 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740154.912745:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000449a4cf7 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6528:1877727021896192:0@lo:104: 00010000:00010000:3.0:1790740154.912754:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009fd80866/0xb25dda4f4e92d679 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92d672 expref: 11 pid: 6530 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740154.912762:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000026e22c42 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6528:1877727021896320:0@lo:104: 00000100:00100000:0.0:1790740154.913954:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021896448 00000100:00100000:0.0:1790740154.913966:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021896448 00000100:00100000:0.0:1790740154.914064:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790740154.914074:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000bbde2f8a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+3:6528:x1877727021896448:12345-0@lo:104: 00010000:00010000:0.0:1790740154.914093:0:6518:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: 00000000e5f2e4ec/0xb25dda4f4e92d656 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d65d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740154.914202:0:6518:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790740154.914208:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000bbde2f8a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+3:6528:x1877727021896448:12345-0@lo:104: Request processed in 137us (1540us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740154.914215:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790740154.914650:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000030d2cd58 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6528:1877727021896448:0@lo:104: 00010000:00010000:2.0:1790740154.914678:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000398877b6/0xb25dda4f4e92d728 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740154.914892:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790740154.914898:0:6524:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: 00000000e5f2e4ec/0xb25dda4f4e92d656 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d65d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740154.914926:0:6524:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock 00000000e5f2e4ec already unused, calling callback (0000000092620f45) 10000000:00010000:0.0:1790740154.914930:0:6524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: 00000000e5f2e4ec/0xb25dda4f4e92d656 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92d65d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740154.914938:0:6524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: 00000000e5f2e4ec/0xb25dda4f4e92d656 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92d65d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790740154.914944:0:6524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: 00000000e5f2e4ec/0xb25dda4f4e92d656 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92d65d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740154.914950:0:6524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790740154.914995:0:6524:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: 00000000e5f2e4ec/0xb25dda4f4e92d656 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d65d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740154.915002:0:6524:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790740154.915108:0:6524:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: 00000000e5f2e4ec/0xb25dda4f4e92d656 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d65d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740154.915116:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: 00000000e5f2e4ec/0xb25dda4f4e92d656 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d65d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740154.915177:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a6caf131 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3641:1877727021896832:0@lo:103: 00010000:00010000:0.0:1790740154.915201:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740154.915204:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740154.915205:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740154.915226:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740154.915355:0:6520:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021896832 00000100:00100000:0.0:1790740154.915362:0:6520:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021896832 00010000:00010000:0.0:1790740154.915384:0:6520:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e1a44156/0xb25dda4f4e92d65d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d656 expref: 11 pid: 6529 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740154.915416:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790740154.915431:0:6520:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000052f2a0e2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+11:3641:x1877727021896832:12345-0@lo:103: 00010000:00010000:0.0:1790740154.915445:0:6520:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740154.915449:0:6520:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e1a44156/0xb25dda4f4e92d65d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d656 expref: 11 pid: 6529 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740154.915460:0:6520:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e1a44156/0xb25dda4f4e92d65d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92d656 expref: 11 pid: 6529 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740154.915473:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e1a44156/0xb25dda4f4e92d65d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92d656 expref: 11 pid: 6529 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740154.915486:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000398877b6/0xb25dda4f4e92d728 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740154.915494:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000398877b6/0xb25dda4f4e92d728 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740154.915508:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000398877b6/0xb25dda4f4e92d728 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740154.915514:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000398877b6/0xb25dda4f4e92d728 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740154.915520:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000398877b6/0xb25dda4f4e92d728 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740154.915525:0:6520:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000398877b6/0xb25dda4f4e92d728 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740154.915529:0:6520:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock 00000000398877b6 already unused, calling callback (0000000006bfcbe5) 00010000:00010000:0.0:1790740154.915532:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000398877b6/0xb25dda4f4e92d728 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740154.915559:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000398877b6/0xb25dda4f4e92d728 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740154.915579:0:6520:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000398877b6/0xb25dda4f4e92d728 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740154.915597:0:6520:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790740154.915609:0:6528:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000398877b6/0xb25dda4f4e92d728 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740154.915616:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000398877b6/0xb25dda4f4e92d728 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740154.915631:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000398877b6/0xb25dda4f4e92d728 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740154.915641:0:6520:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000052f2a0e2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+10:3641:x1877727021896832:12345-0@lo:103: Request processed in 212us (416us total) trans 0 rc 0/0 20000000:01000000:3.0:1790740154.915646:0:6528:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1790740154.915648:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790740154.915675:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a6caf131 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3641:1877727021896832:0@lo:103: 00000100:00100000:2.0:1790740154.919855:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000008df79b3f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+9:7465:x1877727021896064:12345-0@lo:253: Request processed in 60543us (60773us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740154.919875:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790740154.919993:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b68d749a pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:7465:1877727021896064:0@lo:253: 10000000:01000000:3.0:1790740154.920008:0:7465:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1790740154.920011:0:7465:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790740154.920013:0:7465:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1790740154.920022:0:7465:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790740154.920024:0:7465:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:3.0:1790740154.920025:0:7465:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790740154.920027:0:7465:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790740154.920028:0:7465:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790740154.920049:0:7465:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1790740154.920051:0:7465:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790740154.920052:0:7465:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1790740154.920074:0:7465:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000139583b4 from lustre-MDT0001 10000000:01000000:3.0:1790740154.920106:0:7465:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1790740154.920109:0:7465:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1790740154.920116:0:7465:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98dc992499c0 local copy 10000000:01000000:3.0:1790740154.920120:0:7465:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1790740154.920156:0:7465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: 0000000047b67b4f/0xb25dda4f4e92d72f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740154.920167:0:7465:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.103@tcp lock: 0000000047b67b4f/0xb25dda4f4e92d72f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740154.920175:0:7465:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: 0000000047b67b4f/0xb25dda4f4e92d72f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740154.920193:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000951df8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:7465:1877727021896960:0@lo:101: 00000100:00100000:3.0:1790740154.920229:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740154.920258:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 0000000019161c1c going to sleep for 11 seconds 00000100:00100000:2.0:1790740154.920310:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021896960 00000100:00100000:2.0:1790740154.920317:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021896960 00000100:00100000:2.0:1790740154.920362:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790740154.920369:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000002f75246c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+9:7465:x1877727021896960:12345-0@lo:101: 00010000:00010000:2.0:1790740154.920382:0:6529:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740154.920395:0:6529:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000de8e24e7/0xb25dda4f4e92d736 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92d72f expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740154.920424:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000de8e24e7/0xb25dda4f4e92d736 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92d72f expref: 10 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740154.920445:0:6529:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000de8e24e7/0xb25dda4f4e92d736 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d72f expref: 10 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740154.920453:0:6529:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000de8e24e7, rc 0) 00000100:00100000:2.0:1790740154.920497:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000002f75246c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+10:7465:x1877727021896960:12345-0@lo:101: Request processed in 129us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740154.920503:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790740154.920678:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000951df8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:7465:1877727021896960:0@lo:101: 00010000:00010000:0.0:1790740154.920692:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: 0000000047b67b4f/0xb25dda4f4e92d72f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xb25dda4f4e92d736 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740154.920699:0:7465:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: 0000000047b67b4f/0xb25dda4f4e92d72f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb25dda4f4e92d736 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740154.920786:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a6caf131 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:7465:1877727021897088:0@lo:501: 00000100:00100000:0.0:1790740154.920812:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740154.920839:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ed712362 going to sleep for 11 seconds 00000100:00100000:3.0:1790740154.920915:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021897088 00000100:00100000:3.0:1790740154.920920:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021897088 00000100:00100000:3.0:1790740154.920954:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790740154.920960:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000056204795 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+10:7465:x1877727021897088:12345-0@lo:501: 00000100:00100000:3.0:1790740154.921017:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000056204795 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+10:7465:x1877727021897088:12345-0@lo:501: Request processed in 58us (205us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790740154.921023:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790740154.921124:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a6caf131 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:7465:1877727021897088:0@lo:501: 10000000:01000000:0.0:1790740154.921136:0:7465:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1790740154.921153:0:7465:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1790740154.921158:0:7465:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: 0000000047b67b4f/0xb25dda4f4e92d72f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb25dda4f4e92d736 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740154.921174:0:7465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: 0000000047b67b4f/0xb25dda4f4e92d72f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb25dda4f4e92d736 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740154.921180:0:7465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: 0000000047b67b4f/0xb25dda4f4e92d72f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb25dda4f4e92d736 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740154.921200:0:7465:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1790740154.921220:0:7465:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98dca0cb4800 10000000:01000000:0.0:1790740154.921225:0:7465:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1790740154.921230:0:7465:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff98dc992499c0 10000000:01000000:0.0:1790740154.921232:0:7465:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1790740154.921236:0:7465:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff98dc992499c0 from 1 10000000:01000000:0.0:1790740154.921238:0:7465:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1790740154.921253:0:7465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: 00000000315dde9d/0xb25dda4f4e92d73d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740154.921260:0:7465:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: 00000000315dde9d/0xb25dda4f4e92d73d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740154.921267:0:7465:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: 00000000315dde9d/0xb25dda4f4e92d73d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740154.921279:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a6caf131 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:7465:1877727021897216:0@lo:101: 00000100:00100000:0.0:1790740154.921302:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740154.921313:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f2ec9ad1 going to sleep for 11 seconds 00010000:00010000:3.0:1790740154.921469:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740154.921475:0:6523:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: 0000000047b67b4f/0xb25dda4f4e92d72f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xb25dda4f4e92d736 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740154.921483:0:6523:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock 0000000047b67b4f already unused, calling callback (0000000092620f45) 10000000:00010000:3.0:1790740154.921486:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: 0000000047b67b4f/0xb25dda4f4e92d72f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xb25dda4f4e92d736 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740154.921494:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: 0000000047b67b4f/0xb25dda4f4e92d72f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xb25dda4f4e92d736 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790740154.921500:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: 0000000047b67b4f/0xb25dda4f4e92d72f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xb25dda4f4e92d736 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740154.921506:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790740154.921523:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: 0000000047b67b4f/0xb25dda4f4e92d72f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xb25dda4f4e92d736 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740154.921529:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1790740154.921676:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1790740154.922486:0:6523:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: 0000000047b67b4f/0xb25dda4f4e92d72f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xb25dda4f4e92d736 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740154.922497:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: 0000000047b67b4f/0xb25dda4f4e92d72f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xb25dda4f4e92d736 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740154.922521:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740154.922523:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740154.922525:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740154.922563:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021897216 00000100:00100000:3.0:1790740154.922572:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021897216 00000100:00100000:3.0:1790740154.922618:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790740154.922636:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000a8492045 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+10:7465:x1877727021897216:12345-0@lo:101: 00010000:00010000:3.0:1790740154.922659:0:6530:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740154.922675:0:6530:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008d0757ab/0xb25dda4f4e92d744 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92d73d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740154.922695:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008d0757ab/0xb25dda4f4e92d744 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92d73d expref: 11 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740154.922704:0:6530:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008d0757ab/0xb25dda4f4e92d744 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d73d expref: 11 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740154.922712:0:6530:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008d0757ab, rc 0) 00000100:00100000:3.0:1790740154.922765:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000a8492045 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+11:7465:x1877727021897216:12345-0@lo:101: Request processed in 132us (1463us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740154.922772:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790740154.922944:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a6caf131 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:7465:1877727021897216:0@lo:101: 00010000:00010000:0.0:1790740154.922960:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: 00000000315dde9d/0xb25dda4f4e92d73d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d744 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740154.922979:0:7465:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: 00000000315dde9d/0xb25dda4f4e92d73d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92d744 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740154.922999:0:7465:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1790740154.923018:0:7465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: 00000000315dde9d/0xb25dda4f4e92d73d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d744 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740154.923026:0:7465:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: 00000000315dde9d/0xb25dda4f4e92d73d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d744 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740154.923054:0:7465:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff98dca0cb4800 10000000:01000000:0.0:1790740154.923059:0:7465:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1790740154.923064:0:7465:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff98dca0cb4800 from 1 10000000:01000000:0.0:1790740154.923066:0:7465:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1790740154.923084:0:7465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: 00000000448fbf27/0xb25dda4f4e92d74b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740154.923091:0:7465:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: 00000000448fbf27/0xb25dda4f4e92d74b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740154.923099:0:7465:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: 00000000448fbf27/0xb25dda4f4e92d74b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740154.923117:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a6caf131 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:7465:1877727021897472:0@lo:101: 00000100:00100000:0.0:1790740154.923148:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740154.923173:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f2ec9ad1 going to sleep for 11 seconds 00000100:00100000:1.0:1790740154.923259:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021897472 00000100:00100000:1.0:1790740154.923264:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021897472 00000100:00100000:1.0:1790740154.923290:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790740154.923295:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000007f6b997c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+11:7465:x1877727021897472:12345-0@lo:101: 00010000:00010000:1.0:1790740154.923303:0:6528:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740154.923311:0:6528:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004d3d945d/0xb25dda4f4e92d752 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92d74b expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740154.923338:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004d3d945d/0xb25dda4f4e92d752 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92d74b expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740154.923346:0:6528:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004d3d945d/0xb25dda4f4e92d752 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d74b expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740154.923352:0:6528:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004d3d945d, rc 0) 00000100:00100000:1.0:1790740154.923390:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000007f6b997c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+12:7465:x1877727021897472:12345-0@lo:101: Request processed in 95us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740154.923396:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790740154.923408:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a6caf131 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:7465:1877727021897472:0@lo:101: 00010000:00010000:3.0:1790740154.923418:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: 00000000448fbf27/0xb25dda4f4e92d74b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d752 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740154.923425:0:7465:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: 00000000448fbf27/0xb25dda4f4e92d74b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92d752 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740154.923435:0:7465:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1790740154.923451:0:7465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: 00000000448fbf27/0xb25dda4f4e92d74b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d752 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740154.923457:0:7465:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: 00000000448fbf27/0xb25dda4f4e92d74b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d752 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740154.923463:0:7465:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1790740154.923472:0:7465:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790740154.923477:0:7465:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff98dca0cb4800 10000000:01000000:3.0:1790740154.923479:0:7465:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1790740154.923483:0:7465:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1790740154.923485:0:7465:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1790740154.923498:0:7465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: 00000000b3e8613a/0xb25dda4f4e92d759 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740154.923505:0:7465:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: 00000000b3e8613a/0xb25dda4f4e92d759 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740154.923524:0:7465:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: 00000000b3e8613a/0xb25dda4f4e92d759 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740154.923978:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a5029cbc pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:7465:1877727021897600:0@lo:101: 00000100:00100000:3.0:1790740154.924011:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740154.924061:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 000000006cc17c6a going to sleep for 11 seconds 00000100:00100000:0.0:1790740154.924077:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021897600 00000100:00100000:0.0:1790740154.924081:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021897600 00000100:00100000:0.0:1790740154.924128:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790740154.924144:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000ca39f08d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+12:7465:x1877727021897600:12345-0@lo:101: 00010000:00010000:0.0:1790740154.924154:0:6530:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740154.924163:0:6530:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ee3ffd1f/0xb25dda4f4e92d760 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92d759 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740154.924177:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ee3ffd1f/0xb25dda4f4e92d760 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92d759 expref: 13 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740154.924184:0:6530:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ee3ffd1f/0xb25dda4f4e92d760 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d759 expref: 13 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740154.924189:0:6530:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ee3ffd1f, rc 0) 00000100:00100000:0.0:1790740154.924217:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000ca39f08d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+13:7465:x1877727021897600:12345-0@lo:101: Request processed in 83us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740154.924223:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790740154.924419:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a5029cbc pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:7465:1877727021897600:0@lo:101: 00010000:00010000:3.0:1790740154.924430:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: 00000000b3e8613a/0xb25dda4f4e92d759 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d760 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740154.924450:0:7465:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: 00000000b3e8613a/0xb25dda4f4e92d759 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92d760 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740154.924540:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a5029cbc pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:7465:1877727021897728:0@lo:501: 00000100:00100000:3.0:1790740154.924565:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740154.924899:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 000000006cc17c6a going to sleep for 11 seconds 00000100:00100000:3.0:1790740154.924916:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021897728 00000100:00100000:3.0:1790740154.924920:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021897728 00000100:00100000:3.0:1790740154.924951:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790740154.924956:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000010571058 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+13:7465:x1877727021897728:12345-0@lo:501: 00000100:00100000:3.0:1790740154.925083:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000010571058 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+13:7465:x1877727021897728:12345-0@lo:501: Request processed in 126us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740154.925094:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790740154.925119:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a5029cbc pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:7465:1877727021897728:0@lo:501: 00000100:00100000:3.0:1790740154.925157:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a5029cbc pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:7465:1877727021897856:0@lo:503: 00000100:00100000:3.0:1790740154.925196:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740154.925211:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 000000006cc17c6a going to sleep for 11 seconds 00000100:00100000:3.0:1790740154.925227:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021897856 00000100:00100000:3.0:1790740154.925230:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021897856 00000100:00100000:3.0:1790740154.925244:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790740154.925248:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000b90c756d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+13:7465:x1877727021897856:12345-0@lo:503: 00000100:00100000:3.0:1790740154.925576:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000b90c756d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+13:7465:x1877727021897856:12345-0@lo:503: Request processed in 327us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740154.925584:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790740154.925644:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a5029cbc pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:7465:1877727021897856:0@lo:503: 00000040:00080000:1.0:1790740154.925891:0:7465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790740154.925957:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000197567ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:7465:1877727021897984:0@lo:502: 00000100:00100000:1.0:1790740154.925996:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740154.926028:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 0000000017aa8f57 going to sleep for 11 seconds 00000100:00100000:3.0:1790740154.926253:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021897984 00000100:00100000:3.0:1790740154.926258:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021897984 00000100:00100000:3.0:1790740154.926290:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790740154.926296:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000b7056f2e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+13:7465:x1877727021897984:12345-0@lo:502: 00000100:00100000:3.0:1790740154.926421:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000b7056f2e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+13:7465:x1877727021897984:12345-0@lo:502: Request processed in 125us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740154.926428:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790740154.927084:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bf5f39ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3639:1877727021897344:0@lo:103: 00000100:00100000:0.0:1790740154.927122:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740154.927275:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021897344 00000100:00100000:2.0:1790740154.927282:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021897344 00000100:00100000:2.0:1790740154.927323:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790740154.927330:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000005530cf58 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+13:3639:x1877727021897344:12345-0@lo:103: 00010000:00010000:2.0:1790740154.927343:0:6521:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740154.927361:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000de8e24e7/0xb25dda4f4e92d736 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb25dda4f4e92d72f expref: 13 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740154.927377:0:6521:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740154.927413:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000005530cf58 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+12:3639:x1877727021897344:12345-0@lo:103: Request processed in 83us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740154.927419:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790740154.927422:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bf5f39ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3639:1877727021897344:0@lo:103: 00000100:00100000:1.0:1790740154.928495:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000197567ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:7465:1877727021897984:0@lo:502: 00000040:00080000:1.0:1790740154.928785:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1790740154.928815:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:1.0:1790740154.928829:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:1.0:1790740154.928842:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:1.0:1790740154.928854:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:1.0:1790740154.928865:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:1.0:1790740154.928878:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:1.0:1790740154.928891:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:1.0:1790740154.928905:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:1.0:1790740154.928916:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:1.0:1790740154.928928:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:1.0:1790740154.928939:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:1.0:1790740154.928952:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:1.0:1790740154.928964:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:1.0:1790740154.928976:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:1.0:1790740154.928987:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:1.0:1790740154.928999:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:1.0:1790740154.929011:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:1.0:1790740154.929024:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:1.0:1790740154.929075:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:1.0:1790740154.929088:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:1.0:1790740154.929100:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:1.0:1790740154.929115:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:1.0:1790740154.929148:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000197567ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:7465:1877727021898112:0@lo:502: 00000100:00100000:1.0:1790740154.929213:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740154.929248:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 0000000017aa8f57 going to sleep for 11 seconds 00000100:00100000:2.0:1790740154.929374:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021898112 00000100:00100000:2.0:1790740154.929381:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021898112 00000100:00100000:2.0:1790740154.929428:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790740154.929435:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000004f7cdeec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+12:7465:x1877727021898112:12345-0@lo:502: 00000100:00100000:2.0:1790740154.929550:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000004f7cdeec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+12:7465:x1877727021898112:12345-0@lo:502: Request processed in 115us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740154.929558:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790740154.929707:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000197567ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:7465:1877727021898112:0@lo:502: 00000040:00080000:1.0:1790740154.929754:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:1.0:1790740154.929770:0:7465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:0.0:1790740154.930310:0:7477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790740154.930397:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740154.930400:0:7477:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1790740154.930406:0:7477:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1790740154.930409:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790740154.930435:0:7477:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000f5f7a581) 00000020:00000080:0.0:1790740154.930522:0:7477:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:0.0:1790740154.930531:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1790740154.930620:0:7477:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:0.0:1790740154.930645:0:7477:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb25dda4f4e92d76e 00000020:00000080:0.0:1790740154.931270:0:7477:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1790740154.931276:0:7477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790740154.931280:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740154.931282:0:7477:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1790740154.931284:0:7477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790740154.931288:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740154.931290:0:7477:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1790740154.931293:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790740154.931303:0:7477:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (0000000094a3ba81) 00000020:00000080:0.0:1790740154.931330:0:7477:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:0.0:1790740154.931335:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1790740154.931337:0:7477:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1790740154.931340:0:7477:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1790740154.931345:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1790740154.931402:0:7477:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000139583b4 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1790740154.931416:0:7477:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (000000002184e80f) 00000020:00000080:0.0:1790740154.931425:0:7477:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:0.0:1790740154.931504:0:7477:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1790740154.931510:0:7477:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb25dda4f4e92d783 00000020:00000080:0.0:1790740154.931604:0:7477:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1790740154.931610:0:7477:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1790740154.931614:0:7477:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xb25dda4f4e92d78a 00080000:01000000:0.0:1790740154.931620:0:7477:0:(osd_handler.c:8931:osd_obd_connect()) connect #2 00000020:00000080:0.0:1790740154.931634:0:7477:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb25dda4f4e92d791 00080000:10000000:0.0:1790740154.932084:0:7477:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1790740154.932203:0:7477:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:2.0:1790740155.045746:0:7477:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:2.0:1790740155.045996:0:7477:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:2.0:1790740155.050486:0:7477:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1790740155.050858:0:7477:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1790740155.066129:0:7477:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1790740155.066145:0:7477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790740155.066152:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740155.066154:0:7477:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1790740155.066158:0:7477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790740155.066164:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740155.066166:0:7477:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1790740155.066169:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790740155.066174:0:7477:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.103@tcp to nid 0x20000c0a8cc67 (192.168.204.103@tcp) 00000020:00000080:2.0:1790740155.066201:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790740155.066225:0:7477:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000a38e302d) 00000020:00000080:2.0:1790740155.066259:0:7477:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1790740155.066265:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790740155.066354:0:7477:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1790740155.066361:0:7477:0:(osd_handler.c:8931:osd_obd_connect()) connect #3 00000020:00000080:2.0:1790740155.066367:0:7477:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb25dda4f4e92d79f 00010000:00080000:2.0:1790740155.066399:0:7477:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000e59499a6@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.103@tcp at head 00010000:00010000:2.0:1790740155.067981:0:7477:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:2.0:1790740155.072144:0:7477:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1790740155.072161:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1790740155.072196:0:7477:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1790740155.072216:0:7477:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb25dda4f4e92d7a6 00000100:00080000:2.0:1790740155.072227:0:7477:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790740155.072238:0:7477:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000e59499a6 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:2.0:1790740155.072275:0:7477:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e11bf0e0 x1877727021898240/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790740155.072306:0:7477:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1790740155.072369:0:7477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790740155.072373:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740155.072375:0:7477:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1790740155.072378:0:7477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1790740155.072381:0:7477:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1790740155.072383:0:7477:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790740155.072384:0:7477:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790740155.072385:0:7477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1790740155.072388:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740155.072389:0:7477:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1790740155.072391:0:7477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790740155.072395:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740155.072397:0:7477:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1790740155.072400:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1790740155.072430:0:7477:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1790740155.073715:0:7477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790740155.073726:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740155.073729:0:7477:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1790740155.073732:0:7477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790740155.073735:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740155.073736:0:7477:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790740155.073739:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790740155.073740:0:7477:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790740155.073771:0:7477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790740155.073774:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740155.073775:0:7477:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1790740155.073778:0:7477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:0.0:1790740155.074304:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e11bf0e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877727021898240:0@lo:38: 00000100:00100000:0.0:1790740155.074391:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740155.074503:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d848dcc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877727021898368:0@lo:400: 00000100:00100000:0.0:1790740155.074532:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740155.074571:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021898368 00000100:00100000:0.0:1790740155.074587:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021898368 00000100:00100000:0.0:1790740155.074640:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790740155.074648:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000002866f8a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877727021898368:12345-0@lo:400: 00000100:00100000:0.0:1790740155.074700:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000002866f8a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877727021898368:12345-0@lo:400: Request processed in 53us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740155.074706:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1790740155.074743:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d848dcc0 x1877727021898368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740171 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740155.074756:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d848dcc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877727021898368:0@lo:400: 00000020:01000000:1.0:1790740155.075053:0:7465:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:1.0:1790740155.075092:0:7465:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1790740155.075105:0:7465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: 00000000b3e8613a/0xb25dda4f4e92d759 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d760 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740155.075115:0:7465:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: 00000000b3e8613a/0xb25dda4f4e92d759 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d760 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740155.075123:0:7465:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98dca0cb4800 from 1 10000000:01000000:1.0:1790740155.075125:0:7465:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790740155.075150:0:7465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: 00000000e1a44156/0xb25dda4f4e92d7ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740155.075158:0:7465:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: 00000000e1a44156/0xb25dda4f4e92d7ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740155.075168:0:7465:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: 00000000e1a44156/0xb25dda4f4e92d7ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740155.075182:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000197567ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:7465:1877727021898496:0@lo:101: 00000100:00100000:1.0:1790740155.075217:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740155.075242:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 0000000017aa8f57 going to sleep for 11 seconds 00000100:00100000:1.0:1790740155.075264:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021898240 00000100:00100000:1.0:1790740155.075268:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021898240 00000100:00100000:1.0:1790740155.075290:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790740155.075295:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000008afa8b5b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1877727021898240:12345-0@lo:38: 00010000:00080000:1.0:1790740155.075326:0:6540:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 226 last 0 00000020:00000080:1.0:1790740155.075359:0:6540:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb25dda4f4e92d7b4 00000004:00100000:1.0:1790740155.075373:0:6540:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1790740155.075385:0:6540:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1790740155.076057:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021898496 00000100:00100000:1.0:1790740155.076064:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021898496 00000100:00100000:1.0:1790740155.076104:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790740155.076111:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000004d4948e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+12:7465:x1877727021898496:12345-0@lo:101: 00010000:00010000:1.0:1790740155.076122:0:6530:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740155.076135:0:6530:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e308c08b/0xb25dda4f4e92d7bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92d7ad expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740155.076156:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e308c08b/0xb25dda4f4e92d7bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92d7ad expref: 13 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740155.076166:0:6530:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e308c08b/0xb25dda4f4e92d7bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d7ad expref: 13 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740155.076174:0:6530:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e308c08b, rc 0) 00000100:00100000:1.0:1790740155.076216:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000004d4948e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+13:7465:x1877727021898496:12345-0@lo:101: Request processed in 107us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740155.076223:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790740155.076263:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000197567ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:7465:1877727021898496:0@lo:101: 00010000:00010000:1.0:1790740155.076276:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: 00000000e1a44156/0xb25dda4f4e92d7ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d7bb expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740155.076284:0:7465:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: 00000000e1a44156/0xb25dda4f4e92d7ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92d7bb expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740155.076941:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000197567ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:7465:1877727021898624:0@lo:256: 00000100:00100000:1.0:1790740155.076986:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740155.080776:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 0000000017aa8f57 going to sleep for 11 seconds 00000100:00100000:0.0:1790740155.081199:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021898624 00000100:00100000:0.0:1790740155.081209:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021898624 00000100:00100000:0.0:1790740155.081255:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790740155.081264:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000a00d97e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+13:7465:x1877727021898624:12345-0@lo:256: 20000000:01000000:0.0:1790740155.081290:0:6529:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1790740155.081322:0:6529:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1790740155.081325:0:6529:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1790740155.081650:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000a00d97e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+13:7465:x1877727021898624:12345-0@lo:256: Request processed in 387us (4664us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740155.081658:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790740155.082388:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000197567ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:7465:1877727021898624:0@lo:256: 10000000:01000000:1.0:1790740155.083998:0:7465:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790740155.084023:0:7465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: 00000000e1a44156/0xb25dda4f4e92d7ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d7bb expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740155.085015:0:7465:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: 00000000e1a44156/0xb25dda4f4e92d7ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d7bb expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740155.085202:0:7465:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98dca0cb4800 from 1 10000000:01000000:0.0:1790740155.085206:0:7465:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790740155.085244:0:7465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: 00000000e5f2e4ec/0xb25dda4f4e92d7c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740155.085253:0:7465:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: 00000000e5f2e4ec/0xb25dda4f4e92d7c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740155.085263:0:7465:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: 00000000e5f2e4ec/0xb25dda4f4e92d7c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740155.085292:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d848dcc0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:7465:1877727021898752:0@lo:101: 00000100:00100000:0.0:1790740155.085365:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740155.085401:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 000000003393d7b5 going to sleep for 11 seconds 00000100:00100000:0.0:1790740155.085425:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021898752 00000100:00100000:0.0:1790740155.085433:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021898752 00000100:00100000:0.0:1790740155.085502:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790740155.085511:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000388f8e01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+13:7465:x1877727021898752:12345-0@lo:101: 00010000:00010000:0.0:1790740155.085525:0:6529:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740155.085536:0:6529:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007f1b7985/0xb25dda4f4e92d7c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92d7c2 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740155.085559:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007f1b7985/0xb25dda4f4e92d7c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92d7c2 expref: 14 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740155.085569:0:6529:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007f1b7985/0xb25dda4f4e92d7c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d7c2 expref: 14 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740155.085577:0:6529:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007f1b7985, rc 0) 00000100:00100000:0.0:1790740155.085614:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000388f8e01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+14:7465:x1877727021898752:12345-0@lo:101: Request processed in 105us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740155.085632:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790740155.085684:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d848dcc0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:7465:1877727021898752:0@lo:101: 00010000:00010000:0.0:1790740155.085698:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: 00000000e5f2e4ec/0xb25dda4f4e92d7c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d7c9 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740155.085706:0:7465:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: 00000000e5f2e4ec/0xb25dda4f4e92d7c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92d7c9 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740155.085816:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d848dcc0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:7465:1877727021898880:0@lo:501: 00000100:00100000:0.0:1790740155.085842:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740155.085857:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 000000003393d7b5 going to sleep for 11 seconds 00000100:00100000:0.0:1790740155.085869:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021898880 00000100:00100000:0.0:1790740155.085873:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021898880 00000100:00100000:0.0:1790740155.085896:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790740155.085902:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000037820d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+14:7465:x1877727021898880:12345-0@lo:501: 00000100:00100000:0.0:1790740155.085981:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000037820d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+14:7465:x1877727021898880:12345-0@lo:501: Request processed in 80us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740155.085988:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790740155.086015:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d848dcc0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:7465:1877727021898880:0@lo:501: 00000100:00100000:0.0:1790740155.086070:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d848dcc0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:7465:1877727021899008:0@lo:503: 00000100:00100000:0.0:1790740155.086105:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740155.086123:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021899008 00000100:00100000:0.0:1790740155.086126:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021899008 00000100:00100000:0.0:1790740155.086141:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790740155.086146:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000db7a8d7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+14:7465:x1877727021899008:12345-0@lo:503: 00000040:00080000:0.0:1790740155.086183:0:6529:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790740155.086214:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000db7a8d7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+14:7465:x1877727021899008:12345-0@lo:503: Request processed in 67us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740155.086221:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790740155.086250:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 000000003393d7b5 going to sleep for 11 seconds 00000100:00100000:0.0:1790740155.086261:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d848dcc0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:7465:1877727021899008:0@lo:503: 00000040:00080000:0.0:1790740155.086490:0:7465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790740155.086548:0:7465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:0.0:1790740155.086616:0:7465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:1.0:1790740155.087861:0:6540:0:(import.c:65:import_set_state_nolock()) 00000000a8d66212 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790740155.087948:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000008afa8b5b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3637:x1877727021898240:12345-0@lo:38: Request processed in 12651us (13556us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740155.087958:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790740155.088061:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790740155.088070:0:3637:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1790740155.088077:0:3637:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1790740155.088081:0:3637:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790740155.088089:0:3637:0:(import.c:65:import_set_state_nolock()) 00000000e59499a6 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790740155.088100:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e11bf0e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877727021898240:0@lo:38: 00000100:00100000:1.0:1790740155.088200:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e11bf0e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021899136:0@lo:41: 00000100:00100000:1.0:1790740155.088237:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740155.088328:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021899136 00000100:00100000:2.0:1790740155.088335:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021899136 00000100:00100000:2.0:1790740155.088375:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790740155.088382:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000197567ed pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3640:x1877727021899136:12345-0@lo:41: 00000004:00000024:2.0:1790740155.088406:0:6541:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1790740155.088716:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000197567ed pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3640:x1877727021899136:12345-0@lo:41: Request processed in 334us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740155.088723:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790740155.088788:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e11bf0e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021899136:0@lo:41: 00000040:00080000:1.0:1790740155.089907:0:7482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:0.0:1790740155.090267:0:7465:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1790740155.090304:0:7465:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790740155.090445:0:7465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: 00000000e5f2e4ec/0xb25dda4f4e92d7c2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d7c9 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740155.090459:0:7465:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: 00000000e5f2e4ec/0xb25dda4f4e92d7c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d7c9 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740155.090512:0:7465:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1790740155.090516:0:7465:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98dca0cb4800 10000000:01000000:0.0:1790740155.090519:0:7465:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98dca0cb4800 10000000:01000000:0.0:1790740155.090523:0:7465:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790740155.090529:0:7465:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98dca0cb4800 from 1 10000000:01000000:0.0:1790740155.090532:0:7465:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790740155.090564:0:7465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: 0000000004a9c349/0xb25dda4f4e92d7d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740155.090572:0:7465:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: 0000000004a9c349/0xb25dda4f4e92d7d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740155.090582:0:7465:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: 0000000004a9c349/0xb25dda4f4e92d7d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740155.090601:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d848dcc0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:7465:1877727021899264:0@lo:101: 00000100:00100000:0.0:1790740155.090671:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740155.090712:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f2ec9ad1 going to sleep for 11 seconds 00000100:00100000:2.0:1790740155.090838:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021899264 00000100:00100000:2.0:1790740155.090845:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021899264 00000100:00100000:2.0:1790740155.090891:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790740155.090899:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000004a46f39e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+14:7465:x1877727021899264:12345-0@lo:101: 00010000:00010000:2.0:1790740155.090912:0:6529:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740155.090924:0:6529:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000de8e24e7/0xb25dda4f4e92d7d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92d7d0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740155.090945:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000de8e24e7/0xb25dda4f4e92d7d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92d7d0 expref: 15 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740155.090955:0:6529:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000de8e24e7/0xb25dda4f4e92d7d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d7d0 expref: 15 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740155.090964:0:6529:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000de8e24e7, rc 0) 00000100:00100000:2.0:1790740155.091012:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000004a46f39e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:7465:x1877727021899264:12345-0@lo:101: Request processed in 114us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740155.091018:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790740155.091241:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d848dcc0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:7465:1877727021899264:0@lo:101: 00010000:00010000:3.0:1790740155.091254:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: 0000000004a9c349/0xb25dda4f4e92d7d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d7d7 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740155.091270:0:7465:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: 0000000004a9c349/0xb25dda4f4e92d7d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92d7d7 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740155.091363:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bf5f39ac pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:7465:1877727021899392:0@lo:501: 00000100:00100000:3.0:1790740155.091390:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740155.091423:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a35fe62e going to sleep for 11 seconds 00000100:00100000:0.0:1790740155.091564:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021899392 00000100:00100000:0.0:1790740155.091569:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021899392 00000100:00100000:0.0:1790740155.091600:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790740155.091612:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000003c5f3cbf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:7465:x1877727021899392:12345-0@lo:501: 00000100:00100000:0.0:1790740155.091720:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000003c5f3cbf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:7465:x1877727021899392:12345-0@lo:501: Request processed in 109us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740155.091727:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790740155.091825:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bf5f39ac pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:7465:1877727021899392:0@lo:501: 00000100:00100000:3.0:1790740155.091864:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bf5f39ac pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:7465:1877727021899520:0@lo:503: 00000100:00100000:3.0:1790740155.091897:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740155.091921:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a35fe62e going to sleep for 11 seconds 00000100:00100000:0.0:1790740155.091975:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021899520 00000100:00100000:0.0:1790740155.091980:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021899520 00000100:00100000:0.0:1790740155.092011:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790740155.092016:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000c15e5dd8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:7465:x1877727021899520:12345-0@lo:503: 00000100:00100000:0.0:1790740155.092240:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000c15e5dd8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:7465:x1877727021899520:12345-0@lo:503: Request processed in 224us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740155.092247:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790740155.092341:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bf5f39ac pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:7465:1877727021899520:0@lo:503: 00000040:00080000:3.0:1790740155.092775:0:7465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790740155.092873:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bf5f39ac pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:7465:1877727021899648:0@lo:502: 00000100:00100000:3.0:1790740155.092909:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740155.092983:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a35fe62e going to sleep for 11 seconds 00000100:00100000:2.0:1790740155.093268:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021899648 00000100:00100000:2.0:1790740155.093274:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021899648 00000100:00100000:0.0:1790740155.095858:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790740155.095883:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000006d7765fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:7465:x1877727021899648:12345-0@lo:502: 00000100:00100000:0.0:1790740155.096392:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000006d7765fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:7465:x1877727021899648:12345-0@lo:502: Request processed in 520us (3481us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740155.096403:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790740155.096874:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bf5f39ac pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:7465:1877727021899648:0@lo:502: 00000040:00080000:3.0:1790740155.097381:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1790740155.097416:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1790740155.097434:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1790740155.097466:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1790740155.097479:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1790740155.097491:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1790740155.097503:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1790740155.097737:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1790740155.097755:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1790740155.097765:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1790740155.097788:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1790740155.097803:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1790740155.097814:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1790740155.097826:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1790740155.097836:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1790740155.097847:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1790740155.097859:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1790740155.097872:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1790740155.097883:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1790740155.097905:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1790740155.097917:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1790740155.097927:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1790740155.097938:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1790740155.097949:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1790740155.097959:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1790740155.097969:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1790740155.097980:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1790740155.097992:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:3.0:1790740155.098333:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bf5f39ac pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:7465:1877727021899776:0@lo:502: 00000100:00100000:3.0:1790740155.098409:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740155.098453:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a35fe62e going to sleep for 11 seconds 00000100:00100000:0.0:1790740155.098578:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021899776 00000100:00100000:0.0:1790740155.098586:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021899776 00000100:00100000:0.0:1790740155.098646:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790740155.098654:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000d8a35bd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:7465:x1877727021899776:12345-0@lo:502: 00000100:00100000:0.0:1790740155.098763:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000d8a35bd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:7465:x1877727021899776:12345-0@lo:502: Request processed in 110us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740155.098771:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790740155.098886:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bf5f39ac pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:7465:1877727021899776:0@lo:502: 00000040:00080000:3.0:1790740155.098936:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1790740155.098944:0:7465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1790740155.099775:0:7483:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1790740155.099792:0:7483:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000a40ef49c) 00000020:00000080:3.0:1790740155.099812:0:7483:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1790740155.099899:0:7483:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000139583b4 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1790740155.099904:0:7483:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000139583b4 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1790740155.099906:0:7483:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000139583b4 3 00010000:00080000:3.0:1790740155.099933:0:7483:0:(ldlm_lib.c:102:import_set_conn()) imp 000000002064fc48@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.103@tcp at head 00010000:00010000:3.0:1790740155.115990:0:7483:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:3.0:1790740155.116472:0:7483:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1790740155.116514:0:7483:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790740155.116526:0:7483:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xb25dda4f4e92d7e5 00000100:00080000:3.0:1790740155.116537:0:7483:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790740155.116546:0:7483:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 000000002064fc48 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:3.0:1790740155.116581:0:7483:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000bf5f39ac x1877727021899904/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790740155.116660:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bf5f39ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877727021899904:0@lo:38: 00000100:00100000:2.0:1790740155.116730:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740155.116818:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021899904 00000100:00100000:1.0:1790740155.116825:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021899904 00000100:00100000:1.0:1790740155.116862:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790740155.116868:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000035780d88 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1877727021899904:12345-0@lo:38: 00010000:00080000:1.0:1790740155.116891:0:6537:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 226 last 0 00000020:00000080:1.0:1790740155.116923:0:6537:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xb25dda4f4e92d7ec 00000004:00100000:1.0:1790740155.116938:0:6537:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790740155.116969:0:6537:0:(import.c:65:import_set_state_nolock()) 000000000b83eab8 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1790740155.117058:0:7483:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1790740155.122402:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000035780d88 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877727021899904:12345-0@lo:38: Request processed in 5525us (5665us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740155.122428:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1790740155.122685:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000bf5f39ac x1877727021899904/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790740165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740155.122697:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790740155.122706:0:3637:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1790740155.122715:0:3637:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1790740155.122720:0:3637:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790740155.122723:0:3637:0:(import.c:65:import_set_state_nolock()) 000000002064fc48 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790740155.122729:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bf5f39ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877727021899904:0@lo:38: 00000040:00080000:0.0:1790740155.127389:0:7483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1790740155.127498:0:7465:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1790740155.127527:0:7465:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790740155.127539:0:7465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: 0000000004a9c349/0xb25dda4f4e92d7d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d7d7 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740155.127563:0:7465:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: 0000000004a9c349/0xb25dda4f4e92d7d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d7d7 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1790740155.127613:0:7465:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1790740155.127616:0:7465:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1790740155.127627:0:7465:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790740155.127628:0:7465:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790740155.127630:0:7465:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790740155.127631:0:7465:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790740155.127632:0:7465:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790740155.127634:0:7465:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790740155.127635:0:7465:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790740155.127636:0:7465:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790740155.127637:0:7465:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790740155.127641:0:7465:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:0.0:1790740155.127643:0:7465:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790740155.127644:0:7465:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1790740155.127645:0:7465:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790740155.127646:0:7465:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790740155.127647:0:7465:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790740155.127648:0:7465:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790740155.127649:0:7465:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790740155.127650:0:7465:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790740155.127651:0:7465:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790740155.127652:0:7465:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790740155.127653:0:7465:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790740155.127680:0:7465:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1790740155.127696:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005a8a4532 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:7465:1877727021900032:0@lo:253: 00000100:00100000:0.0:1790740155.127764:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740155.127802:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021900032 00000100:00100000:0.0:1790740155.127809:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021900032 00000100:00100000:0.0:1790740155.127851:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790740155.127860:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000062b06738 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:7465:x1877727021900032:12345-0@lo:253: 20000000:01000000:0.0:1790740155.127883:0:6530:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1790740155.127899:0:6530:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 40000000:00080000:2.0:1790740155.128260:0:7485:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000100:00100000:0.0:1790740155.128743:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 000000003393d7b5 going to sleep for 11 seconds 00000001:00100000:1.0:1790740155.130377:0:6514:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1790740155.130505:0:6530:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790740155.130521:0:6530:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1790740155.130672:0:6551:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790740155.130677:0:6551:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790740155.130699:0:6551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000047b67b4f/0xb25dda4f4e92d7f3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740155.130716:0:6551:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a952f8de/0xb25dda4f4e92d713 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d70c expref: 15 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740155.130723:0:6551:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e308c08b/0xb25dda4f4e92d7bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d7ad expref: 15 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740155.130731:0:6551:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000047b67b4f/0xb25dda4f4e92d7f3 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740155.130768:0:6551:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e308c08b/0xb25dda4f4e92d7bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92d7ad expref: 15 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740155.130783:0:6551:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e308c08b/0xb25dda4f4e92d7bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92d7ad expref: 15 pid: 6530 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740155.130797:0:6551:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a5029cbc pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6551:1877727021900160:0@lo:104: 00000100:00100000:3.0:1790740155.130876:0:6551:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790740155.130928:0:6551:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a952f8de/0xb25dda4f4e92d713 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92d70c expref: 15 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740155.130936:0:6551:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a952f8de/0xb25dda4f4e92d713 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92d70c expref: 15 pid: 6529 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740155.130944:0:6551:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000030d2cd58 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6551:1877727021900288:0@lo:104: 00000100:00100000:3.0:1790740155.130964:0:6551:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740155.130990:0:6551:0:(client.c:2716:ptlrpc_set_wait()) set 0000000092518d94 going to sleep for 11 seconds 00000100:00100000:2.0:1790740155.131082:0:6519:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021900160 00000100:00100000:2.0:1790740155.131090:0:6519:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021900160 00000100:00100000:2.0:1790740155.131125:0:6519:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021900288 00000100:00100000:2.0:1790740155.131128:0:6519:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021900288 00000100:00100000:2.0:1790740155.131141:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790740155.131146:0:6519:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000000951df8f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+4:6551:x1877727021900160:12345-0@lo:104: 00010000:00010000:2.0:1790740155.131158:0:6519:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: 00000000e1a44156/0xb25dda4f4e92d7ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d7bb expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740155.131213:0:6519:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790740155.131218:0:6519:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000000951df8f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+4:6551:x1877727021900160:12345-0@lo:104: Request processed in 72us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740155.131225:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790740155.131240:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790740155.131245:0:6519:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000026e22c42 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+3:6551:x1877727021900288:12345-0@lo:104: 00010000:00010000:2.0:1790740155.131257:0:6519:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: 000000009ccfc306/0xb25dda4f4e92d70c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d713 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740155.131287:0:6519:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790740155.131291:0:6519:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000026e22c42 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+3:6551:x1877727021900288:12345-0@lo:104: Request processed in 47us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740155.131297:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1790740155.131566:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790740155.131571:0:6523:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: 00000000e1a44156/0xb25dda4f4e92d7ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d7bb expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740155.131579:0:6523:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock 00000000e1a44156 already unused, calling callback (0000000092620f45) 10000000:00010000:3.0:1790740155.131584:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: 00000000e1a44156/0xb25dda4f4e92d7ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92d7bb expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740155.131591:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: 00000000e1a44156/0xb25dda4f4e92d7ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92d7bb expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790740155.131597:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: 00000000e1a44156/0xb25dda4f4e92d7ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92d7bb expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740155.131602:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790740155.131646:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: 00000000e1a44156/0xb25dda4f4e92d7ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d7bb expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740155.131652:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790740155.131675:0:6523:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: 00000000e1a44156/0xb25dda4f4e92d7ad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d7bb expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740155.131692:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: 00000000e1a44156/0xb25dda4f4e92d7ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d7bb expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740155.131704:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740155.131706:0:6523:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: 000000009ccfc306/0xb25dda4f4e92d70c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d713 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740155.131712:0:6523:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock 000000009ccfc306 already unused, calling callback (0000000092620f45) 10000000:00010000:3.0:1790740155.131714:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: 000000009ccfc306/0xb25dda4f4e92d70c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92d713 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740155.131720:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: 000000009ccfc306/0xb25dda4f4e92d70c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92d713 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790740155.131725:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: 000000009ccfc306/0xb25dda4f4e92d70c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92d713 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740155.131729:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790740155.131742:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: 000000009ccfc306/0xb25dda4f4e92d70c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d713 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740155.131748:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790740155.131762:0:6523:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: 000000009ccfc306/0xb25dda4f4e92d70c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d713 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740155.131767:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: 000000009ccfc306/0xb25dda4f4e92d70c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d713 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740155.131778:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740155.131785:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740155.131787:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740155.131992:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000002834fa0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727021900544:0@lo:103: 00000100:00100000:3.0:1790740155.132024:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740155.132124:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790740155.132136:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000449a4cf7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727021900416:0@lo:103: 00010000:00010000:0.0:1790740155.132291:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740155.132353:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000062b06738 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:7465:x1877727021900032:12345-0@lo:253: Request processed in 4494us (4589us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740155.132362:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790740155.132454:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005a8a4532 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:7465:1877727021900032:0@lo:253: 10000000:01000000:1.0:1790740155.132466:0:7465:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1790740155.132469:0:7465:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790740155.132471:0:7465:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1790740155.132472:0:7465:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790740155.132473:0:7465:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790740155.132474:0:7465:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790740155.132476:0:7465:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790740155.132477:0:7465:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790740155.132478:0:7465:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790740155.132479:0:7465:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790740155.132481:0:7465:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790740155.132482:0:7465:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1790740155.132495:0:7465:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1790740155.133220:0:6551:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a5029cbc pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6551:1877727021900160:0@lo:104: 00000100:00100000:2.0:1790740155.133231:0:6551:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000030d2cd58 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6551:1877727021900288:0@lo:104: 00010000:00010000:2.0:1790740155.133247:0:6551:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000047b67b4f/0xb25dda4f4e92d7f3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1790740155.138303:0:7465:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:1.0:1790740155.138479:0:7465:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1790740155.138702:0:7465:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1790740155.138871:0:7465:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1790740155.139023:0:7465:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1790740155.139187:0:7465:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000100:00100000:0.0:1790740155.139775:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740155.139871:0:6520:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021900544 00000100:00100000:2.0:1790740155.139880:0:6520:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021900544 00010000:00010000:2.0:1790740155.139910:0:6520:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a952f8de/0xb25dda4f4e92d713 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d70c expref: 15 pid: 6529 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740155.139946:0:6520:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021900416 00000100:00100000:2.0:1790740155.139949:0:6520:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021900416 00010000:00010000:2.0:1790740155.139957:0:6520:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e308c08b/0xb25dda4f4e92d7bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d7ad expref: 16 pid: 6530 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740155.139970:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790740155.139976:0:6520:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000ae89b259 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:3638:x1877727021900544:12345-0@lo:103: 00010000:00010000:2.0:1790740155.139990:0:6520:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740155.139994:0:6520:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a952f8de/0xb25dda4f4e92d713 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d70c expref: 16 pid: 6529 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740155.140003:0:6520:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a952f8de/0xb25dda4f4e92d713 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92d70c expref: 16 pid: 6529 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740155.140024:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a952f8de/0xb25dda4f4e92d713 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92d70c expref: 16 pid: 6529 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740155.140087:0:6520:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740155.140137:0:6520:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000ae89b259 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:3638:x1877727021900544:12345-0@lo:103: Request processed in 161us (8113us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740155.140144:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790740155.140158:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790740155.140163:0:6520:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000073a5e4e2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+14:3640:x1877727021900416:12345-0@lo:103: 00010000:00010000:2.0:1790740155.140169:0:6520:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740155.140172:0:6520:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e308c08b/0xb25dda4f4e92d7bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d7ad expref: 14 pid: 6530 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740155.140180:0:6520:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e308c08b/0xb25dda4f4e92d7bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92d7ad expref: 14 pid: 6530 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740155.140188:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e308c08b/0xb25dda4f4e92d7bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92d7ad expref: 14 pid: 6530 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740155.140198:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000047b67b4f/0xb25dda4f4e92d7f3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740155.140205:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000047b67b4f/0xb25dda4f4e92d7f3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790740155.140218:0:6520:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009541360s 00010000:00010000:2.0:1790740155.140221:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000047b67b4f/0xb25dda4f4e92d7f3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740155.140238:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000047b67b4f/0xb25dda4f4e92d7f3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740155.140244:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000047b67b4f/0xb25dda4f4e92d7f3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740155.140250:0:6520:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000047b67b4f/0xb25dda4f4e92d7f3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740155.140256:0:6520:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock 0000000047b67b4f already unused, calling callback (0000000006bfcbe5) 00010000:00010000:2.0:1790740155.140259:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000047b67b4f/0xb25dda4f4e92d7f3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740155.140266:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000047b67b4f/0xb25dda4f4e92d7f3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740155.140278:0:6520:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000047b67b4f/0xb25dda4f4e92d7f3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740155.140287:0:6520:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740155.140310:0:6520:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000073a5e4e2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+13:3640:x1877727021900416:12345-0@lo:103: Request processed in 148us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740155.140316:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790740155.140591:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000002834fa0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727021900544:0@lo:103: 00000100:00100000:0.0:1790740155.141384:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000449a4cf7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727021900416:0@lo:103: 00010000:00010000:0.0:1790740155.141421:0:6551:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000047b67b4f/0xb25dda4f4e92d7f3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740155.141430:0:6551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000047b67b4f/0xb25dda4f4e92d7f3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740155.141447:0:6551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000047b67b4f/0xb25dda4f4e92d7f3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1790740155.142314:0:7465:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1790740155.142757:0:7465:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1790740155.142950:0:7465:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:1.0:1790740155.143231:0:7465:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1790740155.143423:0:7465:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:1.0:1790740155.143710:0:7465:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:0.0:1790740155.145661:0:7465:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:0.0:1790740155.145930:0:7489:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:0.0:1790740155.145982:0:7489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000086078a97 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7489:1877727021900672:0@lo:700: 00000100:00100000:0.0:1790740155.146091:0:7489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740155.146125:0:7489:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f2ec9ad1 going to sleep for 11 seconds 00000100:00100000:3.0:1790740155.146246:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021900672 00000100:00100000:3.0:1790740155.146254:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021900672 00000100:00100000:3.0:1790740155.146304:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790740155.146312:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000e39536f1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7489:x1877727021900672:12345-0@lo:700: 00000040:01000000:1.0:1790740155.146559:0:7465:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1790740155.146904:0:7490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000d0bf9f0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7490:1877727021900800:0@lo:1000: 00000100:00100000:1.0:1790740155.146951:0:7490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:0.0:1790740155.147365:0:7465:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1790740155.147636:0:7465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1790740155.148190:0:7465:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1790740155.148197:0:7465:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1790740155.148329:0:7465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790740155.148584:0:7490:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a0bf71f6 going to sleep for 11 seconds 00000020:00080000:2.0:1790740155.149157:0:7488:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1790740155.149162:0:7488:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:00080000:0.0:1790740155.149790:0:7465:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:3.0:1790740155.152214:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021900800 00000100:00100000:3.0:1790740155.152229:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021900800 00000100:00100000:3.0:1790740155.152290:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790740155.152298:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000001eb3dc68 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7490:x1877727021900800:12345-0@lo:1000: 00000100:00100000:3.0:1790740155.152431:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000001eb3dc68 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7490:x1877727021900800:12345-0@lo:1000: Request processed in 133us (5479us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740155.152510:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790740155.152764:0:7490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000d0bf9f0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7490:1877727021900800:0@lo:1000: 00000040:01000000:1.0:1790740155.152803:0:7490:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:1.0:1790740155.152839:0:7490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000d0bf9f0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7490:1877727021900928:0@lo:700: 00000100:00100000:1.0:1790740155.152877:0:7490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740155.152904:0:7490:0:(client.c:2716:ptlrpc_set_wait()) set 00000000007b7525 going to sleep for 11 seconds 00000040:00080000:0.0:1790740155.153497:0:7465:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1790740155.153577:0:7465:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1790740155.153862:0:7465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1790740155.154100:0:7465:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1790740155.154691:0:7465:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1790740155.154825:0:7465:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1790740155.154964:0:7465:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1790740155.155128:0:7465:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1790740155.155270:0:7465:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1790740155.155398:0:7465:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1790740155.155546:0:7465:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1790740155.155789:0:7465:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1790740155.155940:0:7465:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1790740155.156110:0:7465:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1790740155.156246:0:7465:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00000100:00100000:3.0:1790740155.157025:0:6544:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021900928 00000100:00100000:3.0:1790740155.157056:0:6544:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021900928 00000100:00100000:3.0:1790740155.157123:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790740155.157132:0:6544:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000033e49c56 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7490:x1877727021900928:12345-0@lo:700: 00000100:00100000:3.0:1790740155.157221:0:6544:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000033e49c56 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7490:x1877727021900928:12345-0@lo:700: Request processed in 91us (4344us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740155.157228:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790740155.157323:0:7490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000d0bf9f0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7490:1877727021900928:0@lo:700: 00000100:00100000:1.0:1790740155.157393:0:7490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000d0bf9f0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7490:1877727021901056:0@lo:900: 00000100:00100000:1.0:1790740155.157432:0:7490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740155.157489:0:7490:0:(client.c:2716:ptlrpc_set_wait()) set 00000000007b7525 going to sleep for 11 seconds 00000100:00100000:3.0:1790740155.157905:0:6546:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021901056 00000100:00100000:3.0:1790740155.157912:0:6546:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021901056 00000100:00100000:3.0:1790740155.157948:0:6546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790740155.157954:0:6546:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000748b78cd pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7490:x1877727021901056:12345-0@lo:900: 00000100:00100000:3.0:1790740155.158010:0:6546:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000748b78cd pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7490:x1877727021901056:12345-0@lo:900: Request processed in 56us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740155.158017:0:6546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1790740155.158130:0:7490:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000000d0bf9f0 x1877727021901056/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790740171 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740155.158142:0:7490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000d0bf9f0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7490:1877727021901056:0@lo:900: 00000100:00100000:1.0:1790740155.158219:0:7490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000d0bf9f0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7490:1877727021901184:0@lo:1000: 00000100:00100000:1.0:1790740155.158246:0:7490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740155.158276:0:7490:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d9b1e5da going to sleep for 11 seconds 00000100:00100000:3.0:1790740155.158359:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021901184 00000100:00100000:3.0:1790740155.158363:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021901184 00000100:00100000:3.0:1790740155.158394:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790740155.158401:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000de31de62 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7490:x1877727021901184:12345-0@lo:1000: 00000100:00100000:3.0:1790740155.158470:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000de31de62 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7490:x1877727021901184:12345-0@lo:1000: Request processed in 71us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740155.158487:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790740155.159673:0:7490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000d0bf9f0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7490:1877727021901184:0@lo:1000: 00000004:00080000:1.0:1790740155.159728:0:7490:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000007b7525 with version 0 00000020:00100000:1.0:1790740155.159747:0:7490:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1790740155.159753:0:7490:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000000d0bf9f0 x1877727021901440/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790740155.159769:0:7490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000d0bf9f0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7490:1877727021901440:0@lo:1000: 00000100:00100000:1.0:1790740155.159817:0:7490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740155.159843:0:7490:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e2888044 going to sleep for 11 seconds 00000100:00100000:3.0:1790740155.160099:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021901440 00000100:00100000:3.0:1790740155.160105:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021901440 00000100:00100000:3.0:1790740155.160140:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790740155.160145:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000dd341674 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7490:x1877727021901440:12345-0@lo:1000: 40000000:02000000:3.0:1790740155.161352:0:6542:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00100000:10000000:0.0:1790740155.163751:0:7465:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1790740155.163935:0:7465:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1790740155.164757:0:7465:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1790740155.164897:0:7465:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1790740155.166121:0:7465:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1790740155.166645:0:7465:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1790740155.166764:0:7465:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1790740155.166869:0:7465:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1790740155.167008:0:7465:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1790740155.168385:0:7465:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1790740155.168687:0:7465:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1790740155.168815:0:7465:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00000100:00100000:3.0:1790740155.172400:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000e39536f1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7489:x1877727021900672:12345-0@lo:700: Request processed in 26081us (26302us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740155.172415:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00100000:10000000:1.0:1790740155.172958:0:7465:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00010000:00080000:0.0:1790740155.173992:0:7489:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000086078a97 x1877727021900672/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790740171 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740155.174011:0:7489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000086078a97 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7489:1877727021900672:0@lo:700: 40000000:02000000:0.0:1790740155.174026:0:7489:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00100000:10000000:1.0:1790740155.175061:0:7465:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1790740155.175215:0:7465:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1790740155.175322:0:7465:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1790740155.177211:0:7465:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1790740155.177446:0:7465:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1790740155.177574:0:7465:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1790740155.177711:0:7465:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1790740155.177872:0:7465:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1790740155.178062:0:7465:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:1.0:1790740155.183110:0:6514:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:3.0:1790740155.183278:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000dd341674 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7490:x1877727021901440:12345-0@lo:1000: Request processed in 23128us (23456us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1790740155.183291:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:1.0:1790740155.183418:0:7490:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1790740155.183423:0:7490:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1790740155.183509:0:7490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000d0bf9f0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7490:1877727021901440:0@lo:1000: 00000100:00100000:1.0:1790740155.183595:0:7490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000d0bf9f0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7490:1877727021901568:0@lo:1000: 00000100:00100000:1.0:1790740155.183645:0:7490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740155.183903:0:7490:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a0bf71f6 going to sleep for 11 seconds 00000001:00080000:1.0:1790740155.186660:0:7465:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1790740155.186699:0:7465:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb5b101c9b988 00100000:10000000:1.0:1790740155.186708:0:7465:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0001-osd: start master thread 00000100:00100000:3.0:1790740155.187025:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021901568 00000100:00100000:3.0:1790740155.187062:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021901568 00000100:00100000:2.0:1790740155.187244:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790740155.187253:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000b64bbad7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7490:x1877727021901568:12345-0@lo:1000: 00000100:00100000:2.0:1790740155.187384:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000b64bbad7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7490:x1877727021901568:12345-0@lo:1000: Request processed in 132us (3739us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740155.187403:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790740155.187573:0:7490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000d0bf9f0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7490:1877727021901568:0@lo:1000: 00000040:00080000:0.0:1790740155.187601:0:7490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1790740155.187652:0:7490:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000031b3ef45 with version 1 00000004:00080000:2.0:1790740155.189157:0:7480:0:(osp_trans.c:1336:osp_get_next_request()) ou 0000000053b1a207 version 1 rpc_version 1 00000020:00100000:2.0:1790740155.189192:0:7480:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1790740155.189202:0:7480:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000052f2a0e2 x1877727021901824/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790740155.189224:0:7480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000052f2a0e2 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7480:1877727021901824:0@lo:1000: 00000100:00100000:2.0:1790740155.189299:0:7480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740155.189337:0:7480:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a934a984 going to sleep for 11 seconds 00000100:00100000:2.0:1790740155.189364:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021901824 00000100:00100000:2.0:1790740155.189370:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021901824 00000100:00100000:2.0:1790740155.189404:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790740155.189411:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000008c258a8a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7480:x1877727021901824:12345-0@lo:1000: 00000020:01000004:1.0:1790740155.189822:0:7465:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1790740155.190074:0:7465:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.103@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1790740155.190098:0:7465:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1790740155.190114:0:7465:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1790740155.190931:0:7465:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790740155.191177:0:7465:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:0.0:1790740155.191757:0:7490:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1790740155.191822:0:7490:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000001:00080000:0.0:1790740155.203893:0:6514:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:3.0:1790740155.204141:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000008c258a8a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7480:x1877727021901824:12345-0@lo:1000: Request processed in 14727us (14839us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1790740155.204155:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:0.0:1790740155.204264:0:7480:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1790740155.204269:0:7480:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1790740155.204285:0:7480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000052f2a0e2 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7480:1877727021901824:0@lo:1000: 00000040:00080000:0.0:1790740155.206654:0:7489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790740155.220189:0:7489:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1790740155.220263:0:7489:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1790740155.220268:0:7489:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:2.0:1790740155.883945:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740156.911065:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740157.930235:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740158.954281:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790740159.956754:0:7735:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg403-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1790740159.979281:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740160.109083:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790740160.109110:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005aeeb779 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021901952:0@lo:41: 00000100:00100000:1.0:1790740160.109177:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740160.109243:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021901952 00000100:00100000:1.0:1790740160.109250:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021901952 00000100:00100000:1.0:1790740160.109297:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790740160.109306:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000079e76dba pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021901952:12345-0@lo:41: 00000004:00000024:1.0:1790740160.109348:0:6541:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1790740160.109398:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000079e76dba pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021901952:12345-0@lo:41: Request processed in 93us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740160.109405:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790740160.109449:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005aeeb779 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021901952:0@lo:41: 00000100:00100000:2.0:1790740160.621108:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008044cd84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727021902080:0@lo:400: 00000100:00100000:2.0:1790740160.621214:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740160.621288:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790740160.621294:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000090385019 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877727021902208:0@lo:400: 00000100:00100000:2.0:1790740160.621327:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740160.621363:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006c35d2f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877727021902336:0@lo:400: 00000100:00100000:2.0:1790740160.621387:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740160.621442:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021902080 00000100:00100000:2.0:1790740160.621454:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021902080 00000100:00100000:2.0:1790740160.621526:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790740160.621536:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000009c3374f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+13:3640:x1877727021902080:12345-0@lo:400: 00000100:00100000:2.0:1790740160.621610:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000009c3374f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+13:3640:x1877727021902080:12345-0@lo:400: Request processed in 76us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740160.621619:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790740160.621673:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021902208 00000100:00100000:2.0:1790740160.621677:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021902208 00000100:00100000:2.0:1790740160.621705:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021902336 00000100:00100000:2.0:1790740160.621708:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021902336 00000100:00100000:2.0:1790740160.621722:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790740160.621727:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000000bdd4f44 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877727021902208:12345-0@lo:400: 00000100:00100000:2.0:1790740160.621761:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000000bdd4f44 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877727021902208:12345-0@lo:400: Request processed in 34us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740160.622068:0:6535:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1790740160.622093:0:6535:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1790740160.622485:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790740160.622505:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790740160.622524:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000009cebfdff pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877727021902336:12345-0@lo:400: 00000100:00100000:2.0:1790740160.622588:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000009cebfdff pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877727021902336:12345-0@lo:400: Request processed in 77us (1201us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740160.622595:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1790740160.625482:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000090385019 x1877727021902208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740160.625510:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000090385019 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877727021902208:0@lo:400: 00000100:00100000:2.0:1790740160.625536:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008044cd84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727021902080:0@lo:400: 00010000:00080000:0.0:1790740160.625977:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000006c35d2f9 x1877727021902336/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740160.625989:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006c35d2f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877727021902336:0@lo:400: 00010000:00010000:1.0:1790740161.002180:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1790740161.237159:0:7788:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790740161.237705:0:7788:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1790740162.027004:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740163.051114:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1790740163.178194:0:6532:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790740163.178207:0:6532:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98dca0cb4800 from 4 10000000:01000000:1.0:1790740163.178213:0:6532:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790740163.178281:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: 0000000050e0af44/0xb25dda4f4e92d7fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740163.178296:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: 0000000050e0af44/0xb25dda4f4e92d7fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740163.178319:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: 0000000050e0af44/0xb25dda4f4e92d7fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740163.178376:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005aeeb779 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021902464:0@lo:101: 00000100:00100000:1.0:1790740163.178488:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740163.178579:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set 000000006592597d going to sleep for 11 seconds 00000100:00100000:0.0:1790740163.178582:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021902464 00000100:00100000:0.0:1790740163.178595:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021902464 00000100:00100000:0.0:1790740163.178678:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790740163.178690:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000008999b245 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+13:6532:x1877727021902464:12345-0@lo:101: 00010000:00010000:0.0:1790740163.178719:0:6530:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740163.178737:0:6530:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000018ccb799/0xb25dda4f4e92d801 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92d7fa expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740163.178766:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000018ccb799/0xb25dda4f4e92d801 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92d7fa expref: 14 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740163.178791:0:6530:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000018ccb799/0xb25dda4f4e92d801 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d7fa expref: 14 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740163.178803:0:6530:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000018ccb799, rc 0) 00000100:00100000:0.0:1790740163.178869:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000008999b245 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+14:6532:x1877727021902464:12345-0@lo:101: Request processed in 181us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740163.178878:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790740163.179085:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005aeeb779 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021902464:0@lo:101: 00010000:00010000:3.0:1790740163.179104:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: 0000000050e0af44/0xb25dda4f4e92d7fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d801 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740163.179113:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: 0000000050e0af44/0xb25dda4f4e92d7fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92d801 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740163.179171:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000002834fa0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021902592:0@lo:256: 00000100:00100000:3.0:1790740163.179209:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740163.179230:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set 00000000398a7015 going to sleep for 11 seconds 00000100:00100000:2.0:1790740163.179280:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021902592 00000100:00100000:2.0:1790740163.179287:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021902592 00000100:00100000:2.0:1790740163.179370:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790740163.179379:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000cb70a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+14:6532:x1877727021902592:12345-0@lo:256: 20000000:01000000:2.0:1790740163.179403:0:6528:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790740163.179422:0:6528:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790740163.179424:0:6528:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1790740163.179533:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000cb70a0f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+14:6532:x1877727021902592:12345-0@lo:256: Request processed in 155us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740163.179540:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790740163.179569:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000002834fa0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021902592:0@lo:256: 10000000:01000000:0.0:1790740163.179634:0:6532:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790740163.179641:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: 0000000050e0af44/0xb25dda4f4e92d7fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d801 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740163.179650:0:6532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: 0000000050e0af44/0xb25dda4f4e92d7fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d801 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740163.179659:0:6532:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1790740163.179663:0:6532:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98dc82d23800 from 21 10000000:01000000:0.0:1790740163.179676:0:6532:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790740163.179698:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: 0000000010e3c7b6/0xb25dda4f4e92d808 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740163.179705:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: 0000000010e3c7b6/0xb25dda4f4e92d808 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740163.179719:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: 0000000010e3c7b6/0xb25dda4f4e92d808 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740163.179731:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000086078a97 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021902720:0@lo:101: 00000100:00100000:0.0:1790740163.192090:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740163.192910:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set 00000000178d355b going to sleep for 11 seconds 00000100:00100000:1.0:1790740163.193108:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021902720 00000100:00100000:1.0:1790740163.193121:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021902720 00000100:00100000:1.0:1790740163.193187:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790740163.193197:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000080982146 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+14:6532:x1877727021902720:12345-0@lo:101: 00010000:00010000:1.0:1790740163.193223:0:6530:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740163.193246:0:6530:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002094ee79/0xb25dda4f4e92d80f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92d808 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740163.193282:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002094ee79/0xb25dda4f4e92d80f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92d808 expref: 15 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740163.193294:0:6530:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002094ee79/0xb25dda4f4e92d80f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d808 expref: 15 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740163.193305:0:6530:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002094ee79, rc 0) 00000100:00100000:1.0:1790740163.195189:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000080982146 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:6532:x1877727021902720:12345-0@lo:101: Request processed in 1988us (3106us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740163.195199:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790740163.196124:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000086078a97 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021902720:0@lo:101: 00010000:00010000:0.0:1790740163.196159:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: 0000000010e3c7b6/0xb25dda4f4e92d808 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d80f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740163.196173:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: 0000000010e3c7b6/0xb25dda4f4e92d808 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92d80f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740163.196299:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000086078a97 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021902848:0@lo:501: 00000100:00100000:0.0:1790740163.196368:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740163.196430:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set 00000000178d355b going to sleep for 11 seconds 00000100:00100000:2.0:1790740163.196505:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021902848 00000100:00100000:2.0:1790740163.196516:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021902848 00000100:00100000:2.0:1790740163.196572:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790740163.196582:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000d2209c67 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:6532:x1877727021902848:12345-0@lo:501: 00000100:00100000:2.0:1790740163.196798:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000d2209c67 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:6532:x1877727021902848:12345-0@lo:501: Request processed in 218us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740163.196806:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790740163.197301:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000086078a97 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021902848:0@lo:501: 00000100:00100000:0.0:1790740163.197347:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000086078a97 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021902976:0@lo:503: 00000100:00100000:0.0:1790740163.197411:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740163.197446:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set 00000000178d355b going to sleep for 11 seconds 00000100:00100000:3.0:1790740163.198338:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021902976 00000100:00100000:3.0:1790740163.198351:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021902976 00000100:00100000:3.0:1790740163.198457:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790740163.198477:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000003c5dadb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:6532:x1877727021902976:12345-0@lo:503: 00000100:00100000:3.0:1790740163.198659:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000003c5dadb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:6532:x1877727021902976:12345-0@lo:503: Request processed in 193us (1247us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740163.199050:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000086078a97 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021902976:0@lo:503: 00000100:00100000:0.0:1790740163.199357:0:7841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000086078a97 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:7841:1877727021903104:0@lo:502: 00000100:00100000:0.0:1790740163.199417:0:7841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740163.199487:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790740163.212333:0:7841:0:(client.c:2716:ptlrpc_set_wait()) set 0000000040c4cc3e going to sleep for 11 seconds 00000100:00100000:3.0:1790740163.212428:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021903104 00000100:00100000:3.0:1790740163.212441:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021903104 00000100:00100000:3.0:1790740163.212931:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790740163.212942:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000009dc33bfe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:7841:x1877727021903104:12345-0@lo:502: 00000100:00100000:3.0:1790740163.213226:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000009dc33bfe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:7841:x1877727021903104:12345-0@lo:502: Request processed in 286us (13808us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740163.213235:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790740163.214824:0:7841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000086078a97 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:7841:1877727021903104:0@lo:502: 00000100:00100000:0.0:1790740163.214956:0:7841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000086078a97 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:7841:1877727021903232:0@lo:502: 00000100:00100000:0.0:1790740163.215097:0:7841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740163.215142:0:7841:0:(client.c:2716:ptlrpc_set_wait()) set 0000000040c4cc3e going to sleep for 11 seconds 00000100:00100000:3.0:1790740163.217440:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021903232 00000100:00100000:3.0:1790740163.217483:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021903232 00000100:00100000:3.0:1790740163.217559:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790740163.217600:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000f970f5b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:7841:x1877727021903232:12345-0@lo:502: 00000100:00100000:3.0:1790740163.218139:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000f970f5b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:7841:x1877727021903232:12345-0@lo:502: Request processed in 551us (3041us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740163.218149:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790740163.218833:0:7841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000086078a97 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:7841:1877727021903232:0@lo:502: 00000040:00080000:0.0:1790740163.218886:0:7841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1790740163.220244:0:6532:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1790740163.220295:0:6532:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790740163.220374:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: 0000000010e3c7b6/0xb25dda4f4e92d808 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d80f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740163.220392:0:6532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: 0000000010e3c7b6/0xb25dda4f4e92d808 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d80f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740163.220405:0:6532:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790740163.220408:0:6532:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98dc82d23800 from 4 10000000:01000000:3.0:1790740163.220410:0:6532:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790740163.220845:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: 000000009ccfc306/0xb25dda4f4e92d816 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740163.220855:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: 000000009ccfc306/0xb25dda4f4e92d816 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740163.220867:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: 000000009ccfc306/0xb25dda4f4e92d816 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740163.220900:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000479ad4fb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021903360:0@lo:101: 00000100:00100000:3.0:1790740163.220989:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740163.221637:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set 00000000391a0899 going to sleep for 11 seconds 00000100:00100000:0.0:1790740163.226637:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021903360 00000100:00100000:0.0:1790740163.226673:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021903360 00000100:00100000:0.0:1790740163.226772:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790740163.226784:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000082c28fd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:6532:x1877727021903360:12345-0@lo:101: 00010000:00010000:0.0:1790740163.226809:0:6529:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740163.226834:0:6529:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c0ac33b2/0xb25dda4f4e92d81d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92d816 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740163.226874:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c0ac33b2/0xb25dda4f4e92d81d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92d816 expref: 16 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740163.226888:0:6529:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c0ac33b2/0xb25dda4f4e92d81d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d816 expref: 16 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740163.226899:0:6529:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c0ac33b2, rc 0) 00000100:00100000:0.0:1790740163.227002:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000082c28fd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:6532:x1877727021903360:12345-0@lo:101: Request processed in 220us (6013us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740163.227011:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790740163.228065:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000479ad4fb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021903360:0@lo:101: 00010000:00010000:3.0:1790740163.228099:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: 000000009ccfc306/0xb25dda4f4e92d816 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d81d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740163.228131:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: 000000009ccfc306/0xb25dda4f4e92d816 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92d81d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740163.228219:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000479ad4fb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021903488:0@lo:256: 00000100:00100000:3.0:1790740163.228294:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740163.228359:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set 00000000391a0899 going to sleep for 11 seconds 00000100:00100000:1.0:1790740163.228453:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021903488 00000100:00100000:1.0:1790740163.228462:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021903488 00000100:00100000:1.0:1790740163.228523:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790740163.228531:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000909132cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:6532:x1877727021903488:12345-0@lo:256: 20000000:01000000:1.0:1790740163.228555:0:6530:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790740163.228577:0:6530:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790740163.228583:0:6530:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1790740163.228700:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000909132cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:6532:x1877727021903488:12345-0@lo:256: Request processed in 169us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740163.228708:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790740163.228768:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000479ad4fb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021903488:0@lo:256: 10000000:01000000:3.0:1790740163.228819:0:6532:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790740163.228828:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: 000000009ccfc306/0xb25dda4f4e92d816 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d81d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740163.228837:0:6532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: 000000009ccfc306/0xb25dda4f4e92d816 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d81d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740163.228848:0:6532:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1790740163.228851:0:6532:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1790740163.228854:0:6532:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1790740163.228878:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: 00000000398877b6/0xb25dda4f4e92d824 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740163.228885:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: 00000000398877b6/0xb25dda4f4e92d824 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740163.228894:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: 00000000398877b6/0xb25dda4f4e92d824 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740163.228907:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000479ad4fb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021903616:0@lo:101: 00000100:00100000:3.0:1790740163.228943:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740163.228970:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set 0000000038a216bb going to sleep for 11 seconds 00000100:00100000:0.0:1790740163.229854:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021903616 00000100:00100000:0.0:1790740163.229867:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021903616 00000100:00100000:0.0:1790740163.229928:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790740163.229937:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000012e79f93 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:6532:x1877727021903616:12345-0@lo:101: 00010000:00010000:0.0:1790740163.229954:0:6529:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740163.229983:0:6529:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a952f8de/0xb25dda4f4e92d82b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92d824 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740163.230013:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a952f8de/0xb25dda4f4e92d82b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92d824 expref: 17 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740163.230024:0:6529:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a952f8de/0xb25dda4f4e92d82b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d824 expref: 17 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740163.230048:0:6529:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a952f8de, rc 0) 00000100:00100000:0.0:1790740163.230121:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000012e79f93 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:6532:x1877727021903616:12345-0@lo:101: Request processed in 186us (1177us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740163.230128:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790740163.230227:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000479ad4fb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021903616:0@lo:101: 00010000:00010000:3.0:1790740163.230245:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: 00000000398877b6/0xb25dda4f4e92d824 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d82b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740163.230254:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: 00000000398877b6/0xb25dda4f4e92d824 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92d82b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740163.230334:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000479ad4fb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021903744:0@lo:501: 00000100:00100000:3.0:1790740163.230363:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740163.230403:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set 0000000038a216bb going to sleep for 11 seconds 00000100:00100000:1.0:1790740163.230424:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021903744 00000100:00100000:1.0:1790740163.230431:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021903744 00000100:00100000:1.0:1790740163.230478:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790740163.230486:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000acbe7145 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:6532:x1877727021903744:12345-0@lo:501: 00000100:00100000:3.0:1790740163.230883:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000479ad4fb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021903744:0@lo:501: 00000100:00100000:3.0:1790740163.230922:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000479ad4fb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021903872:0@lo:503: 00000100:00100000:2.0:1790740163.234136:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740163.234209:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set 0000000038a216bb going to sleep for 11 seconds 00000100:00100000:3.0:1790740163.234286:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021903872 00000100:00100000:3.0:1790740163.234299:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021903872 00000100:00100000:3.0:1790740163.234363:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790740163.234373:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000000d19cbdb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+18:6532:x1877727021903872:12345-0@lo:503: 00000100:00100000:3.0:1790740163.234579:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000000d19cbdb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+18:6532:x1877727021903872:12345-0@lo:503: Request processed in 207us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740163.234588:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790740163.234707:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000479ad4fb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021903872:0@lo:503: 00000100:00100000:1.0:1790740163.235179:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000acbe7145 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:6532:x1877727021903744:12345-0@lo:501: Request processed in 4692us (4812us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740163.235191:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790740163.237346:0:7842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008044cd84 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:7842:1877727021904000:0@lo:502: 00000100:00100000:2.0:1790740163.237454:0:7842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740163.237520:0:7842:0:(client.c:2716:ptlrpc_set_wait()) set 000000008b075992 going to sleep for 11 seconds 00000100:00100000:3.0:1790740163.237665:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021904000 00000100:00100000:3.0:1790740163.237676:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021904000 00000100:00100000:3.0:1790740163.237735:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790740163.237745:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000076dfb065 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:7842:x1877727021904000:12345-0@lo:502: 00000100:00100000:3.0:1790740163.238170:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000076dfb065 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:7842:x1877727021904000:12345-0@lo:502: Request processed in 426us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740163.238188:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790740163.238746:0:7842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008044cd84 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:7842:1877727021904000:0@lo:502: 00000020:01000000:0.0:1790740163.238931:0:7842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790740163.238948:0:7842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740163.238951:0:7842:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1790740163.238957:0:7842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1790740163.238961:0:7842:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.103@tcp to nid 0x20000c0a8cc67 (192.168.204.103@tcp) 00000020:00000080:0.0:1790740163.238997:0:7842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790740163.239018:0:7842:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000bc7882fd) 00000020:00000080:0.0:1790740163.239081:0:7842:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:0.0:1790740163.239116:0:7842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1790740163.239228:0:7842:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1790740163.239235:0:7842:0:(osd_handler.c:8931:osd_obd_connect()) connect #5 00000020:00000080:0.0:1790740163.239242:0:7842:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb25dda4f4e92d839 00010000:00080000:0.0:1790740163.239282:0:7842:0:(ldlm_lib.c:102:import_set_conn()) imp 000000009ccdaab7@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.103@tcp at head 00010000:00010000:1.0:1790740163.246515:0:7842:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:3.0:1790740163.257663:0:7842:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790740163.257686:0:7842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1790740163.257742:0:7842:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1790740163.257784:0:7842:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb25dda4f4e92d840 00000100:00080000:3.0:1790740163.257797:0:7842:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790740163.257809:0:7842:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 000000009ccdaab7 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:3.0:1790740163.257995:0:7842:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000022981703 x1877727021904128/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790740163.258382:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022981703 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877727021904128:0@lo:38: 00000100:00100000:2.0:1790740163.258482:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740163.258634:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021904128 00000100:00100000:1.0:1790740163.258645:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021904128 00000100:00100000:1.0:1790740163.258694:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790740163.258702:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000090385019 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1877727021904128:12345-0@lo:38: 00010000:00080000:1.0:1790740163.258732:0:6541:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 234 last 0 00000020:00000080:1.0:1790740163.258785:0:6541:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb25dda4f4e92d847 00000004:00100000:1.0:1790740163.258803:0:6541:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1790740163.258809:0:6541:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1790740163.262694:0:7842:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:0.0:1790740163.262819:0:7842:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:3.0:1790740163.264688:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ef8df2df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877727021904256:0@lo:400: 00000100:00100000:3.0:1790740163.264814:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740163.265124:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022675901 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021904384:0@lo:400: 00000100:00100000:2.0:1790740163.265174:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740163.265199:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790740163.265206:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c179a950 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877727021904512:0@lo:400: 00000100:00100000:2.0:1790740163.265232:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740163.265347:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021904256 00000100:00100000:1.0:1790740163.265358:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021904256 00000100:00100000:1.0:1790740163.265423:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021904512 00000100:00100000:1.0:1790740163.265426:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021904512 00000100:00100000:1.0:1790740163.265446:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790740163.265454:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000688d9552 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877727021904256:12345-0@lo:400: 00000100:00100000:1.0:1790740163.265530:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000688d9552 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877727021904256:12345-0@lo:400: Request processed in 77us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740163.265548:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790740163.265568:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790740163.265574:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000004664ae78 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877727021904512:12345-0@lo:400: 00000100:00100000:1.0:1790740163.265609:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000004664ae78 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877727021904512:12345-0@lo:400: Request processed in 36us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740163.265616:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1790740163.265727:0:7845:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@00000000d5a6db1f x1877727021904640/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740163.265739:0:7845:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d9b1e5da going to sleep for 0 seconds 00010000:00080000:2.0:1790740163.265837:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000c179a950 x1877727021904512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740163.265851:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c179a950 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877727021904512:0@lo:400: 00000020:01000000:0.0:1790740163.266274:0:7842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790740163.266288:0:7842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740163.266291:0:7842:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1790740163.266297:0:7842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790740163.266315:0:7842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740163.266317:0:7842:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790740163.266322:0:7842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790740163.266324:0:7842:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1790740163.266355:0:7842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000086078a97 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:7842:1877727021904768:0@lo:502: 00000100:00100000:0.0:1790740163.266438:0:7842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740163.266693:0:6540:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1790740163.266705:0:7842:0:(client.c:2716:ptlrpc_set_wait()) set 000000008db6f21c going to sleep for 11 seconds 00000100:00100000:3.0:1790740163.266706:0:6540:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00010000:00080000:3.0:1790740163.266767:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000ef8df2df x1877727021904256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740163.266779:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ef8df2df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877727021904256:0@lo:400: 00000100:00100000:1.0:1790740163.266861:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021904768 00000100:00100000:1.0:1790740163.266868:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021904768 00000100:00100000:1.0:1790740163.267158:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790740163.267167:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000b7411f61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:7842:x1877727021904768:12345-0@lo:502: 00000100:00100000:1.0:1790740163.267328:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000b7411f61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:7842:x1877727021904768:12345-0@lo:502: Request processed in 162us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740163.267336:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790740163.267619:0:7842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000086078a97 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:7842:1877727021904768:0@lo:502: 00000020:01000000:0.0:1790740163.267653:0:7842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790740163.267661:0:7842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740163.267663:0:7842:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:0.0:1790740163.267677:0:7842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:2.0:1790740163.267757:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021904384 00000100:00100000:2.0:1790740163.267764:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021904384 00000100:00100000:2.0:1790740163.267891:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790740163.267898:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000000aa31486 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021904384:12345-0@lo:400: 00000100:00100000:2.0:1790740163.267953:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000000aa31486 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021904384:12345-0@lo:400: Request processed in 56us (2780us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740163.267960:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790740163.267991:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022675901 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021904384:0@lo:400: 00000020:01000000:0.0:1790740163.268575:0:6532:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1790740163.268623:0:6532:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1790740163.268651:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: 00000000398877b6/0xb25dda4f4e92d824 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d82b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740163.268759:0:6532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: 00000000398877b6/0xb25dda4f4e92d824 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d82b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740163.268837:0:6532:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1790740163.268840:0:6532:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98dc992499c0 from 1 10000000:01000000:0.0:1790740163.268844:0:6532:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790740163.268907:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: 000000007fccda41/0xb25dda4f4e92d84e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740163.268918:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: 000000007fccda41/0xb25dda4f4e92d84e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740163.268942:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: 000000007fccda41/0xb25dda4f4e92d84e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740163.268965:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000086078a97 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021904896:0@lo:101: 00000100:00100000:0.0:1790740163.269024:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790740163.272583:0:6541:0:(import.c:65:import_set_state_nolock()) 00000000fa013712 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790740163.272737:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000090385019 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3637:x1877727021904128:12345-0@lo:38: Request processed in 14033us (14253us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740163.272753:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790740163.275363:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790740163.275382:0:3637:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1790740163.275392:0:3637:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1790740163.275398:0:3637:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1790740163.275401:0:3637:0:(import.c:65:import_set_state_nolock()) 000000009ccdaab7 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1790740163.275429:0:3637:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000d9b1e5da): req@00000000d5a6db1f x1877727021904640/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740163.275450:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022981703 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877727021904128:0@lo:38: 00000100:00100000:3.0:1790740163.276260:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021904896 00000100:00100000:3.0:1790740163.276276:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021904896 00000100:00100000:0.0:1790740163.276511:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set 000000008db6f21c going to sleep for 11 seconds 00000100:00100000:3.0:1790740163.276727:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790740163.276745:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001b7fe394 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021905024:0@lo:41: 00000100:00100000:3.0:1790740163.276827:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740163.276899:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021905024 00000100:00100000:0.0:1790740163.276905:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021905024 00000100:00100000:0.0:1790740163.276970:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790740163.276980:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000db079912 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1877727021905024:12345-0@lo:41: 00000004:00000024:0.0:1790740163.277023:0:6540:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1790740163.277099:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000db079912 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1877727021905024:12345-0@lo:41: Request processed in 120us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740163.277106:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790740163.277157:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001b7fe394 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021905024:0@lo:41: 00000100:00100000:0.0:1790740163.278214:0:7845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740163.278245:0:7845:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d9b1e5da going to sleep for 11 seconds 00000100:00100000:2.0:1790740163.278312:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790740163.278323:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000af854048 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:6532:x1877727021904896:12345-0@lo:101: 00010000:00010000:2.0:1790740163.278359:0:6529:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740163.278381:0:6529:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000037a00375/0xb25dda4f4e92d855 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92d84e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740163.278414:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000037a00375/0xb25dda4f4e92d855 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92d84e expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740163.278426:0:6529:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000037a00375/0xb25dda4f4e92d855 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d84e expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740163.278436:0:6529:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000037a00375, rc 0) 00000100:00100000:2.0:1790740163.278493:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000af854048 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+18:6532:x1877727021904896:12345-0@lo:101: Request processed in 171us (9469us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740163.278500:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790740163.278563:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000086078a97 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021904896:0@lo:101: 00010000:00010000:0.0:1790740163.278585:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: 000000007fccda41/0xb25dda4f4e92d84e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d855 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740163.278595:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: 000000007fccda41/0xb25dda4f4e92d84e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92d855 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740163.278704:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000086078a97 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021905152:0@lo:501: 00000100:00100000:0.0:1790740163.278733:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740163.278903:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set 000000008db6f21c going to sleep for 11 seconds 00000100:00100000:2.0:1790740163.279958:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021905152 00000100:00100000:2.0:1790740163.279971:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021905152 00000100:00100000:2.0:1790740163.280065:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790740163.280077:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000008e960a92 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+18:6532:x1877727021905152:12345-0@lo:501: 00000100:00100000:2.0:1790740163.280234:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000008e960a92 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+18:6532:x1877727021905152:12345-0@lo:501: Request processed in 160us (1499us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790740163.280242:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790740163.280428:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000086078a97 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021905152:0@lo:501: 10000000:01000000:0.0:1790740163.280495:0:6532:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1790740163.280506:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: 000000007fccda41/0xb25dda4f4e92d84e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d855 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740163.280517:0:6532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: 000000007fccda41/0xb25dda4f4e92d84e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d855 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740163.280956:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021904640 00000100:00100000:3.0:1790740163.280965:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021904640 00000100:00100000:3.0:1790740163.281024:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790740163.281065:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000004dd143bc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7845:x1877727021904640:12345-0@lo:1000: 00000100:00100000:3.0:1790740163.281182:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000004dd143bc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7845:x1877727021904640:12345-0@lo:1000: Request processed in 152us (2973us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740163.281205:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790740163.281393:0:7845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d5a6db1f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7845:1877727021904640:0@lo:1000: 00000040:01000000:0.0:1790740163.281436:0:7845:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1790740163.281507:0:7845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000086078a97 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7845:1877727021905280:0@lo:1000: 00000100:00100000:0.0:1790740163.281568:0:7845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740163.281612:0:7845:0:(client.c:2716:ptlrpc_set_wait()) set 000000008db6f21c going to sleep for 11 seconds 00000100:00100000:3.0:1790740163.286235:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021905280 00000100:00100000:3.0:1790740163.286260:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021905280 00000100:00100000:3.0:1790740163.286356:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790740163.286368:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000ff2ea3ea pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7845:x1877727021905280:12345-0@lo:1000: 00000100:00100000:3.0:1790740163.286672:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000ff2ea3ea pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7845:x1877727021905280:12345-0@lo:1000: Request processed in 306us (5104us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740163.286681:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790740163.286980:0:7845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000086078a97 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7845:1877727021905280:0@lo:1000: 00000100:00100000:1.0:1790740163.287123:0:7845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d5a6db1f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7845:1877727021905408:0@lo:700: 00000100:00100000:1.0:1790740163.287171:0:7845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740163.287204:0:7845:0:(client.c:2716:ptlrpc_set_wait()) set 000000006369c092 going to sleep for 11 seconds 00000100:00100000:0.0:1790740163.287382:0:6545:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021905408 00000100:00100000:0.0:1790740163.287389:0:6545:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021905408 00000100:00100000:0.0:1790740163.287434:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790740163.287441:0:6545:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000022675901 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7845:x1877727021905408:12345-0@lo:700: 00000100:00100000:0.0:1790740163.287510:0:6545:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000022675901 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7845:x1877727021905408:12345-0@lo:700: Request processed in 70us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740163.287517:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790740163.288587:0:7845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d5a6db1f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7845:1877727021905408:0@lo:700: 00000100:00100000:1.0:1790740163.288877:0:7845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d5a6db1f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7845:1877727021905536:0@lo:1000: 00000100:00100000:1.0:1790740163.288948:0:7845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740163.288984:0:7845:0:(client.c:2716:ptlrpc_set_wait()) set 000000006592597d going to sleep for 11 seconds 00000100:00100000:3.0:1790740163.289318:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021905536 00000100:00100000:3.0:1790740163.289327:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021905536 00000100:00100000:3.0:1790740163.289388:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790740163.289396:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000ef8df2df pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7845:x1877727021905536:12345-0@lo:1000: 00000100:00100000:3.0:1790740163.289505:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000ef8df2df pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7845:x1877727021905536:12345-0@lo:1000: Request processed in 111us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740163.289513:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790740163.289795:0:7845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d5a6db1f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7845:1877727021905536:0@lo:1000: 00000004:00080000:1.0:1790740163.289891:0:7845:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000006369c092 with version 0 00000020:00100000:1.0:1790740163.289913:0:7845:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1790740163.289921:0:7845:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000d5a6db1f x1877727021905792/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790740163.289939:0:7845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d5a6db1f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7845:1877727021905792:0@lo:1000: 00000100:00100000:1.0:1790740163.289970:0:7845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740163.290120:0:7845:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d9b1e5da going to sleep for 11 seconds 00000100:00100000:0.0:1790740163.293252:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021905792 00000100:00100000:0.0:1790740163.293273:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021905792 00000100:00100000:0.0:1790740163.293355:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790740163.293365:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000c179a950 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7845:x1877727021905792:12345-0@lo:1000: 00000001:00080000:2.0:1790740163.296981:0:7466:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:2.0:1790740163.297007:0:7466:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1790740163.302956:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000c179a950 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7845:x1877727021905792:12345-0@lo:1000: Request processed in 9522us (12916us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1790740163.303004:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:1.0:1790740163.306432:0:7845:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1790740163.306446:0:7845:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1790740163.306895:0:7845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d5a6db1f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7845:1877727021905792:0@lo:1000: 00000100:00100000:0.0:1790740163.307715:0:7845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000086078a97 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7845:1877727021905920:0@lo:1000: 00000100:00100000:0.0:1790740163.307999:0:7845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740163.309708:0:7845:0:(client.c:2716:ptlrpc_set_wait()) set 000000003ff317bf going to sleep for 11 seconds 00000100:00100000:3.0:1790740163.310997:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021905920 00000100:00100000:3.0:1790740163.311215:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021905920 00000100:00100000:3.0:1790740163.311312:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790740163.311323:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000069aff066 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7845:x1877727021905920:12345-0@lo:1000: 00000100:00100000:3.0:1790740163.312782:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000069aff066 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7845:x1877727021905920:12345-0@lo:1000: Request processed in 1452us (4774us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740163.312798:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790740163.318235:0:7845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000086078a97 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7845:1877727021905920:0@lo:1000: 00000040:00080000:0.0:1790740163.318293:0:7845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1790740163.318360:0:7845:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000db96f279 with version 1 00000004:00080000:1.0:1790740163.319927:0:7843:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000007bc3f66f version 1 rpc_version 1 00000020:00100000:1.0:1790740163.319983:0:7843:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1790740163.319997:0:7843:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000d5a6db1f x1877727021906176/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790740163.320060:0:7843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d5a6db1f pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7843:1877727021906176:0@lo:1000: 00000100:00100000:1.0:1790740163.320150:0:7843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740163.320220:0:7843:0:(client.c:2716:ptlrpc_set_wait()) set 000000006369c092 going to sleep for 11 seconds 00000100:00100000:2.0:1790740163.320519:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021906176 00000100:00100000:2.0:1790740163.320530:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021906176 00000100:00100000:2.0:1790740163.320611:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790740163.320621:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000005aeeb779 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7843:x1877727021906176:12345-0@lo:1000: 00000040:00080000:0.0:1790740163.322978:0:7845:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1790740163.324236:0:7845:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1790740163.324247:0:7845:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:1.0:1790740163.324606:0:7466:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:2.0:1790740163.325259:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000005aeeb779 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7843:x1877727021906176:12345-0@lo:1000: Request processed in 4633us (5102us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1790740163.325292:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:1.0:1790740163.325416:0:7843:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1790740163.325423:0:7843:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1790740163.325446:0:7843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d5a6db1f pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7843:1877727021906176:0@lo:1000: 00010000:00010000:2.0:1790740164.076202:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1790740164.899818:0:7896:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790740164.900221:0:7896:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1790740165.098317:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740165.226498:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d5a6db1f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727021906304:0@lo:41: 00000100:00100000:3.0:1790740165.226620:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740165.227075:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021906304 00000100:00100000:0.0:1790740165.227088:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021906304 00000100:00100000:0.0:1790740165.227158:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790740165.227168:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000001b7fe394 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727021906304:12345-0@lo:41: 00000004:00000024:0.0:1790740165.227216:0:6541:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1790740165.227301:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000001b7fe394 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727021906304:12345-0@lo:41: Request processed in 133us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740165.227310:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790740165.227438:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d5a6db1f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727021906304:0@lo:41: 00010000:00010000:3.0:1790740166.131880:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790740166.215439:0:7944:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffcae79bb0 20000000:00000080:0.0:1790740166.215532:0:7944:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98dcbc214400 uarg=0000000000000000 20000000:01000000:0.0:1790740166.215591:0:7944:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1790740166.215600:0:7944:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1790740166.215606:0:7944:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1790740166.215714:0:7944:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1790740166.215729:0:7944:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1790740166.226447:0:7944:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790740166.226793:0:7944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1790740166.226860:0:7944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1790740166.226889:0:7944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1790740166.226924:0:7944:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1790740166.226950:0:7944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d2076d9c/0xb25dda4f4e92d85c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740166.226983:0:7944:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d6f58cc9/0xb25dda4f4e92d6db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d6d4 expref: 17 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740166.226991:0:7944:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007f1b7985/0xb25dda4f4e92d7c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d7c2 expref: 17 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740166.226998:0:7944:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000d2076d9c/0xb25dda4f4e92d85c lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740166.227080:0:7944:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007f1b7985/0xb25dda4f4e92d7c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92d7c2 expref: 17 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740166.227099:0:7944:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007f1b7985/0xb25dda4f4e92d7c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92d7c2 expref: 17 pid: 6529 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740166.227115:0:7944:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d5a6db1f pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7944:1877727021906432:0@lo:104: 00000100:00100000:1.0:1790740166.227212:0:7944:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740166.227290:0:6518:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1790740166.227308:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021906432 00000100:00100000:1.0:1790740166.227320:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021906432 00000100:00100000:1.0:1790740166.227379:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790740166.227388:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000095c1cef5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+3:7944:x1877727021906432:12345-0@lo:104: 00010000:00010000:1.0:1790740166.227403:0:6518:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: 00000000e5f2e4ec/0xb25dda4f4e92d7c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d7c9 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740166.227471:0:6518:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790740166.227483:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000095c1cef5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+3:7944:x1877727021906432:12345-0@lo:104: Request processed in 97us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740166.227491:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1790740166.227547:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790740166.227554:0:6524:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: 00000000e5f2e4ec/0xb25dda4f4e92d7c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d7c9 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740166.227563:0:6524:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock 00000000e5f2e4ec already unused, calling callback (0000000092620f45) 10000000:00010000:1.0:1790740166.227566:0:6524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: 00000000e5f2e4ec/0xb25dda4f4e92d7c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92d7c9 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740166.227574:0:6524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: 00000000e5f2e4ec/0xb25dda4f4e92d7c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92d7c9 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790740166.227581:0:6524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: 00000000e5f2e4ec/0xb25dda4f4e92d7c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92d7c9 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740166.227586:0:6524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790740166.227623:0:6524:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: 00000000e5f2e4ec/0xb25dda4f4e92d7c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d7c9 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740166.227630:0:6524:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790740166.227648:0:6524:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: 00000000e5f2e4ec/0xb25dda4f4e92d7c2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d7c9 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740166.227654:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: 00000000e5f2e4ec/0xb25dda4f4e92d7c2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d7c9 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740166.227670:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740166.227672:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740166.227673:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740166.227728:0:7944:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d6f58cc9/0xb25dda4f4e92d6db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92d6d4 expref: 17 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740166.227736:0:7944:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d6f58cc9/0xb25dda4f4e92d6db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92d6d4 expref: 17 pid: 6530 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740166.227745:0:7944:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f8dc4ca pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7944:1877727021906688:0@lo:104: 00000100:00100000:1.0:1790740166.227771:0:7944:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740166.227790:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021906688 00000100:00100000:1.0:1790740166.227794:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021906688 00000100:00100000:1.0:1790740166.227810:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790740166.227814:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000038f8466c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+3:7944:x1877727021906688:12345-0@lo:104: 00010000:00010000:1.0:1790740166.227822:0:6518:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: 000000000cb6542f/0xb25dda4f4e92d6d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d6db expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740166.227851:0:6518:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790740166.227855:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000038f8466c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+3:7944:x1877727021906688:12345-0@lo:104: Request processed in 42us (85us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740166.227861:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790740166.227879:0:7944:0:(client.c:2716:ptlrpc_set_wait()) set 000000009fee1f32 going to sleep for 11 seconds 00000100:00100000:1.0:1790740166.227907:0:7944:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d5a6db1f pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7944:1877727021906432:0@lo:104: 00000100:00100000:1.0:1790740166.227916:0:7944:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f8dc4ca pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7944:1877727021906688:0@lo:104: 00010000:00010000:1.0:1790740166.227939:0:7944:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000d2076d9c/0xb25dda4f4e92d85c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740166.228859:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740166.228871:0:6523:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: 000000000cb6542f/0xb25dda4f4e92d6d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d6db expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740166.228882:0:6523:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock 000000000cb6542f already unused, calling callback (0000000092620f45) 10000000:00010000:3.0:1790740166.228884:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: 000000000cb6542f/0xb25dda4f4e92d6d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92d6db expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740166.228892:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: 000000000cb6542f/0xb25dda4f4e92d6d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92d6db expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790740166.228898:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: 000000000cb6542f/0xb25dda4f4e92d6d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92d6db expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740166.228903:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790740166.228949:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: 000000000cb6542f/0xb25dda4f4e92d6d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d6db expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740166.228956:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790740166.228967:0:6523:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: 000000000cb6542f/0xb25dda4f4e92d6d4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d6db expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740166.228982:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: 000000000cb6542f/0xb25dda4f4e92d6d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d6db expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740166.229007:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740166.229009:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740166.229011:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740166.229650:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000d0bf9f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727021906560:0@lo:103: 00000100:00100000:2.0:1790740166.229725:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740166.229791:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790740166.229798:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022981703 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727021906816:0@lo:103: 00000100:00100000:2.0:1790740166.230204:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740166.230734:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021906560 00000100:00100000:3.0:1790740166.230745:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021906560 00010000:00010000:3.0:1790740166.230780:0:6522:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007f1b7985/0xb25dda4f4e92d7c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d7c2 expref: 18 pid: 6529 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740166.230840:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021906816 00000100:00100000:3.0:1790740166.230844:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021906816 00010000:00010000:3.0:1790740166.230854:0:6522:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d6f58cc9/0xb25dda4f4e92d6db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d6d4 expref: 19 pid: 6530 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740166.230867:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790740166.230874:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000d658528a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+19:3640:x1877727021906560:12345-0@lo:103: 00010000:00010000:3.0:1790740166.230890:0:6522:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740166.230894:0:6522:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007f1b7985/0xb25dda4f4e92d7c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d7c2 expref: 19 pid: 6529 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740166.230905:0:6522:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007f1b7985/0xb25dda4f4e92d7c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92d7c2 expref: 19 pid: 6529 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740166.231124:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007f1b7985/0xb25dda4f4e92d7c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92d7c2 expref: 19 pid: 6529 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740166.231141:0:6522:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740166.231195:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000d658528a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+18:3640:x1877727021906560:12345-0@lo:103: Request processed in 322us (1471us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740166.231204:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790740166.231228:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790740166.231246:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000549ee20a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:3640:x1877727021906816:12345-0@lo:103: 00010000:00010000:3.0:1790740166.231254:0:6522:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740166.231258:0:6522:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d6f58cc9/0xb25dda4f4e92d6db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d6d4 expref: 17 pid: 6530 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740166.231266:0:6522:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d6f58cc9/0xb25dda4f4e92d6db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92d6d4 expref: 17 pid: 6530 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740166.231282:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d6f58cc9/0xb25dda4f4e92d6db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92d6d4 expref: 17 pid: 6530 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740166.231296:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000d2076d9c/0xb25dda4f4e92d85c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740166.231304:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d2076d9c/0xb25dda4f4e92d85c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740166.231584:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d2076d9c/0xb25dda4f4e92d85c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740166.231594:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d2076d9c/0xb25dda4f4e92d85c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740166.231601:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d2076d9c/0xb25dda4f4e92d85c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740166.231608:0:6522:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d2076d9c/0xb25dda4f4e92d85c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740166.231615:0:6522:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock 00000000d2076d9c already unused, calling callback (0000000006bfcbe5) 00010000:00010000:3.0:1790740166.231619:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d2076d9c/0xb25dda4f4e92d85c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740166.231627:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d2076d9c/0xb25dda4f4e92d85c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740166.231650:0:6522:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d2076d9c/0xb25dda4f4e92d85c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740166.231675:0:6522:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740166.231708:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000549ee20a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:3640:x1877727021906816:12345-0@lo:103: Request processed in 474us (1504us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740166.231715:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1790740166.231780:0:7944:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000d2076d9c/0xb25dda4f4e92d85c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740166.231789:0:7944:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d2076d9c/0xb25dda4f4e92d85c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740166.231803:0:7944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d2076d9c/0xb25dda4f4e92d85c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740166.234450:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022981703 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727021906816:0@lo:103: 00000100:00100000:2.0:1790740166.234472:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000d0bf9f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727021906560:0@lo:103: 00010000:00010000:2.0:1790740167.146441:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740168.174174:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740168.298219:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000086078a97 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021906944:0@lo:41: 00000100:00100000:0.0:1790740168.298521:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740168.298639:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021906944 00000100:00100000:0.0:1790740168.298650:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021906944 00000100:00100000:0.0:1790740168.298709:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790740168.298719:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000009a6def53 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021906944:12345-0@lo:41: 00000004:00000024:0.0:1790740168.298771:0:6540:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1790740168.299208:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d5a6db1f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877727021907200:0@lo:400: 00000100:00100000:1.0:1790740168.299266:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740168.299295:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790740168.299300:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000930cce5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021907328:0@lo:400: 00000100:00100000:1.0:1790740168.299346:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740168.299396:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021907200 00000100:00100000:1.0:1790740168.299402:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021907200 00000100:00100000:1.0:1790740168.299441:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790740168.299448:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000000d0bf9f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877727021907200:12345-0@lo:400: 00000100:00100000:1.0:1790740168.299498:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000000d0bf9f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877727021907200:12345-0@lo:400: Request processed in 51us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740168.299506:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790740168.299535:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021907328 00000100:00100000:1.0:1790740168.299539:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021907328 00000100:00100000:1.0:1790740168.299558:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790740168.299564:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000007e4ce9e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021907328:12345-0@lo:400: 00000100:00100000:1.0:1790740168.299596:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000007e4ce9e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021907328:12345-0@lo:400: Request processed in 33us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740168.299603:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790740168.299646:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000930cce5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021907328:0@lo:400: 00010000:00080000:1.0:1790740168.299661:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000d5a6db1f x1877727021907200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740184 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740168.299686:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d5a6db1f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877727021907200:0@lo:400: 00000100:00100000:0.0:1790740168.300166:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000009a6def53 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021906944:12345-0@lo:41: Request processed in 1446us (1643us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740168.300174:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790740168.300274:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f8dc4ca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3639:1877727021907072:0@lo:400: 00000100:00100000:0.0:1790740168.303176:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740168.304132:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790740168.304150:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a282aacf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877727021907456:0@lo:400: 00000100:00100000:3.0:1790740168.304936:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021907072 00000100:00100000:3.0:1790740168.304950:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021907072 00000100:00100000:3.0:1790740168.305017:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790740168.305026:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000a7863fd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:3639:x1877727021907072:12345-0@lo:400: 00000100:00100000:3.0:1790740168.305625:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000a7863fd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:3639:x1877727021907072:12345-0@lo:400: Request processed in 599us (2459us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740168.305637:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790740168.305878:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740168.306620:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f8dc4ca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3639:1877727021907072:0@lo:400: 00000100:00100000:0.0:1790740168.306692:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000086078a97 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021906944:0@lo:41: 00000100:00100000:1.0:1790740168.307592:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021907456 00000100:00100000:1.0:1790740168.307605:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021907456 00000100:00100000:1.0:1790740168.307666:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790740168.307675:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000005530cf58 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877727021907456:12345-0@lo:400: 00000100:00100000:1.0:1790740168.307776:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000005530cf58 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877727021907456:12345-0@lo:400: Request processed in 102us (1899us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740168.307783:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1790740168.309569:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000a282aacf x1877727021907456/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740184 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740168.309594:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a282aacf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877727021907456:0@lo:400: 00010000:00010000:2.0:1790740169.194517:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740170.219423:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740170.346596:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e493f731 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727021907584:0@lo:41: 00000100:00100000:1.0:1790740170.346696:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740170.347065:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021907584 00000100:00100000:1.0:1790740170.347077:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021907584 00000100:00100000:1.0:1790740170.348624:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790740170.348645:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000004f5e29e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727021907584:12345-0@lo:41: 00000004:00000024:1.0:1790740170.348700:0:7846:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1790740170.348802:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000004f5e29e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727021907584:12345-0@lo:41: Request processed in 165us (2107us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740170.348811:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790740170.348886:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e493f731 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727021907584:0@lo:41: 00010000:00010000:3.0:1790740171.245803:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790740171.882112:0:6532:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790740171.882124:0:6532:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98dca0cb4800 from 1 10000000:01000000:0.0:1790740171.882131:0:6532:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790740171.882186:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: 00000000c5ea0cab/0xb25dda4f4e92d863 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740171.882201:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: 00000000c5ea0cab/0xb25dda4f4e92d863 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740171.882238:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: 00000000c5ea0cab/0xb25dda4f4e92d863 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740171.882266:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000086078a97 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021907712:0@lo:101: 00000100:00100000:0.0:1790740171.882368:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740171.882434:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set 0000000011576f35 going to sleep for 11 seconds 00000100:00100000:1.0:1790740171.882574:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021907712 00000100:00100000:1.0:1790740171.882584:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021907712 00000100:00100000:1.0:1790740171.882642:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790740171.882650:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000aa897040 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:6532:x1877727021907712:12345-0@lo:101: 00010000:00010000:1.0:1790740171.882666:0:6530:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740171.882686:0:6530:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000043407004/0xb25dda4f4e92d86a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92d863 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740171.882713:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000043407004/0xb25dda4f4e92d86a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92d863 expref: 17 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740171.882723:0:6530:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000043407004/0xb25dda4f4e92d86a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d863 expref: 17 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740171.882745:0:6530:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000043407004, rc 0) 00000100:00100000:1.0:1790740171.882794:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000aa897040 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:6532:x1877727021907712:12345-0@lo:101: Request processed in 145us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740171.882801:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790740171.882861:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000086078a97 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021907712:0@lo:101: 00010000:00010000:1.0:1790740171.882877:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: 00000000c5ea0cab/0xb25dda4f4e92d863 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d86a expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740171.882886:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: 00000000c5ea0cab/0xb25dda4f4e92d863 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92d86a expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740171.882963:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e493f731 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021907840:0@lo:501: 00000100:00100000:1.0:1790740171.882989:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740171.883004:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set 000000007c81b31f going to sleep for 11 seconds 00000100:00100000:1.0:1790740171.883018:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021907840 00000100:00100000:1.0:1790740171.883021:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021907840 00000100:00100000:1.0:1790740171.883069:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790740171.883076:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000b0b7e89b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:6532:x1877727021907840:12345-0@lo:501: 00000100:00100000:1.0:1790740171.883359:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000b0b7e89b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:6532:x1877727021907840:12345-0@lo:501: Request processed in 138us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740171.883378:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790740171.883415:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e493f731 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021907840:0@lo:501: 00000100:00100000:1.0:1790740171.883448:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e493f731 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021907968:0@lo:503: 00000100:00100000:1.0:1790740171.883493:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740171.883510:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set 000000007c81b31f going to sleep for 11 seconds 00000100:00100000:1.0:1790740171.883523:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021907968 00000100:00100000:1.0:1790740171.883527:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021907968 00000100:00100000:1.0:1790740171.883550:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790740171.883556:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000067c61414 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:6532:x1877727021907968:12345-0@lo:503: 00000100:00100000:1.0:1790740171.883641:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000067c61414 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:6532:x1877727021907968:12345-0@lo:503: Request processed in 85us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740171.883649:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790740171.883687:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e493f731 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021907968:0@lo:503: 00000100:00100000:0.0:1790740171.903232:0:8147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005a8a4532 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8147:1877727021908096:0@lo:502: 00000100:00100000:0.0:1790740171.903360:0:8147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740171.903417:0:8147:0:(client.c:2716:ptlrpc_set_wait()) set 000000000243e2f7 going to sleep for 11 seconds 00000100:00100000:1.0:1790740171.903713:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021908096 00000100:00100000:1.0:1790740171.905470:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021908096 00000100:00100000:1.0:1790740171.905574:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790740171.905586:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000f0918674 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:8147:x1877727021908096:12345-0@lo:502: 00000100:00100000:1.0:1790740171.906451:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000f0918674 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:8147:x1877727021908096:12345-0@lo:502: Request processed in 864us (3088us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740171.906463:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1790740171.906490:0:8147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005a8a4532 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8147:1877727021908096:0@lo:502: 00000020:01000000:2.0:1790740171.906541:0:8147:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790740171.906554:0:8147:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740171.906556:0:8147:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1790740171.906566:0:8147:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98dca0cb4800 00000020:00000080:2.0:1790740171.906568:0:8147:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1790740171.906702:0:8147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb813b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8147:1877727021908224:0@lo:502: 00000100:00100000:2.0:1790740171.906756:0:8147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740171.906958:0:8147:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc897fbcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790740171.906963:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021908224 00000100:00100000:1.0:1790740171.906972:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021908224 00000100:00100000:1.0:1790740171.907016:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790740171.907025:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99054c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:8147:x1877727021908224:12345-0@lo:502: 00000100:00100000:1.0:1790740171.907167:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99054c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:8147:x1877727021908224:12345-0@lo:502: Request processed in 143us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740171.907181:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790740171.907349:0:8147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb813b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8147:1877727021908224:0@lo:502: 00000020:01000000:0.0:1790740171.907373:0:8147:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790740171.907380:0:8147:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740171.907382:0:8147:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1790740171.907386:0:8147:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1790740171.907889:0:6532:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1790740171.907923:0:6532:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790740171.907938:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3a00/0xb25dda4f4e92d863 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d86a expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740171.907952:0:6532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3a00/0xb25dda4f4e92d863 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d86a expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740171.907964:0:6532:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790740171.907967:0:6532:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98dc82d23800 from 1 10000000:01000000:1.0:1790740171.907971:0:6532:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790740171.908011:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dca1968200/0xb25dda4f4e92d871 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740171.908021:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dca1968200/0xb25dda4f4e92d871 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740171.908063:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dca1968200/0xb25dda4f4e92d871 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740171.908082:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021908352:0@lo:101: 00000100:00100000:1.0:1790740171.908138:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740171.908232:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc985daa80 going to sleep for 11 seconds 00000100:00100000:2.0:1790740171.917426:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021908352 00000100:00100000:2.0:1790740171.917445:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021908352 00000100:00100000:2.0:1790740171.917826:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790740171.917840:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99055450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:6532:x1877727021908352:12345-0@lo:101: 00010000:00010000:2.0:1790740171.917864:0:6530:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740171.917890:0:6530:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dc81489c00/0xb25dda4f4e92d878 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92d871 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740171.917935:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dc81489c00/0xb25dda4f4e92d878 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92d871 expref: 18 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740171.917950:0:6530:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dc81489c00/0xb25dda4f4e92d878 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d871 expref: 18 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740171.917961:0:6530:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dc81489c00, rc 0) 00000100:00100000:2.0:1790740171.918082:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99055450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+18:6532:x1877727021908352:12345-0@lo:101: Request processed in 246us (9943us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740171.918089:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790740171.918191:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021908352:0@lo:101: 00010000:00010000:2.0:1790740171.918216:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dca1968200/0xb25dda4f4e92d871 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d878 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740171.918227:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dca1968200/0xb25dda4f4e92d871 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92d878 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740171.919221:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb813aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021908480:0@lo:501: 00000100:00100000:2.0:1790740171.919621:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740171.919903:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc897fb780 going to sleep for 11 seconds 00000100:00100000:1.0:1790740171.920151:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021908480 00000100:00100000:1.0:1790740171.920162:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021908480 00000100:00100000:1.0:1790740171.923514:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790740171.923548:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99056850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+18:6532:x1877727021908480:12345-0@lo:501: 00000100:00100000:1.0:1790740171.923807:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99056850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+18:6532:x1877727021908480:12345-0@lo:501: Request processed in 275us (4186us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740171.923830:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790740171.924170:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb813aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021908480:0@lo:501: 00000100:00100000:0.0:1790740171.924255:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb81b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021908608:0@lo:503: 00000100:00100000:0.0:1790740171.924343:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740171.924567:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc98473c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790740171.924700:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021908608 00000100:00100000:3.0:1790740171.924709:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021908608 00000100:00100000:3.0:1790740171.924759:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790740171.924767:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99054450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+18:6532:x1877727021908608:12345-0@lo:503: 00000100:00100000:3.0:1790740171.925434:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99054450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+18:6532:x1877727021908608:12345-0@lo:503: Request processed in 665us (1089us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740171.925445:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790740171.927822:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb81b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021908608:0@lo:503: 00000100:00100000:1.0:1790740171.938471:0:8150:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb81b4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8150:1877727021908736:0@lo:502: 00000100:00100000:1.0:1790740171.938581:0:8150:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740171.938631:0:8150:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc985dae40 going to sleep for 11 seconds 00000100:00100000:3.0:1790740171.938696:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021908736 00000100:00100000:3.0:1790740171.938706:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021908736 00000100:00100000:3.0:1790740171.938763:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790740171.938773:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99057450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+18:8150:x1877727021908736:12345-0@lo:502: 00000100:00100000:3.0:1790740171.939121:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99057450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+18:8150:x1877727021908736:12345-0@lo:502: Request processed in 347us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740171.939130:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790740171.939228:0:8150:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb81b4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8150:1877727021908736:0@lo:502: 00000020:01000000:1.0:1790740171.939260:0:8150:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790740171.939272:0:8150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740171.939275:0:8150:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790740171.939283:0:8150:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98dc82d23800 00000020:00000080:1.0:1790740171.939286:0:8150:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790740171.939325:0:8150:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8150:1877727021908864:0@lo:502: 00000100:00100000:1.0:1790740171.939367:0:8150:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740171.939399:0:8150:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc985dae40 going to sleep for 11 seconds 00000100:00100000:3.0:1790740171.939501:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021908864 00000100:00100000:3.0:1790740171.939506:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021908864 00000100:00100000:3.0:1790740171.939535:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790740171.939542:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99056c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+18:8150:x1877727021908864:12345-0@lo:502: 00000100:00100000:3.0:1790740171.939605:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99056c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+18:8150:x1877727021908864:12345-0@lo:502: Request processed in 63us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740171.939612:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790740171.939829:0:8150:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8150:1877727021908864:0@lo:502: 00000020:01000000:1.0:1790740171.939847:0:8150:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790740171.939852:0:8150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740171.939854:0:8150:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1790740171.939858:0:8150:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1790740171.940229:0:6532:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1790740171.940261:0:6532:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790740171.940274:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dca1968200/0xb25dda4f4e92d871 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d878 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740171.940287:0:6532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dca1968200/0xb25dda4f4e92d871 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d878 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740172.266305:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740173.291155:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740173.419327:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb81b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021909248:0@lo:400: 00000100:00100000:0.0:1790740173.419420:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740173.419656:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790740173.419667:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb81b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877727021909376:0@lo:400: 00000100:00100000:0.0:1790740173.419772:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740173.419838:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021909248 00000100:00100000:0.0:1790740173.419847:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021909248 00000100:00100000:0.0:1790740173.420241:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790740173.420251:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb81b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021909248:12345-0@lo:400: 00000100:00100000:0.0:1790740173.420324:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb81b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021909248:12345-0@lo:400: Request processed in 74us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740173.420333:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790740173.420361:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021909376 00000100:00100000:0.0:1790740173.420364:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021909376 00000100:00100000:1.0:1790740173.420491:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb81b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727021908992:0@lo:400: 00000100:00100000:1.0:1790740173.420530:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740173.420555:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb81b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021909504:0@lo:400: 00000100:00100000:1.0:1790740173.420577:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740173.420614:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790740173.420620:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb81b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877727021909120:0@lo:400: 00000100:00100000:1.0:1790740173.420642:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740173.420669:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98535180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021909632:0@lo:41: 00000100:00100000:1.0:1790740173.420688:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740173.420729:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021909120 00000100:00100000:1.0:1790740173.420733:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021909120 00000100:00100000:1.0:1790740173.420765:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790740173.420771:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5f6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877727021909120:12345-0@lo:400: 00000100:00100000:1.0:1790740173.420809:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5f6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877727021909120:12345-0@lo:400: Request processed in 38us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740173.420815:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1790740173.421114:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98dcb81b4380 x1877727021909120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740173.421131:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb81b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877727021909120:0@lo:400: 00000100:00100000:0.0:1790740173.421437:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790740173.421446:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb81b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877727021909376:12345-0@lo:400: 00000100:00100000:3.0:1790740173.421560:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021909504 00000100:00100000:3.0:1790740173.421565:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021909504 00000100:00100000:3.0:1790740173.421585:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021909632 00000100:00100000:3.0:1790740173.421597:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021909632 00000100:00100000:3.0:1790740173.421608:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790740173.421613:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5f6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3640:x1877727021909504:12345-0@lo:400: 00000100:00100000:3.0:1790740173.421655:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5f6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3640:x1877727021909504:12345-0@lo:400: Request processed in 42us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740173.421661:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790740173.421673:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790740173.421678:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021909632:12345-0@lo:41: 00000004:00000024:3.0:1790740173.421711:0:7846:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1790740173.421740:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021909632:12345-0@lo:41: Request processed in 63us (1051us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740173.421757:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790740173.421773:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021908992 00000100:00100000:3.0:1790740173.421776:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021908992 00000100:00100000:3.0:1790740173.421796:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1790740173.421801:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99057050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+18:3640:x1877727021908992:12345-0@lo:400: 00000100:00100000:3.0:1790740173.421828:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99057050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+18:3640:x1877727021908992:12345-0@lo:400: Request processed in 27us (1298us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740173.421833:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1790740173.422017:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98535180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021909632:0@lo:41: 00000100:00100000:3.0:1790740173.422026:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb81b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727021908992:0@lo:400: 00000100:00100000:3.0:1790740173.422049:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb81b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021909504:0@lo:400: 00000100:00100000:0.0:1790740173.422670:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb81b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877727021909376:12345-0@lo:400: Request processed in 1034us (2782us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740173.422680:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1790740173.422798:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98dcb81b7100 x1877727021909376/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740173.422810:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb81b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877727021909376:0@lo:400: 00000100:00100000:0.0:1790740173.422820:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb81b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021909248:0@lo:400: 00010000:00010000:1.0:1790740174.321102:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740175.339552:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740175.467386:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790740175.467415:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727021909760:0@lo:41: 00000100:00100000:2.0:1790740175.467499:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740175.467825:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021909760 00000100:00100000:3.0:1790740175.467833:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021909760 00000100:00100000:3.0:1790740175.467886:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790740175.467896:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb8139880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727021909760:12345-0@lo:41: 00000004:00000024:3.0:1790740175.467932:0:7846:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1790740175.467988:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb8139880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727021909760:12345-0@lo:41: Request processed in 93us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740175.467995:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790740175.468371:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727021909760:0@lo:41: 00010000:00010000:2.0:1790740176.366532:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740177.387341:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790740178.088009:0:8445:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1790740178.088014:0:8445:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1790740178.088015:0:8445:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1790740178.088936:0:8445:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98dcaedda800 00000020:01000004:3.0:1790740178.088954:0:8445:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1790740178.088967:0:8445:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1790740178.088991:0:8445:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff98dcaefccd40) 00000020:00000080:3.0:1790740178.089008:0:8445:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1790740178.130006:0:8445:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1790740178.131928:0:8445:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:2.0:1790740178.154094:0:8445:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1790740178.154457:0:8445:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1790740178.154469:0:8445:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790740178.154481:0:8445:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb25dda4f4e92d886 00000020:01000004:2.0:1790740178.154487:0:8445:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1790740178.154508:0:8445:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.103@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790740178.154511:0:8445:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790740178.154518:0:8445:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1790740178.154522:0:8445:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1790740178.154533:0:8445:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff98dcbc238000) 00000020:00000080:2.0:1790740178.154544:0:8445:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:2.0:1790740178.156192:0:8445:0:(service.c:173:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790740178.156358:0:8445:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1790740178.156364:0:8445:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1790740178.161827:0:8445:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1790740178.161844:0:8445:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1790740178.163547:0:8445:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1790740178.163557:0:8445:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1790740178.169217:0:8445:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790740178.169424:0:8445:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1790740178.169432:0:8445:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1790740178.185020:0:8445:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1790740178.185531:0:8445:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1790740178.217474:0:8445:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790740178.217937:0:8445:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1790740178.217945:0:8445:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1790740178.219275:0:8445:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1790740178.219285:0:8445:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1790740178.220595:0:8445:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1790740178.220661:0:8445:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1790740178.223492:0:8445:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790740178.223859:0:8445:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1790740178.223865:0:8445:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1790740178.224558:0:8445:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1790740178.224566:0:8445:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1790740178.266589:0:8445:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790740178.267023:0:8445:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1790740178.267109:0:8445:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1790740178.269480:0:8445:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1790740178.269493:0:8445:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1790740178.270234:0:8445:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1790740178.270262:0:8445:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1790740178.270269:0:8445:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.103@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1790740178.317452:0:8445:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.103@tcp ctxt 0 is initialized 00000020:01000004:1.0:1790740178.317499:0:8445:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.103@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1790740178.317504:0:8445:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1790740178.317506:0:8445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790740178.317508:0:8445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790740178.317509:0:8445:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790740178.317510:0:8445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790740178.317511:0:8445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790740178.317513:0:8445:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790740178.317514:0:8445:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790740178.317516:0:8445:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790740178.317523:0:8445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790740178.317524:0:8445:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790740178.317528:0:8445:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1790740178.317530:0:8445:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790740178.317532:0:8445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790740178.317533:0:8445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790740178.317534:0:8445:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790740178.317535:0:8445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790740178.317536:0:8445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790740178.317537:0:8445:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790740178.317538:0:8445:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790740178.317539:0:8445:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790740178.317539:0:8445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790740178.317540:0:8445:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790740178.317567:0:8445:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1790740178.317587:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8445:1877727021909888:0@lo:253: 00000100:00100000:1.0:1790740178.317658:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740178.317707:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5fbfb40 going to sleep for 11 seconds 00000100:00100000:3.0:1790740178.317788:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021909888 00000100:00100000:3.0:1790740178.317797:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021909888 00000100:00100000:3.0:1790740178.317852:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1790740178.317861:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99055050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+18:8445:x1877727021909888:12345-0@lo:253: 20000000:01000000:3.0:1790740178.317902:0:6529:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1790740178.317907:0:6529:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1790740178.317912:0:6529:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1790740178.317915:0:6529:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1790740178.318150:0:6529:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790740178.318325:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1790740178.318340:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1790740178.318359:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1790740178.318366:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1790740178.318380:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1790740178.318396:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1790740178.318483:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1790740178.318498:0:6529:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.103@tcp 20000000:01000000:3.0:1790740178.318499:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.103@tcp (null) (null) (null) 00000040:00080000:3.0:1790740178.318514:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1790740178.318520:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1790740178.318534:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1790740178.318540:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.103@tcp (null) (null) 00000040:00080000:3.0:1790740178.318553:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1790740178.318566:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1790740178.318579:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1790740178.318590:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1790740178.318654:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:3.0:1790740178.318665:0:6529:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.103@tcp 20000000:01000000:3.0:1790740178.318667:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.103@tcp (null) (null) (null) 00000040:00080000:3.0:1790740178.318680:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:3.0:1790740178.318686:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1790740178.318699:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:3.0:1790740178.318705:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.204.103@tcp (null) (null) 00000040:00080000:3.0:1790740178.318717:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:3.0:1790740178.318722:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1790740178.318749:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:3.0:1790740178.318766:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:3.0:1790740178.319154:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:3.0:1790740178.319167:0:6529:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.103@tcp 20000000:01000000:3.0:1790740178.319168:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.103@tcp (null) (null) (null) 00000040:00080000:3.0:1790740178.319197:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:3.0:1790740178.319203:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1790740178.319215:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:3.0:1790740178.319220:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.103@tcp (null) (null) 00000040:00080000:3.0:1790740178.319230:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:3.0:1790740178.319235:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1790740178.319245:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:3.0:1790740178.319258:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:3.0:1790740178.319272:0:6529:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1790740178.319275:0:6529:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1790740178.319279:0:6529:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1790740178.319325:0:6529:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1790740178.319327:0:6529:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1790740178.325669:0:8464:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:3.0:1790740178.325743:0:8464:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:3.0:1790740178.325764:0:8464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1790740178.326307:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1790740178.326332:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1790740178.326345:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1790740178.326359:0:6529:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1790740178.326362:0:6529:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1790740178.326832:0:8465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1790740178.326996:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1790740178.327018:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1790740178.327075:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1790740178.327088:0:6529:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1790740178.327090:0:6529:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1790740178.336885:0:8466:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 19 1->4: lustre sys.timeout 20000000:01000000:3.0:1790740178.336943:0:8466:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 19 2->4: lustre sys.timeout 00000040:00080000:3.0:1790740178.336962:0:8466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1790740178.337389:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:1.0:1790740178.337419:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:1.0:1790740178.337438:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:1.0:1790740178.337451:0:6529:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1790740178.337454:0:6529:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1790740178.337921:0:8467:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:2.0:1790740178.337951:0:8467:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:2.0:1790740178.337969:0:8467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:1.0:1790740178.338156:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:1.0:1790740178.338190:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:1.0:1790740178.338209:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 10000000:01000000:1.0:1790740178.338224:0:6529:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1790740178.338243:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98dca1969000/0xb25dda4f4e92d894 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740178.338274:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dc80030e00/0xb25dda4f4e92d760 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d759 expref: 18 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740178.338283:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dc81488400/0xb25dda4f4e92d7d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d7d0 expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740178.338289:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dca1969800/0xb25dda4f4e92d80f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d808 expref: 18 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740178.338296:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dc80031c00/0xb25dda4f4e92d82b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d824 expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740178.338303:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dc81489200/0xb25dda4f4e92d855 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d84e expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740178.338311:0:6529:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98dca1969000/0xb25dda4f4e92d894 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740178.338361:0:6529:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dc81489200/0xb25dda4f4e92d855 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92d84e expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740178.338375:0:6529:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98dc81489200/0xb25dda4f4e92d855 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92d84e expref: 18 pid: 6529 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740178.338390:0:6529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6e680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6529:1877727021910016:0@lo:104: 00000100:00100000:1.0:1790740178.338458:0:6529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790740178.338508:0:6529:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dc80031c00/0xb25dda4f4e92d82b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92d824 expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740178.338517:0:6529:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98dc80031c00/0xb25dda4f4e92d82b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92d824 expref: 18 pid: 6529 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740178.338533:0:6529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6f800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6529:1877727021910144:0@lo:104: 00000100:00100000:1.0:1790740178.338558:0:6529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790740178.338592:0:6529:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dca1969800/0xb25dda4f4e92d80f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92d808 expref: 18 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740178.338601:0:6529:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98dca1969800/0xb25dda4f4e92d80f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92d808 expref: 18 pid: 6530 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740178.338609:0:6529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6c380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6529:1877727021910272:0@lo:104: 00000100:00100000:1.0:1790740178.338629:0:6529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790740178.338647:0:6529:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dc81488400/0xb25dda4f4e92d7d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92d7d0 expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740178.338655:0:6529:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98dc81488400/0xb25dda4f4e92d7d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92d7d0 expref: 18 pid: 6529 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740178.338664:0:6529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6529:1877727021910400:0@lo:104: 00000100:00100000:1.0:1790740178.338683:0:6529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790740178.338700:0:6529:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dc80030e00/0xb25dda4f4e92d760 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92d759 expref: 18 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740178.338709:0:6529:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98dc80030e00/0xb25dda4f4e92d760 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92d759 expref: 18 pid: 6530 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740178.338717:0:6529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6ce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6529:1877727021910528:0@lo:104: 00000100:00100000:1.0:1790740178.338736:0:6529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740178.338745:0:6529:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5fbfe40 going to sleep for 11 seconds 00000100:00100000:2.0:1790740178.338804:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021910016 00000100:00100000:2.0:1790740178.338812:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021910016 00000100:00100000:2.0:1790740178.338845:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021910144 00000100:00100000:2.0:1790740178.338848:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021910144 00000100:00100000:2.0:1790740178.338857:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021910272 00000100:00100000:2.0:1790740178.338859:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021910272 00000100:00100000:2.0:1790740178.338868:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021910400 00000100:00100000:2.0:1790740178.338870:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021910400 00000100:00100000:2.0:1790740178.338879:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021910528 00000100:00100000:2.0:1790740178.338882:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021910528 00000100:00100000:2.0:1790740178.338896:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790740178.338906:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5f6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+7:6529:x1877727021910016:12345-0@lo:104: 00010000:00010000:2.0:1790740178.338919:0:6518:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2200/0xb25dda4f4e92d84e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d855 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740178.338993:0:6518:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790740178.339008:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5f6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+7:6529:x1877727021910016:12345-0@lo:104: Request processed in 103us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740178.339016:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790740178.339062:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790740178.339068:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+6:6529:x1877727021910144:12345-0@lo:104: 00010000:00010000:2.0:1790740178.339078:0:6518:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8e00/0xb25dda4f4e92d824 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d82b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740178.339112:0:6518:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790740178.339117:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+6:6529:x1877727021910144:12345-0@lo:104: Request processed in 50us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740178.339123:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790740178.339136:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790740178.339142:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5f6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+5:6529:x1877727021910272:12345-0@lo:104: 00010000:00010000:2.0:1790740178.339149:0:6518:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff98dc80030800/0xb25dda4f4e92d808 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d80f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740178.339174:0:6518:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1790740178.339191:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5f6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+5:6529:x1877727021910272:12345-0@lo:104: Request processed in 50us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740178.339197:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790740178.339210:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790740178.339214:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5f6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+4:6529:x1877727021910400:12345-0@lo:104: 00010000:00010000:2.0:1790740178.339221:0:6518:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff98dc80031400/0xb25dda4f4e92d7d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d7d7 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740178.339245:0:6518:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1790740178.339255:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5f6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+4:6529:x1877727021910400:12345-0@lo:104: Request processed in 41us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740178.339260:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790740178.339272:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790740178.339277:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+3:6529:x1877727021910528:12345-0@lo:104: 00010000:00010000:2.0:1790740178.339284:0:6518:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8a00/0xb25dda4f4e92d759 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d760 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740178.339313:0:6518:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1790740178.339318:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+3:6529:x1877727021910528:12345-0@lo:104: Request processed in 41us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740178.339322:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790740178.339463:0:6529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6e680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6529:1877727021910016:0@lo:104: 00000100:00100000:1.0:1790740178.339481:0:6529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6f800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6529:1877727021910144:0@lo:104: 00000100:00100000:1.0:1790740178.339487:0:6529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6c380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6529:1877727021910272:0@lo:104: 00000100:00100000:1.0:1790740178.339493:0:6529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6529:1877727021910400:0@lo:104: 00000100:00100000:1.0:1790740178.339499:0:6529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6ce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6529:1877727021910528:0@lo:104: 00010000:00010000:1.0:1790740178.339519:0:6529:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98dca1969000/0xb25dda4f4e92d894 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.339589:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1790740178.339598:0:6523:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2200/0xb25dda4f4e92d84e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d855 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.339606:0:6523:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee2200 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:0.0:1790740178.339610:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2200/0xb25dda4f4e92d84e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92d855 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.339619:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2200/0xb25dda4f4e92d84e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92d855 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790740178.339626:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2200/0xb25dda4f4e92d84e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92d855 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740178.339631:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790740178.339671:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2200/0xb25dda4f4e92d84e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d855 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.339677:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790740178.339705:0:6523:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2200/0xb25dda4f4e92d84e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d855 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.339713:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2200/0xb25dda4f4e92d84e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d855 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.339738:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1790740178.339741:0:6523:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8e00/0xb25dda4f4e92d824 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d82b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.339746:0:6523:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc8e00 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:0.0:1790740178.339749:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8e00/0xb25dda4f4e92d824 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92d82b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.339755:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8e00/0xb25dda4f4e92d824 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92d82b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790740178.339761:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8e00/0xb25dda4f4e92d824 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92d82b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740178.339766:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790740178.339781:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8e00/0xb25dda4f4e92d824 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d82b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.339786:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790740178.339802:0:6523:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8e00/0xb25dda4f4e92d824 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d82b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.339809:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8e00/0xb25dda4f4e92d824 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d82b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.339817:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790740178.339821:0:6523:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dc80030800/0xb25dda4f4e92d808 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d80f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.339837:0:6523:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dc80030800 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:0.0:1790740178.339839:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dc80030800/0xb25dda4f4e92d808 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92d80f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.339845:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dc80030800/0xb25dda4f4e92d808 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92d80f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790740178.339851:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dc80030800/0xb25dda4f4e92d808 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92d80f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740178.339855:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790740178.339869:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dc80030800/0xb25dda4f4e92d808 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d80f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.339874:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790740178.339879:0:6523:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dc80030800/0xb25dda4f4e92d808 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d80f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.339885:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dc80030800/0xb25dda4f4e92d808 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d80f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.339895:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790740178.339898:0:6523:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dc80031400/0xb25dda4f4e92d7d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d7d7 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.339903:0:6523:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dc80031400 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:0.0:1790740178.339906:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dc80031400/0xb25dda4f4e92d7d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92d7d7 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.339922:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dc80031400/0xb25dda4f4e92d7d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92d7d7 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790740178.339928:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dc80031400/0xb25dda4f4e92d7d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92d7d7 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740178.339934:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790740178.339947:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dc80031400/0xb25dda4f4e92d7d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d7d7 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.339952:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790740178.339957:0:6523:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dc80031400/0xb25dda4f4e92d7d0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d7d7 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.339963:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dc80031400/0xb25dda4f4e92d7d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d7d7 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.339973:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790740178.339976:0:6523:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8a00/0xb25dda4f4e92d759 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d760 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.339981:0:6523:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc8a00 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:0.0:1790740178.339983:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8a00/0xb25dda4f4e92d759 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92d760 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.339990:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8a00/0xb25dda4f4e92d759 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92d760 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790740178.339995:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8a00/0xb25dda4f4e92d759 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92d760 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740178.340005:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790740178.340018:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8a00/0xb25dda4f4e92d759 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d760 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.340023:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790740178.340027:0:6523:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8a00/0xb25dda4f4e92d759 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d760 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.340065:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8a00/0xb25dda4f4e92d759 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d760 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.340080:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740178.340082:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740178.340084:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740178.340090:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740178.340103:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb81b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727021911040:0@lo:103: 00000100:00100000:0.0:1790740178.340142:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740178.340189:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1790740178.340196:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb81b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727021910656:0@lo:103: 00000100:00100000:0.0:1790740178.340233:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740178.340251:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb81b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727021911168:0@lo:103: 00000100:00100000:0.0:1790740178.340269:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740178.340292:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb81b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727021910784:0@lo:103: 00000100:00100000:0.0:1790740178.340310:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740178.340320:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790740178.340324:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb81b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727021910912:0@lo:103: 00000100:00100000:0.0:1790740178.340342:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740178.340827:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021911040 00000100:00100000:0.0:1790740178.340834:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021911040 00010000:00010000:0.0:1790740178.340874:0:6522:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dc81488400/0xb25dda4f4e92d7d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d7d0 expref: 19 pid: 6529 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740178.340894:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021910656 00000100:00100000:0.0:1790740178.340897:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021910656 00010000:00010000:0.0:1790740178.340907:0:6522:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dc81489200/0xb25dda4f4e92d855 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d84e expref: 20 pid: 6529 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740178.340916:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021911168 00000100:00100000:0.0:1790740178.340918:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021911168 00010000:00010000:0.0:1790740178.340926:0:6522:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dc80030e00/0xb25dda4f4e92d760 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d759 expref: 21 pid: 6530 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740178.340936:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021910784 00000100:00100000:0.0:1790740178.340938:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021910784 00010000:00010000:0.0:1790740178.340947:0:6522:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dc80031c00/0xb25dda4f4e92d82b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d824 expref: 22 pid: 6529 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740178.340957:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021910912 00000100:00100000:0.0:1790740178.340959:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021910912 00010000:00010000:0.0:1790740178.340967:0:6522:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dca1969800/0xb25dda4f4e92d80f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d808 expref: 23 pid: 6530 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740178.340979:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790740178.340985:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb81b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:3638:x1877727021911040:12345-0@lo:103: 00010000:00010000:0.0:1790740178.340998:0:6522:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740178.341002:0:6522:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dc81488400/0xb25dda4f4e92d7d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d7d0 expref: 23 pid: 6529 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.341011:0:6522:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dc81488400/0xb25dda4f4e92d7d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92d7d0 expref: 23 pid: 6529 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.341067:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dc81488400/0xb25dda4f4e92d7d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92d7d0 expref: 23 pid: 6529 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.341082:0:6522:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740178.341126:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb81b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+22:3638:x1877727021911040:12345-0@lo:103: Request processed in 141us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740178.341131:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790740178.341146:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790740178.341151:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82331880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:3638:x1877727021910656:12345-0@lo:103: 00010000:00010000:0.0:1790740178.341158:0:6522:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740178.341162:0:6522:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dc81489200/0xb25dda4f4e92d855 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d84e expref: 21 pid: 6529 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.341170:0:6522:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dc81489200/0xb25dda4f4e92d855 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92d84e expref: 21 pid: 6529 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.341191:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dc81489200/0xb25dda4f4e92d855 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92d84e expref: 21 pid: 6529 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.341200:0:6522:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740178.341222:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82331880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+20:3638:x1877727021910656:12345-0@lo:103: Request processed in 71us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740178.341228:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790740178.341241:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790740178.341247:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82330a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+19:3638:x1877727021911168:12345-0@lo:103: 00010000:00010000:0.0:1790740178.341256:0:6522:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740178.341260:0:6522:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dc80030e00/0xb25dda4f4e92d760 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d759 expref: 19 pid: 6530 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.341273:0:6522:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dc80030e00/0xb25dda4f4e92d760 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92d759 expref: 19 pid: 6530 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.341283:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dc80030e00/0xb25dda4f4e92d760 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92d759 expref: 19 pid: 6530 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.341291:0:6522:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740178.341313:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82330a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+18:3638:x1877727021911168:12345-0@lo:103: Request processed in 66us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740178.341319:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790740178.341332:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790740178.341337:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82330700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:3640:x1877727021910784:12345-0@lo:103: 00010000:00010000:0.0:1790740178.341345:0:6522:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790740178.342186:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb81b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727021910656:0@lo:103: 00000100:00100000:1.0:1790740178.342200:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb81b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727021911168:0@lo:103: 00000100:00100000:1.0:1790740178.342208:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb81b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727021911040:0@lo:103: 00010000:00010000:0.0:1790740178.342305:0:6522:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dc80031c00/0xb25dda4f4e92d82b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d824 expref: 17 pid: 6529 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.342316:0:6522:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dc80031c00/0xb25dda4f4e92d82b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92d824 expref: 17 pid: 6529 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.342327:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dc80031c00/0xb25dda4f4e92d82b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92d824 expref: 17 pid: 6529 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.342336:0:6522:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740178.342472:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82330700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:3640:x1877727021910784:12345-0@lo:103: Request processed in 1134us (2160us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740178.342480:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790740178.342501:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790740178.342509:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc86ac3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:3640:x1877727021910912:12345-0@lo:103: 00010000:00010000:0.0:1790740178.342538:0:6522:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740178.342544:0:6522:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dca1969800/0xb25dda4f4e92d80f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d808 expref: 15 pid: 6530 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.342552:0:6522:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dca1969800/0xb25dda4f4e92d80f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92d808 expref: 15 pid: 6530 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.342561:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dca1969800/0xb25dda4f4e92d80f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92d808 expref: 15 pid: 6530 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.342572:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98dca1969000/0xb25dda4f4e92d894 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.342580:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dca1969000/0xb25dda4f4e92d894 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.342595:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98dca1969000/0xb25dda4f4e92d894 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.342604:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98dca1969000/0xb25dda4f4e92d894 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.342611:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98dca1969000/0xb25dda4f4e92d894 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.342618:0:6522:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98dca1969000/0xb25dda4f4e92d894 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.342623:0:6522:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dca1969000 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:0.0:1790740178.342627:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98dca1969000/0xb25dda4f4e92d894 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.342645:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98dca1969000/0xb25dda4f4e92d894 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.342667:0:6522:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98dca1969000/0xb25dda4f4e92d894 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.342678:0:6522:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740178.342703:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc86ac3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+14:3640:x1877727021910912:12345-0@lo:103: Request processed in 196us (2359us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740178.342709:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1790740178.346419:0:6529:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98dca1969000/0xb25dda4f4e92d894 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740178.346438:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98dca1969000/0xb25dda4f4e92d894 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740178.346445:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dca1969000/0xb25dda4f4e92d894 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790740178.346465:0:6529:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1790740178.348637:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99055050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+13:8445:x1877727021909888:12345-0@lo:253: Request processed in 30767us (30969us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740178.348651:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1790740178.349279:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb81b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727021910784:0@lo:103: 00000100:00100000:2.0:1790740178.349733:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8445:1877727021909888:0@lo:253: 10000000:01000000:2.0:1790740178.349760:0:8445:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1790740178.349764:0:8445:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790740178.349766:0:8445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790740178.349768:0:8445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790740178.349769:0:8445:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1790740178.349771:0:8445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790740178.349772:0:8445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790740178.349773:0:8445:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790740178.349775:0:8445:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1790740178.349776:0:8445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790740178.349777:0:8445:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790740178.349797:0:8445:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98dcaedda800 from lustre-OST0000 10000000:01000000:2.0:1790740178.349950:0:8445:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1790740178.349954:0:8445:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1790740178.349962:0:8445:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98dc992499c0 local copy 10000000:01000000:2.0:1790740178.349965:0:8445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790740178.350018:0:8445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dc81488600/0xb25dda4f4e92d89b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740178.350063:0:8445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.103@tcp lock: ffff98dc81488600/0xb25dda4f4e92d89b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740178.350074:0:8445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dc81488600/0xb25dda4f4e92d89b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740178.350093:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb8138a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8445:1877727021911296:0@lo:101: 00000100:00100000:2.0:1790740178.350144:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740178.350192:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc897fb000 going to sleep for 11 seconds 00000100:00100000:2.0:1790740178.350217:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb81b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727021910912:0@lo:103: 00000100:00100000:3.0:1790740178.351212:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021911296 00000100:00100000:3.0:1790740178.351222:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021911296 00000100:00100000:3.0:1790740178.351280:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790740178.351289:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99056450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+13:8445:x1877727021911296:12345-0@lo:101: 00010000:00010000:3.0:1790740178.351304:0:6528:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740178.351321:0:6528:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcb5dc8c00/0xb25dda4f4e92d8a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92d89b expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740178.351359:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcb5dc8c00/0xb25dda4f4e92d8a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92d89b expref: 14 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740178.352206:0:6528:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcb5dc8c00/0xb25dda4f4e92d8a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d89b expref: 14 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740178.352223:0:6528:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc8c00, rc 0) 00000100:00100000:3.0:1790740178.352383:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99056450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+14:8445:x1877727021911296:12345-0@lo:101: Request processed in 1093us (2237us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740178.352390:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1790740178.353425:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb8138a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8445:1877727021911296:0@lo:101: 00010000:00010000:2.0:1790740178.353451:0:8445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dc81488600/0xb25dda4f4e92d89b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xb25dda4f4e92d8a2 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740178.353463:0:8445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dc81488600/0xb25dda4f4e92d89b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb25dda4f4e92d8a2 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740178.353595:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb8138a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8445:1877727021911424:0@lo:501: 00000100:00100000:2.0:1790740178.353642:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740178.353680:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc897fb000 going to sleep for 11 seconds 00000100:00100000:1.0:1790740178.353733:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021911424 00000100:00100000:1.0:1790740178.353740:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021911424 00000100:00100000:1.0:1790740178.353786:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1790740178.353796:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99056050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+14:8445:x1877727021911424:12345-0@lo:501: 00000100:00100000:1.0:1790740178.353882:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99056050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+14:8445:x1877727021911424:12345-0@lo:501: Request processed in 87us (239us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790740178.353890:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1790740178.354077:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb8138a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8445:1877727021911424:0@lo:501: 10000000:01000000:2.0:1790740178.354092:0:8445:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1790740178.354110:0:8445:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1790740178.354117:0:8445:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dc81488600/0xb25dda4f4e92d89b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb25dda4f4e92d8a2 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740178.354137:0:8445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dc81488600/0xb25dda4f4e92d89b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb25dda4f4e92d8a2 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740178.354144:0:8445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: ffff98dc81488600/0xb25dda4f4e92d89b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb25dda4f4e92d8a2 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740178.354163:0:8445:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1790740178.354198:0:8445:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98dcaedda800 10000000:01000000:2.0:1790740178.354204:0:8445:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1790740178.354209:0:8445:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1790740178.354212:0:8445:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790740178.354216:0:8445:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1790740178.354219:0:8445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1790740178.354238:0:8445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dc81489400/0xb25dda4f4e92d8a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740178.354245:0:8445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dc81489400/0xb25dda4f4e92d8a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740178.354254:0:8445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dc81489400/0xb25dda4f4e92d8a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740178.354266:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb8138a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8445:1877727021911552:0@lo:101: 00000100:00100000:2.0:1790740178.354295:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740178.354316:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc897fb240 going to sleep for 11 seconds 00000100:00100000:1.0:1790740178.354386:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021911552 00000100:00100000:1.0:1790740178.354391:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021911552 00000100:00100000:1.0:1790740178.354427:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1790740178.354433:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99054050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+14:8445:x1877727021911552:12345-0@lo:101: 00010000:00010000:1.0:1790740178.354442:0:6528:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740178.354454:0:6528:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dca1968c00/0xb25dda4f4e92d8b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92d8a9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740178.354472:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dca1968c00/0xb25dda4f4e92d8b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92d8a9 expref: 15 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740178.354482:0:6528:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dca1968c00/0xb25dda4f4e92d8b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d8a9 expref: 15 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740178.354489:0:6528:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dca1968c00, rc 0) 00000100:00100000:1.0:1790740178.354522:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99054050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:8445:x1877727021911552:12345-0@lo:101: Request processed in 90us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740178.354528:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1790740178.354559:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb8138a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8445:1877727021911552:0@lo:101: 00010000:00010000:1.0:1790740178.354571:0:8445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dc81489400/0xb25dda4f4e92d8a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d8b0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740178.354578:0:8445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dc81489400/0xb25dda4f4e92d8a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92d8b0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740178.354647:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8445:1877727021911680:0@lo:501: 00000100:00100000:1.0:1790740178.354674:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740178.354686:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5fbf180 going to sleep for 11 seconds 00000100:00100000:0.0:1790740178.354746:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021911680 00000100:00100000:0.0:1790740178.354751:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021911680 00000100:00100000:0.0:1790740178.354784:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1790740178.354791:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99055850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:8445:x1877727021911680:12345-0@lo:501: 00000100:00100000:0.0:1790740178.354886:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99055850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:8445:x1877727021911680:12345-0@lo:501: Request processed in 96us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740178.354892:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00010000:0.0:1790740178.354913:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790740178.354919:0:6523:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dc81488600/0xb25dda4f4e92d89b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xb25dda4f4e92d8a2 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.354927:0:6523:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dc81488600 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:0.0:1790740178.354931:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dc81488600/0xb25dda4f4e92d89b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xb25dda4f4e92d8a2 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.354940:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dc81488600/0xb25dda4f4e92d89b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xb25dda4f4e92d8a2 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790740178.354957:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dc81488600/0xb25dda4f4e92d89b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xb25dda4f4e92d8a2 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740178.354962:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790740178.354980:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dc81488600/0xb25dda4f4e92d89b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb25dda4f4e92d8a2 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.354987:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790740178.355005:0:6523:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dc81488600/0xb25dda4f4e92d89b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb25dda4f4e92d8a2 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.355012:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dc81488600/0xb25dda4f4e92d89b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb25dda4f4e92d8a2 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.355025:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740178.355026:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740178.355051:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740178.355059:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790740178.355069:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82331880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3641:1877727021911808:0@lo:103: 00000100:00100000:0.0:1790740178.355096:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740178.355120:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021911808 00000100:00100000:0.0:1790740178.355123:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021911808 00000100:00100000:0.0:1790740178.355148:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790740178.355155:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82330a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:3641:x1877727021911808:12345-0@lo:103: 00010000:00010000:0.0:1790740178.355162:0:6522:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740178.355173:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcb5dc8c00/0xb25dda4f4e92d8a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb25dda4f4e92d89b expref: 15 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.355194:0:6522:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740178.355225:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82330a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+14:3641:x1877727021911808:12345-0@lo:103: Request processed in 71us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740178.355231:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790740178.355254:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82331880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3641:1877727021911808:0@lo:103: 00000100:00100000:1.0:1790740178.355403:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8445:1877727021911680:0@lo:501: 00000100:00100000:1.0:1790740178.355429:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8445:1877727021911936:0@lo:503: 00000100:00100000:1.0:1790740178.355468:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740178.355491:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5fbf180 going to sleep for 11 seconds 00000100:00100000:0.0:1790740178.355566:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021911936 00000100:00100000:0.0:1790740178.355570:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021911936 00000100:00100000:0.0:1790740178.355600:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1790740178.355608:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99054850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+14:8445:x1877727021911936:12345-0@lo:503: 00000100:00100000:0.0:1790740178.355685:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99054850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+14:8445:x1877727021911936:12345-0@lo:503: Request processed in 78us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740178.355692:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1790740178.355763:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8445:1877727021911936:0@lo:503: 00000040:00080000:1.0:1790740178.356015:0:8445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790740178.356114:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8445:1877727021912064:0@lo:502: 00000100:00100000:1.0:1790740178.356153:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740178.356171:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5fbf180 going to sleep for 11 seconds 00000100:00100000:0.0:1790740178.356237:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021912064 00000100:00100000:0.0:1790740178.356242:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021912064 00000100:00100000:0.0:1790740178.356274:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1790740178.356282:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+14:8445:x1877727021912064:12345-0@lo:502: 00000100:00100000:0.0:1790740178.356375:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+14:8445:x1877727021912064:12345-0@lo:502: Request processed in 94us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740178.356382:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1790740178.356811:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8445:1877727021912064:0@lo:502: 00000040:00080000:1.0:1790740178.357060:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1790740178.357090:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1790740178.357106:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1790740178.357117:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1790740178.357130:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1790740178.357140:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1790740178.357165:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8445:1877727021912192:0@lo:502: 00000100:00100000:1.0:1790740178.357220:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740178.357238:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5fbf180 going to sleep for 11 seconds 00000100:00100000:0.0:1790740178.357321:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021912192 00000100:00100000:0.0:1790740178.357326:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021912192 00000100:00100000:0.0:1790740178.357543:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1790740178.357551:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+14:8445:x1877727021912192:12345-0@lo:502: 00000100:00100000:0.0:1790740178.357635:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+14:8445:x1877727021912192:12345-0@lo:502: Request processed in 85us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740178.357642:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1790740178.357701:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8445:1877727021912192:0@lo:502: 00000040:00080000:1.0:1790740178.357737:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1790740178.357751:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1790740178.359532:0:8468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790740178.359552:0:8468:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1790740178.359560:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790740178.359562:0:8468:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1790740178.359570:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790740178.359585:0:8468:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff98dcaefc8000) 00000020:00000080:3.0:1790740178.359608:0:8468:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:3.0:1790740178.359615:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1790740178.359695:0:8468:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98dcaedda800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1790740178.359703:0:8468:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:3.0:1790740178.359719:0:8468:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb25dda4f4e92d8be 00010000:00010000:2.0:1790740178.364839:0:8468:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:2.0:1790740178.365351:0:8468:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1790740178.371716:0:8468:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1790740178.372740:0:8468:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1790740178.383448:0:8468:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1790740178.384443:0:8468:0:(osd_compat.c:1354:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1790740178.390110:0:8468:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1790740178.392781:0:8468:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1790740178.392796:0:8468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790740178.392803:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740178.392805:0:8468:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1790740178.392809:0:8468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790740178.392814:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740178.392815:0:8468:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790740178.392818:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790740178.392820:0:8468:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1790740178.392845:0:8468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790740178.392848:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740178.392849:0:8468:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:1.0:1790740178.392852:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1790740178.397164:0:8445:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1790740178.397220:0:8445:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1790740178.397281:0:8445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dc81489400/0xb25dda4f4e92d8a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d8b0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740178.397297:0:8445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dc81489400/0xb25dda4f4e92d8a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d8b0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740178.397306:0:8445:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98dcaedda800 from 1 10000000:01000000:3.0:1790740178.397309:0:8445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790740178.397349:0:8445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9c00/0xb25dda4f4e92d8c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740178.397358:0:8445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9c00/0xb25dda4f4e92d8c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740178.397370:0:8445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9c00/0xb25dda4f4e92d8c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740178.397395:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98535180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8445:1877727021912320:0@lo:101: 00000100:00100000:3.0:1790740178.397472:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740178.397539:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5fed9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740178.398144:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021912320 00000100:00100000:2.0:1790740178.398153:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021912320 00000100:00100000:2.0:1790740178.398215:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790740178.398226:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+14:8445:x1877727021912320:12345-0@lo:101: 00010000:00010000:2.0:1790740178.398242:0:6528:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740178.398258:0:6528:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dc81488000/0xb25dda4f4e92d8cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92d8c5 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740178.398283:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dc81488000/0xb25dda4f4e92d8cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92d8c5 expref: 15 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740178.398294:0:6528:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dc81488000/0xb25dda4f4e92d8cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d8c5 expref: 15 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740178.398303:0:6528:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dc81488000, rc 0) 00000100:00100000:2.0:1790740178.398347:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:8445:x1877727021912320:12345-0@lo:101: Request processed in 123us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740178.398354:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1790740178.398461:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98535180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8445:1877727021912320:0@lo:101: 00010000:00010000:3.0:1790740178.398476:0:8445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9c00/0xb25dda4f4e92d8c5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d8cc expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740178.398486:0:8445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9c00/0xb25dda4f4e92d8c5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92d8cc expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740178.398580:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98535180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8445:1877727021912448:0@lo:501: 00000100:00100000:3.0:1790740178.398684:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740178.398714:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5fed9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790740178.398730:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021912448 00000100:00100000:3.0:1790740178.398735:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021912448 00000100:00100000:3.0:1790740178.398799:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1790740178.398806:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:8445:x1877727021912448:12345-0@lo:501: 00000100:00100000:3.0:1790740178.398900:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:8445:x1877727021912448:12345-0@lo:501: Request processed in 95us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740178.398908:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1790740178.400291:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98535180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8445:1877727021912448:0@lo:501: 00000100:00100000:0.0:1790740178.400335:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82331880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8445:1877727021912576:0@lo:503: 00000100:00100000:0.0:1790740178.400400:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740178.400549:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc85697c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790740178.400660:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021912576 00000100:00100000:2.0:1790740178.400667:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021912576 00000100:00100000:2.0:1790740178.400702:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1790740178.400709:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:8445:x1877727021912576:12345-0@lo:503: 00000100:00100000:2.0:1790740178.400819:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:8445:x1877727021912576:12345-0@lo:503: Request processed in 109us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740178.400826:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1790740178.400901:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82331880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8445:1877727021912576:0@lo:503: 00000040:00080000:0.0:1790740178.401165:0:8445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790740178.401243:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82331880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8445:1877727021912704:0@lo:502: 00000100:00100000:0.0:1790740178.401277:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740178.401295:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc85697c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790740178.401345:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021912704 00000100:00100000:3.0:1790740178.401349:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021912704 00000100:00100000:3.0:1790740178.401372:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1790740178.401380:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:8445:x1877727021912704:12345-0@lo:502: 00000100:00100000:3.0:1790740178.401469:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:8445:x1877727021912704:12345-0@lo:502: Request processed in 89us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740178.401476:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790740178.401560:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82331880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8445:1877727021912704:0@lo:502: 00000040:00080000:0.0:1790740178.401838:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1790740178.401866:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1790740178.401886:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82331880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8445:1877727021912832:0@lo:502: 00000100:00100000:0.0:1790740178.401919:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740178.401953:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc85697c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790740178.402017:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021912832 00000100:00100000:2.0:1790740178.402027:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021912832 00000100:00100000:2.0:1790740178.402072:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1790740178.402078:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:8445:x1877727021912832:12345-0@lo:502: 00000100:00100000:2.0:1790740178.402151:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:8445:x1877727021912832:12345-0@lo:502: Request processed in 71us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740178.402158:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1790740178.402262:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82331880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8445:1877727021912832:0@lo:502: 00000040:00080000:0.0:1790740178.402297:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1790740178.402305:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1790740178.402891:0:8472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790740178.402901:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740178.402904:0:8472:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790740178.402911:0:8472:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98dcaedda800 00000020:00000080:1.0:1790740178.402913:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790740178.402925:0:8472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790740178.402928:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740178.402929:0:8472:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1790740178.402932:0:8472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1790740178.403317:0:8445:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1790740178.403339:0:8445:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790740178.403361:0:8445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9c00/0xb25dda4f4e92d8c5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d8cc expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.403373:0:8445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9c00/0xb25dda4f4e92d8c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d8cc expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740178.403418:0:8445:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1790740178.403421:0:8445:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98dcaedda800 10000000:01000000:0.0:1790740178.403424:0:8445:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98dcaedda800 10000000:01000000:0.0:1790740178.403436:0:8445:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790740178.403442:0:8445:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98dcaedda800 from 1 10000000:01000000:0.0:1790740178.403445:0:8445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790740178.403472:0:8445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2200/0xb25dda4f4e92d8d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.403481:0:8445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2200/0xb25dda4f4e92d8d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.403491:0:8445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2200/0xb25dda4f4e92d8d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740178.403507:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82331880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8445:1877727021912960:0@lo:101: 00000100:00100000:0.0:1790740178.403550:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740178.403590:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc85697840 going to sleep for 11 seconds 00000100:00100000:3.0:1790740178.403735:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021912960 00000100:00100000:3.0:1790740178.403743:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021912960 00000100:00100000:3.0:1790740178.403787:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1790740178.403802:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:8445:x1877727021912960:12345-0@lo:101: 00010000:00010000:3.0:1790740178.403814:0:6528:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740178.403827:0:6528:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcb5dc8200/0xb25dda4f4e92d8da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92d8d3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740178.403849:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcb5dc8200/0xb25dda4f4e92d8da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92d8d3 expref: 16 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740178.403859:0:6528:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcb5dc8200/0xb25dda4f4e92d8da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d8d3 expref: 16 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740178.403866:0:6528:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc8200, rc 0) 00000100:00100000:3.0:1790740178.403914:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:8445:x1877727021912960:12345-0@lo:101: Request processed in 113us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740178.403921:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1790740178.404012:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82331880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8445:1877727021912960:0@lo:101: 00010000:00010000:1.0:1790740178.404025:0:8445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2200/0xb25dda4f4e92d8d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d8da expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740178.404057:0:8445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2200/0xb25dda4f4e92d8d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92d8da expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740178.404124:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8445:1877727021913088:0@lo:501: 00000100:00100000:1.0:1790740178.404151:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740178.404196:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5fbf480 going to sleep for 11 seconds 00000100:00100000:0.0:1790740178.404252:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021913088 00000100:00100000:0.0:1790740178.404256:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021913088 00000100:00100000:0.0:1790740178.404286:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1790740178.404293:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:8445:x1877727021913088:12345-0@lo:501: 00000100:00100000:0.0:1790740178.404384:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:8445:x1877727021913088:12345-0@lo:501: Request processed in 91us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740178.404390:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1790740178.404456:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8445:1877727021913088:0@lo:501: 00000100:00100000:1.0:1790740178.404480:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8445:1877727021913216:0@lo:503: 00000100:00100000:1.0:1790740178.404518:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740178.404545:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5fbf480 going to sleep for 11 seconds 00000100:00100000:3.0:1790740178.404595:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021913216 00000100:00100000:3.0:1790740178.404600:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021913216 00000100:00100000:3.0:1790740178.404695:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1790740178.404703:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:8445:x1877727021913216:12345-0@lo:503: 00000100:00100000:3.0:1790740178.404777:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:8445:x1877727021913216:12345-0@lo:503: Request processed in 74us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740178.404783:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1790740178.404862:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8445:1877727021913216:0@lo:503: 00000040:00080000:1.0:1790740178.405101:0:8445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790740178.405152:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8445:1877727021913344:0@lo:502: 00000100:00100000:1.0:1790740178.405199:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740178.405221:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc9853a840 going to sleep for 11 seconds 00000100:00100000:0.0:1790740178.405280:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021913344 00000100:00100000:0.0:1790740178.405284:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021913344 00000100:00100000:0.0:1790740178.405313:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1790740178.405320:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:8445:x1877727021913344:12345-0@lo:502: 00000100:00100000:0.0:1790740178.405389:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:8445:x1877727021913344:12345-0@lo:502: Request processed in 69us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740178.405396:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1790740178.405503:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8445:1877727021913344:0@lo:502: 00000040:00080000:1.0:1790740178.405735:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1790740178.405762:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1790740178.405779:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1790740178.405793:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1790740178.405805:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1790740178.405818:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1790740178.405832:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1790740178.405845:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1790740178.405858:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1790740178.405871:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1790740178.405884:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1790740178.405897:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1790740178.405910:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1790740178.405923:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1790740178.405937:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1790740178.405951:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1790740178.405965:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1790740178.405989:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1790740178.406012:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1790740178.406026:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1790740178.406076:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1790740178.406090:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1790740178.406102:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1790740178.406115:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1790740178.406128:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1790740178.406140:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1790740178.406152:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1790740178.406163:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1790740178.406186:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1790740178.406202:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1790740178.406216:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1790740178.406229:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1790740178.406242:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1790740178.406265:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1790740178.406279:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1790740178.406292:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1790740178.406305:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:1.0:1790740178.406329:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8445:1877727021913472:0@lo:502: 00000100:00100000:1.0:1790740178.406370:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740178.406402:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc9853a840 going to sleep for 11 seconds 00000100:00100000:0.0:1790740178.406467:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021913472 00000100:00100000:0.0:1790740178.406473:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021913472 00000100:00100000:0.0:1790740178.406509:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1790740178.406516:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:8445:x1877727021913472:12345-0@lo:502: 00000100:00100000:0.0:1790740178.406667:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:8445:x1877727021913472:12345-0@lo:502: Request processed in 87us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740178.406675:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1790740178.407200:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8445:1877727021913472:0@lo:502: 00000040:00080000:1.0:1790740178.407256:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1790740178.407267:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1790740178.407816:0:8473:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1790740178.407833:0:8473:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff98dcbc23b380) 00000020:00000080:2.0:1790740178.407854:0:8473:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1790740178.407942:0:8473:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98dcaedda800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1790740178.407946:0:8473:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98dcaedda800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1790740178.407949:0:8473:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98dcaedda800 3 00010000:00080000:2.0:1790740178.407976:0:8473:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98db829b5800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.103@tcp at head 00010000:00010000:0.0:1790740178.410293:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740178.411114:0:8473:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:2.0:1790740178.411334:0:8473:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1790740178.411376:0:8473:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790740178.411390:0:8473:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xb25dda4f4e92d8e8 00000100:00080000:2.0:1790740178.411401:0:8473:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790740178.411414:0:8473:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98db829b5800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:2.0:1790740178.411452:0:8473:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98dcb8139500 x1877727021913600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790740178.413154:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb8139500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1877727021913600:0@lo:38: 00000100:00100000:3.0:1790740178.413237:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740178.413337:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021913600 00000100:00100000:0.0:1790740178.413346:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021913600 00000100:00100000:0.0:1790740178.413389:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790740178.413398:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc98535f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1877727021913600:12345-0@lo:38: 00010000:00080000:0.0:1790740178.413424:0:6535:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 249 last 0 00000020:00000080:0.0:1790740178.413471:0:6535:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xb25dda4f4e92d8ef 00000004:00100000:0.0:1790740178.413487:0:6535:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790740178.413519:0:6535:0:(import.c:65:import_set_state_nolock()) ffff98dcb5f99800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790740178.413570:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc98535f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1877727021913600:12345-0@lo:38: Request processed in 171us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740178.413577:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1790740178.413693:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98dcb8139500 x1877727021913600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790740188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740178.413704:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790740178.413711:0:3637:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1790740178.413719:0:3637:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1790740178.413723:0:3637:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790740178.413726:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98db829b5800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790740178.413732:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb8139500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1877727021913600:0@lo:38: 00000100:00080000:2.0:1790740178.413827:0:8473:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1790740178.413985:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98534e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877727021913984:0@lo:400: 00000100:00100000:3.0:1790740178.414017:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740178.414058:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790740178.414063:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98535500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727021913856:0@lo:400: 00000100:00100000:3.0:1790740178.414096:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740178.414187:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98537480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021914112:0@lo:400: 00000100:00100000:0.0:1790740178.414213:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740178.414229:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790740178.414233:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98535880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877727021913728:0@lo:400: 00000100:00100000:0.0:1790740178.414254:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740178.414281:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021913984 00000100:00100000:0.0:1790740178.414285:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021913984 00000100:00100000:0.0:1790740178.414313:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021913728 00000100:00100000:0.0:1790740178.414316:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021913728 00000100:00100000:0.0:1790740178.414334:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790740178.414341:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc98536680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877727021913984:12345-0@lo:400: 00000100:00100000:0.0:1790740178.414382:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc98536680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877727021913984:12345-0@lo:400: Request processed in 42us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740178.414389:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790740178.414404:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790740178.414410:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877727021913728:12345-0@lo:400: 00000100:00100000:0.0:1790740178.414441:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877727021913728:12345-0@lo:400: Request processed in 31us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740178.414447:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790740178.414463:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021913856 00000100:00100000:0.0:1790740178.414466:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021913856 00000100:00100000:0.0:1790740178.414487:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021914112 00000100:00100000:0.0:1790740178.414490:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021914112 00000100:00100000:0.0:1790740178.414504:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790740178.414510:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc98536300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727021913856:12345-0@lo:400: 00000100:00100000:0.0:1790740178.414541:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc98536300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727021913856:12345-0@lo:400: Request processed in 31us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740178.414556:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790740178.414568:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790740178.414574:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82330700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021914112:12345-0@lo:400: 00000100:00100000:0.0:1790740178.415578:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82330700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021914112:12345-0@lo:400: Request processed in 1000us (1360us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740178.415587:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1790740178.415766:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98dc98535880 x1877727021913728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740178.415779:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98535880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877727021913728:0@lo:400: 00000100:00100000:0.0:1790740178.415791:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98537480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021914112:0@lo:400: 00000100:00100000:0.0:1790740178.415825:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98535500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727021913856:0@lo:400: 00010000:00080000:0.0:1790740178.415834:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98dc98534e00 x1877727021913984/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740178.415842:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98534e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877727021913984:0@lo:400: 00000020:01000004:1.0:1790740178.424884:0:8473:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1790740178.424906:0:8473:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff98dcb81db380) 00000020:00000080:1.0:1790740178.424934:0:8473:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:1.0:1790740178.425061:0:8473:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98dcaedda800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1790740178.425066:0:8473:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98dcaedda800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1790740178.425069:0:8473:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98dcaedda800 3 00010000:00080000:1.0:1790740178.425110:0:8473:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98dcaed01800@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.103@tcp at head 00010000:00010000:1.0:1790740178.427247:0:8473:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:1.0:1790740178.427456:0:8473:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1790740178.432298:0:8473:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790740178.432323:0:8473:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xb25dda4f4e92d8fd 00000100:00080000:1.0:1790740178.432335:0:8473:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790740178.432347:0:8473:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff98dcaed01800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:1.0:1790740178.432387:0:8473:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98dcb5f6ce00 x1877727021914240/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790740178.432458:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1877727021914240:0@lo:38: 00000100:00100000:0.0:1790740178.432528:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740178.432615:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021914240 00000100:00100000:2.0:1790740178.432624:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021914240 00000100:00100000:2.0:1790740178.432664:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790740178.432671:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82333480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3637:x1877727021914240:12345-0@lo:38: 00010000:00080000:2.0:1790740178.432702:0:7760:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 249 last 0 00000020:00000080:2.0:1790740178.432735:0:7760:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xb25dda4f4e92d904 00000004:00100000:2.0:1790740178.432763:0:7760:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790740178.432797:0:7760:0:(import.c:65:import_set_state_nolock()) ffff98db829b4000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1790740178.437433:0:8473:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1790740178.443911:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82333480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1877727021914240:12345-0@lo:38: Request processed in 11226us (11370us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740178.443929:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:1.0:1790740178.444736:0:8473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1790740178.444799:0:8445:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1790740178.444826:0:8445:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790740178.444844:0:8445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2200/0xb25dda4f4e92d8d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d8da expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740178.444856:0:8445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2200/0xb25dda4f4e92d8d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d8da expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1790740178.444932:0:8445:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1790740178.444935:0:8445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790740178.444936:0:8445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790740178.444938:0:8445:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790740178.444939:0:8445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790740178.444940:0:8445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790740178.444942:0:8445:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790740178.444943:0:8445:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790740178.444945:0:8445:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790740178.444947:0:8445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790740178.444948:0:8445:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790740178.444953:0:8445:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1790740178.444956:0:8445:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790740178.444964:0:8445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790740178.444965:0:8445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790740178.444966:0:8445:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790740178.444966:0:8445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790740178.444968:0:8445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790740178.444969:0:8445:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790740178.444970:0:8445:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790740178.444970:0:8445:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790740178.444971:0:8445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790740178.444972:0:8445:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790740178.445003:0:8445:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1790740178.445024:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8445:1877727021914368:0@lo:253: 00000100:00100000:1.0:1790740178.445115:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740178.445162:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021914368 00000100:00100000:1.0:1790740178.445169:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021914368 00000100:00100000:1.0:1790740178.445219:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1790740178.445226:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:8445:x1877727021914368:12345-0@lo:253: 20000000:01000000:1.0:1790740178.445252:0:6528:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1790740178.445265:0:6528:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1790740178.445397:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc9853ab40 going to sleep for 11 seconds 00010000:00080000:0.0:1790740178.449120:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98dcb5f6ce00 x1877727021914240/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790740188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740178.449137:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790740178.449148:0:3637:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1790740178.449157:0:3637:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1790740178.449162:0:3637:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1790740178.449166:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98dcaed01800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790740178.449574:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1877727021914240:0@lo:38: 20000000:01000000:1.0:1790740178.450840:0:6528:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790740178.450877:0:6528:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1790740178.451251:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:8445:x1877727021914368:12345-0@lo:253: Request processed in 6020us (6131us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740178.451263:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 20000000:01000000:0.0:1790740178.451911:0:6551:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1790740178.451917:0:6551:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1790740178.451937:0:6551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98dcaeee3000/0xb25dda4f4e92d90b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.451953:0:6551:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dc80030400/0xb25dda4f4e92d801 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d7fa expref: 15 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.451960:0:6551:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dc80031800/0xb25dda4f4e92d81d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d816 expref: 15 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.451967:0:6551:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98dcaeee3000/0xb25dda4f4e92d90b lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.452004:0:6551:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dc80031800/0xb25dda4f4e92d81d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92d816 expref: 15 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.452019:0:6551:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98dc80031800/0xb25dda4f4e92d81d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92d816 expref: 15 pid: 6529 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740178.452222:0:6551:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82331c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6551:1877727021914496:0@lo:104: 00000100:00100000:0.0:1790740178.452272:0:6551:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790740178.452358:0:6551:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dc80030400/0xb25dda4f4e92d801 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92d7fa expref: 15 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.452367:0:6551:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98dc80030400/0xb25dda4f4e92d801 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92d7fa expref: 15 pid: 6530 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740178.452375:0:6551:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82332a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6551:1877727021914624:0@lo:104: 00000100:00100000:0.0:1790740178.452409:0:6551:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc85697cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740178.452504:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8445:1877727021914368:0@lo:253: 10000000:01000000:2.0:1790740178.452516:0:8445:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1790740178.452520:0:8445:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790740178.452522:0:8445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790740178.452524:0:8445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790740178.452525:0:8445:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790740178.452526:0:8445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790740178.452527:0:8445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790740178.452529:0:8445:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790740178.452530:0:8445:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790740178.452532:0:8445:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790740178.452534:0:8445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790740178.452535:0:8445:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790740178.452549:0:8445:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1790740178.456868:0:6518:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1790740178.456916:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740178.456968:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021914496 00000100:00100000:1.0:1790740178.456977:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021914496 00000100:00100000:1.0:1790740178.457052:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021914624 00000100:00100000:1.0:1790740178.457057:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021914624 00000100:00100000:1.0:1790740178.457076:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790740178.457085:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaef4b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+4:6551:x1877727021914496:12345-0@lo:104: 00010000:00010000:1.0:1790740178.457117:0:6518:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9200/0xb25dda4f4e92d816 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d81d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740178.457364:0:6518:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790740178.457371:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaef4b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+4:6551:x1877727021914496:12345-0@lo:104: Request processed in 288us (5098us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740178.457378:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790740178.457424:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790740178.457430:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5f6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+3:6551:x1877727021914624:12345-0@lo:104: 00010000:00010000:1.0:1790740178.457439:0:6518:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff98dca1968a00/0xb25dda4f4e92d7fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d801 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740178.457473:0:6518:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790740178.457479:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5f6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+3:6551:x1877727021914624:12345-0@lo:104: Request processed in 50us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740178.457484:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1790740178.457505:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790740178.457511:0:6523:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9200/0xb25dda4f4e92d816 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d81d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740178.457518:0:6523:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc9200 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:1.0:1790740178.457523:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9200/0xb25dda4f4e92d816 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92d81d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740178.457532:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9200/0xb25dda4f4e92d816 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92d81d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790740178.457539:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9200/0xb25dda4f4e92d816 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92d81d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740178.457552:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790740178.457590:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9200/0xb25dda4f4e92d816 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d81d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740178.457596:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790740178.457629:0:6523:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9200/0xb25dda4f4e92d816 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d81d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740178.457636:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9200/0xb25dda4f4e92d816 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d81d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740178.457650:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790740178.457653:0:6523:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dca1968a00/0xb25dda4f4e92d7fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d801 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740178.457658:0:6523:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dca1968a00 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:1.0:1790740178.457661:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dca1968a00/0xb25dda4f4e92d7fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92d801 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740178.457667:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dca1968a00/0xb25dda4f4e92d7fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92d801 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790740178.457672:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dca1968a00/0xb25dda4f4e92d7fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92d801 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740178.457677:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790740178.457689:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dca1968a00/0xb25dda4f4e92d7fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d801 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740178.457695:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790740178.457716:0:6523:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dca1968a00/0xb25dda4f4e92d7fa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d801 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740178.457722:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dca1968a00/0xb25dda4f4e92d7fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d801 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740178.457738:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740178.457740:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740178.457742:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740178.457748:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740178.457770:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3641:1877727021914752:0@lo:103: 00000100:00100000:1.0:1790740178.457805:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740178.457854:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727021914880:0@lo:103: 00000100:00100000:1.0:1790740178.457876:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740178.457907:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021914752 00000100:00100000:1.0:1790740178.457912:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021914752 00010000:00010000:1.0:1790740178.457931:0:6521:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dc80031800/0xb25dda4f4e92d81d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d816 expref: 16 pid: 6529 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740178.457952:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021914880 00000100:00100000:1.0:1790740178.457955:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021914880 00010000:00010000:1.0:1790740178.457964:0:6521:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dc80030400/0xb25dda4f4e92d801 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d7fa expref: 17 pid: 6530 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740178.457974:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790740178.457979:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5f6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:3641:x1877727021914752:12345-0@lo:103: 00010000:00010000:1.0:1790740178.457989:0:6521:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740178.457995:0:6521:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dc80031800/0xb25dda4f4e92d81d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d816 expref: 17 pid: 6529 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740178.458016:0:6521:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dc80031800/0xb25dda4f4e92d81d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92d816 expref: 17 pid: 6529 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740178.458062:0:6521:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740178.458091:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5f6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:3641:x1877727021914752:12345-0@lo:103: Request processed in 111us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740178.458097:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790740178.458109:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790740178.458115:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5f6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:3638:x1877727021914880:12345-0@lo:103: 00010000:00010000:1.0:1790740178.458121:0:6521:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740178.458125:0:6521:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dc80030400/0xb25dda4f4e92d801 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d7fa expref: 16 pid: 6530 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740178.458133:0:6521:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dc80030400/0xb25dda4f4e92d801 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92d7fa expref: 16 pid: 6530 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740178.458144:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98dcaeee3000/0xb25dda4f4e92d90b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740178.458152:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcaeee3000/0xb25dda4f4e92d90b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790740178.458167:0:6521:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009541360s 00010000:00010000:1.0:1790740178.458171:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98dcaeee3000/0xb25dda4f4e92d90b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740178.458189:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98dcaeee3000/0xb25dda4f4e92d90b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740178.458195:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98dcaeee3000/0xb25dda4f4e92d90b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740178.458209:0:6521:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98dcaeee3000/0xb25dda4f4e92d90b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740178.458214:0:6521:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee3000 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:1.0:1790740178.458218:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98dcaeee3000/0xb25dda4f4e92d90b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740178.458225:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98dcaeee3000/0xb25dda4f4e92d90b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740178.458234:0:6521:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98dcaeee3000/0xb25dda4f4e92d90b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740178.458245:0:6521:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740178.458289:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5f6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:3638:x1877727021914880:12345-0@lo:103: Request processed in 174us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740178.458295:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790740178.458406:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727021914880:0@lo:103: 00000100:00100000:1.0:1790740178.458432:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3641:1877727021914752:0@lo:103: 00010000:00010000:0.0:1790740178.458520:0:6551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dc80031800/0xb25dda4f4e92d81d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92d816 expref: 15 pid: 6529 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740178.458530:0:6551:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82331c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6551:1877727021914496:0@lo:104: 00010000:00010000:0.0:1790740178.458539:0:6551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dc80030400/0xb25dda4f4e92d801 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92d7fa expref: 14 pid: 6530 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740178.458546:0:6551:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82332a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6551:1877727021914624:0@lo:104: 00010000:00010000:0.0:1790740178.458560:0:6551:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98dcaeee3000/0xb25dda4f4e92d90b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.458567:0:6551:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98dcaeee3000/0xb25dda4f4e92d90b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.458573:0:6551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98dcaeee3000/0xb25dda4f4e92d90b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740178.458578:0:6551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcaeee3000/0xb25dda4f4e92d90b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1790740178.460737:0:8445:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1790740178.460898:0:8445:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1790740178.461125:0:8445:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1790740178.461291:0:8445:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1790740178.461515:0:8445:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1790740178.461743:0:8445:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1790740178.465410:0:8445:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1790740178.474803:0:8445:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1790740178.474887:0:8445:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1790740178.474927:0:8445:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1790740178.474973:0:8445:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.103@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1790740178.474998:0:8445:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1790740178.475019:0:8445:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1790740178.475988:0:8445:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790740178.476467:0:8445:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:1.0:1790740178.545804:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790740178.545839:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021915008:0@lo:41: 00000100:00100000:1.0:1790740178.545908:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740178.545980:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021915008 00000100:00100000:1.0:1790740178.545990:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021915008 00000100:00100000:1.0:1790740178.546062:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790740178.546072:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021915008:12345-0@lo:41: 00000004:00000024:1.0:1790740178.546109:0:7846:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1790740178.546164:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021915008:12345-0@lo:41: Request processed in 93us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740178.546185:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790740178.546239:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021915008:0@lo:41: 00000020:00000004:3.0:1790740179.438815:0:8529:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790740179.439085:0:8529:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1790740179.444692:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740180.475964:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740180.589233:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021915136:0@lo:41: 00000100:00100000:1.0:1790740180.589302:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740180.590816:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021915136 00000100:00100000:0.0:1790740180.590827:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021915136 00000100:00100000:0.0:1790740180.590876:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790740180.590885:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021915136:12345-0@lo:41: 00000004:00000024:0.0:1790740180.591021:0:6541:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:0.0:1790740180.591260:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021915136:12345-0@lo:41: Request processed in 375us (1956us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740180.591267:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790740180.591321:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021915136:0@lo:41: 10000000:01000000:2.0:1790740180.915428:0:6532:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1790740180.915436:0:6532:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98dca0cb4800 from 30 10000000:01000000:2.0:1790740180.915440:0:6532:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790740180.915492:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dc81489a00/0xb25dda4f4e92d912 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740180.915504:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dc81489a00/0xb25dda4f4e92d912 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740180.915515:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dc81489a00/0xb25dda4f4e92d912 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740180.915537:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb8139f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021915264:0@lo:101: 00000100:00100000:2.0:1790740180.915623:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740180.915670:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5deb840 going to sleep for 11 seconds 00000100:00100000:2.0:1790740180.915691:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021915264 00000100:00100000:2.0:1790740180.915697:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021915264 00000100:00100000:2.0:1790740180.915756:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790740180.915764:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+14:6532:x1877727021915264:12345-0@lo:101: 00010000:00010000:2.0:1790740180.915777:0:6529:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740180.915789:0:6529:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dc81489000/0xb25dda4f4e92d919 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92d912 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740180.915811:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dc81489000/0xb25dda4f4e92d919 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92d912 expref: 15 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740180.915821:0:6529:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dc81489000/0xb25dda4f4e92d919 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d912 expref: 15 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740180.915830:0:6529:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dc81489000, rc 0) 00000100:00100000:2.0:1790740180.915863:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:6532:x1877727021915264:12345-0@lo:101: Request processed in 100us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740180.915869:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790740180.915906:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb8139f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021915264:0@lo:101: 00010000:00010000:2.0:1790740180.915919:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dc81489a00/0xb25dda4f4e92d912 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d919 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740180.915928:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dc81489a00/0xb25dda4f4e92d912 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92d919 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740180.915992:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb8139f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021915392:0@lo:501: 00000100:00100000:2.0:1790740180.916025:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740180.916062:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5deb840 going to sleep for 11 seconds 00000100:00100000:1.0:1790740180.916281:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021915392 00000100:00100000:1.0:1790740180.916286:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021915392 00000100:00100000:1.0:1790740180.916315:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1790740180.916322:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:6532:x1877727021915392:12345-0@lo:501: 00000100:00100000:1.0:1790740180.916439:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:6532:x1877727021915392:12345-0@lo:501: Request processed in 118us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740180.916445:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1790740180.916514:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb8139f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021915392:0@lo:501: 00000100:00100000:2.0:1790740180.916541:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb8139f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021915520:0@lo:503: 00000100:00100000:2.0:1790740180.916580:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740180.916602:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5deb840 going to sleep for 11 seconds 00000100:00100000:0.0:1790740180.917141:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021915520 00000100:00100000:0.0:1790740180.917147:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021915520 00000100:00100000:0.0:1790740180.917179:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1790740180.917185:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:6532:x1877727021915520:12345-0@lo:503: 00000100:00100000:0.0:1790740180.917484:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:6532:x1877727021915520:12345-0@lo:503: Request processed in 298us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740180.917490:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1790740180.918630:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb8139f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021915520:0@lo:503: 00000100:00100000:3.0:1790740180.924900:0:8600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98534e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8600:1877727021915648:0@lo:502: 00000100:00100000:3.0:1790740180.925006:0:8600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740180.925071:0:8600:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc985dae40 going to sleep for 11 seconds 00000100:00100000:2.0:1790740180.925368:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021915648 00000100:00100000:2.0:1790740180.925376:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021915648 00000100:00100000:2.0:1790740180.925421:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1790740180.925430:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:8600:x1877727021915648:12345-0@lo:502: 00000100:00100000:2.0:1790740180.925556:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:8600:x1877727021915648:12345-0@lo:502: Request processed in 127us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740180.925563:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1790740180.925686:0:8600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98534e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8600:1877727021915648:0@lo:502: 00000100:00100000:3.0:1790740180.925803:0:8600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98534e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8600:1877727021915776:0@lo:502: 00000100:00100000:3.0:1790740180.925841:0:8600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740180.925874:0:8600:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc985dae40 going to sleep for 11 seconds 00000100:00100000:2.0:1790740180.927307:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021915776 00000100:00100000:2.0:1790740180.927320:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021915776 00000100:00100000:2.0:1790740180.927373:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1790740180.927382:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:8600:x1877727021915776:12345-0@lo:502: 00000100:00100000:2.0:1790740180.927537:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:8600:x1877727021915776:12345-0@lo:502: Request processed in 156us (1694us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740180.927545:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1790740180.927669:0:8600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98534e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8600:1877727021915776:0@lo:502: 00000040:00080000:0.0:1790740180.927700:0:8600:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1790740180.927926:0:6532:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1790740180.927950:0:6532:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790740180.927962:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dc81489a00/0xb25dda4f4e92d912 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d919 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740180.928195:0:6532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dc81489a00/0xb25dda4f4e92d912 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d919 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740180.928205:0:6532:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790740180.928208:0:6532:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98dca0cb4800 from 5 10000000:01000000:2.0:1790740180.928211:0:6532:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790740180.928244:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dc81489e00/0xb25dda4f4e92d920 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740180.928253:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dc81489e00/0xb25dda4f4e92d920 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740180.928262:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dc81489e00/0xb25dda4f4e92d920 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740180.928279:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb8139f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021915904:0@lo:101: 00000100:00100000:2.0:1790740180.928318:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740180.928388:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5deb240 going to sleep for 11 seconds 00000100:00100000:0.0:1790740180.928479:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021915904 00000100:00100000:0.0:1790740180.928485:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021915904 00000100:00100000:0.0:1790740180.928552:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1790740180.928561:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:6532:x1877727021915904:12345-0@lo:101: 00010000:00010000:0.0:1790740180.928572:0:6530:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740180.928585:0:6530:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcaeee3400/0xb25dda4f4e92d927 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92d920 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740180.928607:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcaeee3400/0xb25dda4f4e92d927 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92d920 expref: 16 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740180.928616:0:6530:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcaeee3400/0xb25dda4f4e92d927 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d920 expref: 16 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740180.928624:0:6530:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaeee3400, rc 0) 00000100:00100000:0.0:1790740180.928666:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:6532:x1877727021915904:12345-0@lo:101: Request processed in 107us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740180.928672:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1790740180.928751:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb8139f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021915904:0@lo:101: 00010000:00010000:3.0:1790740180.928764:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dc81489e00/0xb25dda4f4e92d920 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d927 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740180.928773:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dc81489e00/0xb25dda4f4e92d920 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92d927 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740180.928817:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98535500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021916032:0@lo:256: 00000100:00100000:3.0:1790740180.928849:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740180.932295:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc985da540 going to sleep for 11 seconds 00000100:00100000:2.0:1790740180.936791:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021916032 00000100:00100000:2.0:1790740180.936808:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021916032 00000100:00100000:2.0:1790740180.936875:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1790740180.936885:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:6532:x1877727021916032:12345-0@lo:256: 20000000:01000000:2.0:1790740180.936914:0:6528:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790740180.936940:0:6528:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790740180.936943:0:6528:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1790740180.939897:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:6532:x1877727021916032:12345-0@lo:256: Request processed in 3007us (11040us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740180.939913:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1790740180.940500:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98535500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021916032:0@lo:256: 10000000:01000000:1.0:1790740180.940574:0:6532:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790740180.940585:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dc81489e00/0xb25dda4f4e92d920 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d927 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740180.940608:0:6532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dc81489e00/0xb25dda4f4e92d920 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d927 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740180.940618:0:6532:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1790740180.940620:0:6532:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:1.0:1790740180.940623:0:6532:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1790740180.940658:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dca1968a00/0xb25dda4f4e92d92e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740180.940667:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dca1968a00/0xb25dda4f4e92d92e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740180.940676:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dca1968a00/0xb25dda4f4e92d92e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740180.940696:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021916160:0@lo:101: 00000100:00100000:1.0:1790740180.940750:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740180.940789:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc897fbb40 going to sleep for 11 seconds 00000100:00100000:2.0:1790740180.940911:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021916160 00000100:00100000:2.0:1790740180.940918:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021916160 00000100:00100000:2.0:1790740180.940956:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1790740180.940965:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:6532:x1877727021916160:12345-0@lo:101: 00010000:00010000:2.0:1790740180.940990:0:6528:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740180.941007:0:6528:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dc81488200/0xb25dda4f4e92d935 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92d92e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740180.941059:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dc81488200/0xb25dda4f4e92d935 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92d92e expref: 17 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740180.941071:0:6528:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dc81488200/0xb25dda4f4e92d935 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d92e expref: 17 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740180.941080:0:6528:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dc81488200, rc 0) 00000100:00100000:2.0:1790740180.941117:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:6532:x1877727021916160:12345-0@lo:101: Request processed in 153us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740180.941123:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790740180.941747:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021916160:0@lo:101: 00010000:00010000:1.0:1790740180.941766:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dca1968a00/0xb25dda4f4e92d92e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d935 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740180.941775:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dca1968a00/0xb25dda4f4e92d92e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92d935 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740180.941842:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021916288:0@lo:501: 00000100:00100000:1.0:1790740180.941877:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740180.941915:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc897fbb40 going to sleep for 11 seconds 00000100:00100000:0.0:1790740180.942118:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021916288 00000100:00100000:0.0:1790740180.942124:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021916288 00000100:00100000:0.0:1790740180.942167:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1790740180.942174:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:6532:x1877727021916288:12345-0@lo:501: 00000100:00100000:0.0:1790740180.942311:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:6532:x1877727021916288:12345-0@lo:501: Request processed in 137us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740180.942319:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1790740180.942380:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021916288:0@lo:501: 00000100:00100000:0.0:1790740180.942409:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82332a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021916416:0@lo:503: 00000100:00100000:0.0:1790740180.942449:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740180.942462:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5f76a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790740180.942474:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021916416 00000100:00100000:0.0:1790740180.942476:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021916416 00000100:00100000:0.0:1790740180.942492:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1790740180.942498:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:6532:x1877727021916416:12345-0@lo:503: 00000100:00100000:0.0:1790740180.942572:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:6532:x1877727021916416:12345-0@lo:503: Request processed in 73us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740180.942578:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1790740180.942617:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82332a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021916416:0@lo:503: 00000100:00100000:0.0:1790740180.942817:0:8602:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82332a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8602:1877727021916544:0@lo:502: 00000100:00100000:0.0:1790740180.942850:0:8602:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740180.942868:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021916544 00000100:00100000:0.0:1790740180.942871:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021916544 00000100:00100000:0.0:1790740180.942890:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1790740180.942896:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:8602:x1877727021916544:12345-0@lo:502: 00000100:00100000:0.0:1790740180.942964:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:8602:x1877727021916544:12345-0@lo:502: Request processed in 67us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740180.943324:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1790740180.943359:0:8602:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5f76f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790740180.943372:0:8602:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82332a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8602:1877727021916544:0@lo:502: 00000020:01000000:0.0:1790740180.943392:0:8602:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790740180.943402:0:8602:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1790740180.943410:0:8602:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740180.943412:0:8602:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1790740180.943417:0:8602:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1790740180.943421:0:8602:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.103@tcp to nid 0x20000c0a8cc67 (192.168.204.103@tcp) 00000020:01000000:0.0:1790740180.943441:0:8602:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1790740180.943444:0:8602:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790740180.943467:0:8602:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff98dcb6c6b380) 00000020:00000080:0.0:1790740180.943489:0:8602:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1790740180.943496:0:8602:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1790740180.943579:0:8602:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1790740180.943586:0:8602:0:(osd_handler.c:8931:osd_obd_connect()) connect #4 00000020:00000080:0.0:1790740180.943593:0:8602:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb25dda4f4e92d943 00010000:00080000:0.0:1790740180.943623:0:8602:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98dcbd56f000@lustre-OST0000-osc-MDT0001: add connection 192.168.204.103@tcp at head 00010000:00010000:0.0:1790740180.943861:0:8602:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1790740180.980643:0:8602:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1790740180.980666:0:8602:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1790740180.981080:0:8602:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790740180.981352:0:8602:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790740180.981444:0:8602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1790740180.981544:0:8602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1790740180.986310:0:8604:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790740180.986318:0:8604:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1790740180.987004:0:8602:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1790740180.987016:0:8602:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1790740180.987081:0:8602:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1790740180.987105:0:8602:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb25dda4f4e92d94a 00000100:00080000:1.0:1790740180.987116:0:8602:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790740180.987137:0:8602:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff98dcbd56f000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:1.0:1790740180.987173:0:8602:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98dcb5f6e680 x1877727021916672/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790740180.987195:0:8602:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1790740180.987254:0:8602:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790740180.987257:0:8602:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740180.987259:0:8602:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1790740180.987262:0:8602:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790740180.987266:0:8602:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740180.987267:0:8602:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790740180.987271:0:8602:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790740180.987273:0:8602:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1790740180.987300:0:8602:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8602:1877727021916800:0@lo:502: 00000100:00100000:1.0:1790740180.987375:0:8602:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740180.987416:0:8602:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc82e60240 going to sleep for 11 seconds 00000100:00100000:0.0:1790740180.987690:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877727021916672:0@lo:8: 00000100:00100000:0.0:1790740180.987729:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740180.987777:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021916800 00000100:00100000:0.0:1790740180.987784:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021916800 00000100:00100000:0.0:1790740180.987830:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1790740180.987839:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:8602:x1877727021916800:12345-0@lo:502: 00000100:00100000:0.0:1790740180.987948:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:8602:x1877727021916800:12345-0@lo:502: Request processed in 109us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740180.987964:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1790740180.988256:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021916672 00000100:00100000:2.0:1790740180.988260:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021916672 00000100:00100000:2.0:1790740180.988279:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790740180.988284:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82332a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1877727021916672:12345-0@lo:8: 00010000:00080000:2.0:1790740180.988304:0:8451:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 252 last 0 00000020:00000080:2.0:1790740180.988325:0:8451:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb25dda4f4e92d951 00002000:00100000:2.0:1790740180.988360:0:8451:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff98db829b1000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b03 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1790740180.988364:0:8451:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:2.0:1790740180.988369:0:8451:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1790740180.988426:0:8451:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1790740180.988684:0:8602:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8602:1877727021916800:0@lo:502: 00000020:01000000:1.0:1790740180.988722:0:8602:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790740180.988728:0:8602:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740180.988730:0:8602:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000100:00100000:0.0:1790740180.988836:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb8139180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877727021916928:0@lo:400: 00000100:00100000:0.0:1790740180.988875:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740180.988899:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb813bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1877727021917440:0@lo:400: 00000100:00100000:0.0:1790740180.988920:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740180.988939:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790740180.988944:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb8138a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021917312:0@lo:400: 00000100:00100000:0.0:1790740180.988968:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740180.989010:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021916928 00000100:00100000:0.0:1790740180.989015:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021916928 00000100:00100000:0.0:1790740180.989060:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021917440 00000100:00100000:0.0:1790740180.989063:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021917440 00000100:00100000:0.0:1790740180.989094:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790740180.989101:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82331c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877727021916928:12345-0@lo:400: 00000100:00100000:0.0:1790740180.989156:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82331c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877727021916928:12345-0@lo:400: Request processed in 55us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740180.989163:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790740180.989178:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790740180.989185:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82332300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1877727021917440:12345-0@lo:400: 00000100:00100000:0.0:1790740180.989213:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82332300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1877727021917440:12345-0@lo:400: Request processed in 29us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740180.989219:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790740180.989238:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021917312 00000100:00100000:0.0:1790740180.989241:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021917312 00000100:00100000:0.0:1790740180.989261:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790740180.989267:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82332680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021917312:12345-0@lo:400: 00000100:00100000:0.0:1790740180.989303:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82332680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021917312:12345-0@lo:400: Request processed in 37us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740180.989309:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790740180.989336:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb8138a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021917312:0@lo:400: 00010000:00080000:0.0:1790740180.989347:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98dcb8139180 x1877727021916928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740180.989356:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb8139180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877727021916928:0@lo:400: 00010000:00080000:0.0:1790740180.989364:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98dcb813bb80 x1877727021917440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740180.989371:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb813bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1877727021917440:0@lo:400: 00000040:00080000:1.0:1790740180.989429:0:8602:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:0.0:1790740180.989718:0:6532:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:0.0:1790740180.989821:0:6532:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1790740180.989832:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dca1968a00/0xb25dda4f4e92d92e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d935 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740180.989843:0:6532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dca1968a00/0xb25dda4f4e92d92e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d935 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740180.989854:0:6532:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1790740180.989857:0:6532:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98dc82d23800 from 30 10000000:01000000:0.0:1790740180.989861:0:6532:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790740180.989889:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3c00/0xb25dda4f4e92d958 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740180.989898:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3c00/0xb25dda4f4e92d958 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740180.989920:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3c00/0xb25dda4f4e92d958 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740180.989936:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82333100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021917696:0@lo:101: 00002000:00080000:2.0:1790740180.990217:0:8451:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1790740180.990244:0:8451:0:(import.c:65:import_set_state_nolock()) ffff98db829b3800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790740180.990298:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82332a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3637:x1877727021916672:12345-0@lo:8: Request processed in 2012us (2568us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740180.990306:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790740180.990337:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb8139f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021917056:0@lo:400: 00000100:00100000:2.0:1790740180.990364:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740180.990386:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb8138380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1877727021917568:0@lo:400: 00000100:00100000:2.0:1790740180.990409:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740180.990428:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790740180.990434:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb8139500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877727021917184:0@lo:400: 00000100:00100000:2.0:1790740180.990454:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740180.990482:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021917568 00000100:00100000:2.0:1790740180.990487:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021917568 00000100:00100000:2.0:1790740180.990519:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021917184 00000100:00100000:2.0:1790740180.990522:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021917184 00000100:00100000:2.0:1790740180.990538:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790740180.990545:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb813b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877727021917568:12345-0@lo:400: 00000100:00100000:0.0:1790740180.990656:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740180.990677:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5f76000 going to sleep for 11 seconds 00010000:00080000:1.0:1790740180.990771:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98dcb5f6e680 x1877727021916672/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790740190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740180.990782:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790740180.990791:0:3637:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1790740180.990800:0:3637:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1790740180.990804:0:3637:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1790740180.990807:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98dcbd56f000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1790740180.990828:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1790740180.990834:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877727021916672:0@lo:8: 00000004:00080000:1.0:1790740180.990861:0:8604:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1790740180.990925:0:8604:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 252276893434ns, next at 0ns, rc = 0 00080000:00080000:1.0:1790740180.990931:0:8604:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1790740180.991169:0:8605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82333800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8605:1877727021917824:0@lo:700: 00000100:00100000:0.0:1790740180.991201:0:8605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740180.991221:0:8605:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5f76600 going to sleep for 11 seconds 00000100:00080000:3.0:1790740180.991306:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790740180.991320:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790740180.992085:0:8460:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021917824 00000100:00100000:1.0:1790740180.992092:0:8460:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021917824 00000100:00100000:1.0:1790740180.992291:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790740180.992300:0:8460:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82333b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8605:x1877727021917824:12345-0@lo:700: 00000100:00100000:1.0:1790740180.992340:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6e680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8460:1877727021917952:0@lo:700: 00000100:00100000:1.0:1790740180.992389:0:8460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740180.992411:0:8460:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5fbf180 going to sleep for 11 seconds 00000100:00080000:0.0:1790740180.993142:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790740180.993264:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb813b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877727021917568:12345-0@lo:400: Request processed in 2716us (2850us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740180.993275:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790740180.993303:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790740180.993312:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb813bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877727021917184:12345-0@lo:400: 00000100:00100000:2.0:1790740180.993342:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb813bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877727021917184:12345-0@lo:400: Request processed in 33us (2886us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740180.993348:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790740180.993369:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021917056 00000100:00100000:2.0:1790740180.993384:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021917056 00000100:00100000:2.0:1790740180.993424:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790740180.993431:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb813aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021917056:12345-0@lo:400: 00000100:00100000:2.0:1790740180.993467:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb813aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021917056:12345-0@lo:400: Request processed in 37us (3101us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740180.993473:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790740180.994241:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021917952 00000100:00100000:3.0:1790740180.994248:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021917952 00000100:00100000:3.0:1790740180.994284:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790740180.994292:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5f6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8460:x1877727021917952:12345-0@lo:700: 00000100:00100000:3.0:1790740180.994426:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021917696 00000100:00100000:3.0:1790740180.994430:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021917696 00000100:00100000:3.0:1790740180.994463:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1790740180.994470:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:6532:x1877727021917696:12345-0@lo:101: 00010000:00010000:3.0:1790740180.994479:0:6528:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740180.994496:0:6528:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcb5dc8600/0xb25dda4f4e92d95f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92d958 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740180.994521:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcb5dc8600/0xb25dda4f4e92d95f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92d958 expref: 18 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740180.994533:0:6528:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcb5dc8600/0xb25dda4f4e92d95f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d958 expref: 18 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740180.994542:0:6528:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc8600, rc 0) 00000100:00100000:3.0:1790740180.994596:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+18:6532:x1877727021917696:12345-0@lo:101: Request processed in 126us (4624us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740180.994601:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1790740180.994649:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82333100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021917696:0@lo:101: 00010000:00010000:3.0:1790740180.994668:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3c00/0xb25dda4f4e92d958 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d95f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740180.994677:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3c00/0xb25dda4f4e92d958 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92d95f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740180.994758:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98537480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021918080:0@lo:501: 00000100:00100000:3.0:1790740180.994789:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740180.994819:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc985da540 going to sleep for 11 seconds 00000100:00100000:3.0:1790740180.994831:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021918080 00000100:00100000:3.0:1790740180.994835:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021918080 00000100:00100000:3.0:1790740180.994856:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1790740180.994862:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+18:6532:x1877727021918080:12345-0@lo:501: 00000100:00100000:3.0:1790740180.994995:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+18:6532:x1877727021918080:12345-0@lo:501: Request processed in 132us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740180.995002:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1790740180.995060:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98537480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021918080:0@lo:501: 00000100:00100000:3.0:1790740180.995088:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98537480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021918208:0@lo:503: 00000100:00100000:3.0:1790740180.995138:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740180.995158:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc985da540 going to sleep for 11 seconds 00000100:00100000:3.0:1790740180.995168:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021918208 00000100:00100000:3.0:1790740180.995171:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021918208 00000100:00100000:3.0:1790740180.995191:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1790740180.995196:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+18:6532:x1877727021918208:12345-0@lo:503: 00000100:00100000:3.0:1790740180.995265:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+18:6532:x1877727021918208:12345-0@lo:503: Request processed in 68us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740180.995271:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1790740180.995310:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98537480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021918208:0@lo:503: 00010000:00080000:1.0:1790740180.995720:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98dcb8139500 x1877727021917184/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740180.995745:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb8139500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877727021917184:0@lo:400: 00000100:00100000:1.0:1790740180.995759:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb8139f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021917056:0@lo:400: 00010000:00080000:1.0:1790740180.995785:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98dcb8138380 x1877727021917568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740180.995793:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb8138380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1877727021917568:0@lo:400: 00000100:00100000:1.0:1790740181.000091:0:8606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8606:1877727021918336:0@lo:502: 00000100:00100000:1.0:1790740181.000187:0:8606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740181.000239:0:8606:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc82e60240 going to sleep for 11 seconds 00000100:00100000:3.0:1790740181.000919:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021918336 00000100:00100000:3.0:1790740181.000928:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021918336 00000100:00100000:3.0:1790740181.001015:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1790740181.001024:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+18:8606:x1877727021918336:12345-0@lo:502: 00000100:00100000:3.0:1790740181.001188:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+18:8606:x1877727021918336:12345-0@lo:502: Request processed in 165us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740181.001195:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1790740181.002325:0:8606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8606:1877727021918336:0@lo:502: 00000100:00100000:1.0:1790740181.002399:0:8606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8606:1877727021918464:0@lo:502: 00000100:00100000:1.0:1790740181.002460:0:8606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740181.002490:0:8606:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc86a18540 going to sleep for 11 seconds 00000100:00100000:0.0:1790740181.003109:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021918464 00000100:00100000:0.0:1790740181.003118:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021918464 00000100:00100000:0.0:1790740181.003184:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1790740181.003195:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+18:8606:x1877727021918464:12345-0@lo:502: 00000100:00100000:0.0:1790740181.003330:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+18:8606:x1877727021918464:12345-0@lo:502: Request processed in 136us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740181.003337:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1790740181.003887:0:8606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8606:1877727021918464:0@lo:502: 00000040:00080000:1.0:1790740181.003921:0:8606:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1790740181.005053:0:6532:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1790740181.005081:0:6532:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790740181.005092:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3c00/0xb25dda4f4e92d958 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d95f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740181.005105:0:6532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3c00/0xb25dda4f4e92d958 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d95f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740181.005115:0:6532:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790740181.005117:0:6532:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98dc82d23800 from 5 10000000:01000000:3.0:1790740181.005120:0:6532:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790740181.005163:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9000/0xb25dda4f4e92d966 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740181.005172:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9000/0xb25dda4f4e92d966 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740181.005182:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9000/0xb25dda4f4e92d966 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740181.005236:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98537480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021918592:0@lo:101: 00000100:00100000:3.0:1790740181.005312:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740181.005348:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc985dae40 going to sleep for 11 seconds 00000100:00100000:3.0:1790740181.005366:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021918592 00000100:00100000:3.0:1790740181.005372:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021918592 00000100:00100000:3.0:1790740181.005419:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1790740181.005427:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+18:6532:x1877727021918592:12345-0@lo:101: 00010000:00010000:3.0:1790740181.005441:0:6528:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740181.005454:0:6528:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcb5dc9e00/0xb25dda4f4e92d96d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92d966 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740181.005475:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcb5dc9e00/0xb25dda4f4e92d96d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92d966 expref: 19 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740181.005485:0:6528:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcb5dc9e00/0xb25dda4f4e92d96d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d966 expref: 19 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740181.005494:0:6528:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc9e00, rc 0) 00000100:00100000:3.0:1790740181.005525:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+19:6532:x1877727021918592:12345-0@lo:101: Request processed in 99us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740181.005531:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 40000000:02000000:3.0:1790740181.005595:0:6542:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000004:00080000:1.0:1790740181.008013:0:7466:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:0.0:1790740181.008926:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98537480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021918592:0@lo:101: 00010000:00010000:0.0:1790740181.008955:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9000/0xb25dda4f4e92d966 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d96d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740181.008969:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9000/0xb25dda4f4e92d966 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92d96d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740181.009075:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82330380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021918720:0@lo:256: 00000100:00100000:0.0:1790740181.009148:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740181.009191:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5f76000 going to sleep for 11 seconds 00000100:00100000:0.0:1790740181.009220:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021918720 00000100:00100000:0.0:1790740181.009227:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021918720 00000100:00100000:0.0:1790740181.009271:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1790740181.009279:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+19:6532:x1877727021918720:12345-0@lo:256: 20000000:01000000:0.0:1790740181.009299:0:6529:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790740181.009314:0:6529:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790740181.009317:0:6529:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1790740181.009409:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+19:6532:x1877727021918720:12345-0@lo:256: Request processed in 129us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740181.009417:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1790740181.009442:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82330380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021918720:0@lo:256: 10000000:01000000:0.0:1790740181.009480:0:6532:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790740181.009487:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9000/0xb25dda4f4e92d966 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d96d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740181.009496:0:6532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9000/0xb25dda4f4e92d966 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d96d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740181.009504:0:6532:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1790740181.009506:0:6532:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1790740181.009509:0:6532:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1790740181.009529:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3200/0xb25dda4f4e92d974 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740181.009537:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3200/0xb25dda4f4e92d974 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740181.009546:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3200/0xb25dda4f4e92d974 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740181.009567:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82330380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021918848:0@lo:101: 00000100:00100000:0.0:1790740181.009593:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740181.009601:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc985dae40 going to sleep for 11 seconds 00000100:00100000:0.0:1790740181.009617:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021918848 00000100:00100000:0.0:1790740181.009621:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021918848 00000100:00100000:0.0:1790740181.009636:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1790740181.009641:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca1332050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+19:6532:x1877727021918848:12345-0@lo:101: 00010000:00010000:0.0:1790740181.009649:0:6529:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740181.009661:0:6529:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcaeee2800/0xb25dda4f4e92d97b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92d974 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740181.009677:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcaeee2800/0xb25dda4f4e92d97b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92d974 expref: 20 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740181.009686:0:6529:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcaeee2800/0xb25dda4f4e92d97b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d974 expref: 20 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740181.009695:0:6529:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaeee2800, rc 0) 00000100:00100000:0.0:1790740181.009721:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca1332050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+20:6532:x1877727021918848:12345-0@lo:101: Request processed in 79us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740181.009727:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1790740181.009934:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82330380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021918848:0@lo:101: 00010000:00010000:0.0:1790740181.009946:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3200/0xb25dda4f4e92d974 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d97b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740181.009954:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3200/0xb25dda4f4e92d974 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92d97b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740181.010154:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82330380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021918976:0@lo:501: 00000100:00100000:0.0:1790740181.010178:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740181.012504:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc985dae40 going to sleep for 11 seconds 00000100:00100000:0.0:1790740181.012542:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021918976 00000100:00100000:0.0:1790740181.012550:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021918976 00000100:00100000:1.0:1790740181.014250:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1790740181.014272:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca1333c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+20:6532:x1877727021918976:12345-0@lo:501: 00000100:00100000:1.0:1790740181.014542:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca1333c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+20:6532:x1877727021918976:12345-0@lo:501: Request processed in 279us (4361us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740181.014550:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1790740181.014769:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82330380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021918976:0@lo:501: 00000100:00100000:2.0:1790740181.014827:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb8139180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021919104:0@lo:503: 00000100:00100000:2.0:1790740181.014883:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740181.015198:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5deb000 going to sleep for 11 seconds 00000100:00100000:1.0:1790740181.015233:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021919104 00000100:00100000:1.0:1790740181.015240:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021919104 00000100:00100000:1.0:1790740181.015273:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1790740181.015278:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca1332850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+20:6532:x1877727021919104:12345-0@lo:503: 00000100:00100000:1.0:1790740181.015457:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca1332850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+20:6532:x1877727021919104:12345-0@lo:503: Request processed in 177us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740181.015473:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1790740181.015548:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb8139180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021919104:0@lo:503: 00000100:00100000:1.0:1790740181.015895:0:8609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8609:1877727021919232:0@lo:502: 00000100:00100000:1.0:1790740181.016282:0:8609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740181.016352:0:8609:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc86a18000 going to sleep for 11 seconds 00000100:00100000:2.0:1790740181.016445:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021919232 00000100:00100000:2.0:1790740181.016450:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021919232 00000100:00100000:2.0:1790740181.016482:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1790740181.016490:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+20:8609:x1877727021919232:12345-0@lo:502: 00000100:00100000:2.0:1790740181.016637:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+20:8609:x1877727021919232:12345-0@lo:502: Request processed in 148us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740181.016645:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1790740181.016767:0:8609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8609:1877727021919232:0@lo:502: 00000020:01000000:1.0:1790740181.016793:0:8609:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790740181.016801:0:8609:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1790740181.016809:0:8609:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740181.016810:0:8609:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1790740181.016815:0:8609:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790740181.016820:0:8609:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.103@tcp to nid 0x20000c0a8cc67 (192.168.204.103@tcp) 00000020:01000000:1.0:1790740181.016843:0:8609:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1790740181.016845:0:8609:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790740181.016871:0:8609:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff98dcbd5a0000) 00000020:00000080:1.0:1790740181.016893:0:8609:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:1.0:1790740181.017116:0:8609:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1790740181.017207:0:8609:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1790740181.017212:0:8609:0:(osd_handler.c:8931:osd_obd_connect()) connect #6 00000020:00000080:1.0:1790740181.017219:0:8609:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb25dda4f4e92d989 00010000:00080000:1.0:1790740181.017249:0:8609:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98dcaec8d800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.103@tcp at head 00010000:00010000:1.0:1790740181.017571:0:8609:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000100:00100000:3.0:1790740181.019209:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5f6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8460:x1877727021917952:12345-0@lo:700: Request processed in 24910us (26811us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740181.019222:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790740181.019270:0:8460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98dcb5f6e680 x1877727021917952/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790740196 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740181.019284:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6e680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8460:1877727021917952:0@lo:700: 40000000:02000000:3.0:1790740181.019297:0:8460:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000040:01000000:0.0:1790740181.026864:0:8609:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1790740181.026891:0:8609:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1790740181.027171:0:8609:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790740181.027373:0:8609:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790740181.027462:0:8609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1790740181.027576:0:8609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1790740181.028533:0:8610:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790740181.028539:0:8610:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1790740181.029392:0:8609:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790740181.029404:0:8609:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1790740181.029440:0:8609:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1790740181.029462:0:8609:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb25dda4f4e92d990 00000100:00080000:0.0:1790740181.029472:0:8609:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790740181.029483:0:8609:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98dcaec8d800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:0.0:1790740181.029520:0:8609:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98db82331180 x1877727021919360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790740181.029545:0:8609:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1790740181.029669:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82331180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877727021919360:0@lo:8: 00000100:00100000:2.0:1790740181.029750:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740181.029818:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021919360 00000100:00100000:2.0:1790740181.029826:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021919360 00000100:00100000:2.0:1790740181.029860:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790740181.029867:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb8139180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3637:x1877727021919360:12345-0@lo:8: 00010000:00080000:2.0:1790740181.029903:0:8454:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 252 last 0 00000020:00000080:2.0:1790740181.029928:0:8454:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb25dda4f4e92d997 00002000:00100000:2.0:1790740181.029942:0:8454:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff98db829b0800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b03 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1790740181.029947:0:8454:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1790740181.029950:0:8454:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:01000000:0.0:1790740181.030265:0:8609:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790740181.030270:0:8609:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740181.030272:0:8609:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1790740181.030275:0:8609:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790740181.030280:0:8609:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740181.030281:0:8609:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790740181.030284:0:8609:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790740181.030286:0:8609:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1790740181.030311:0:8609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82331500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8609:1877727021919488:0@lo:502: 00000100:00100000:0.0:1790740181.030361:0:8609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740181.030379:0:8609:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc8968d000 going to sleep for 11 seconds 00000100:00100000:0.0:1790740181.030411:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021919488 00000100:00100000:0.0:1790740181.030416:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021919488 00000100:00100000:0.0:1790740181.030451:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1790740181.030457:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+20:8609:x1877727021919488:12345-0@lo:502: 00000100:00100000:0.0:1790740181.030574:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+20:8609:x1877727021919488:12345-0@lo:502: Request processed in 116us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740181.030582:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1790740181.030637:0:8609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82331500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:8609:1877727021919488:0@lo:502: 00000020:01000000:0.0:1790740181.030659:0:8609:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790740181.030663:0:8609:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740181.030665:0:8609:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:0.0:1790740181.030669:0:8609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1790740181.030792:0:6532:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1790740181.030813:0:6532:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1790740181.030822:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3200/0xb25dda4f4e92d974 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d97b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740181.030833:0:6532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3200/0xb25dda4f4e92d974 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d97b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740181.030842:0:6532:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1790740181.030845:0:6532:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98dc992499c0 from 1 10000000:01000000:0.0:1790740181.030847:0:6532:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790740181.030867:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2e00/0xb25dda4f4e92d99e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740181.030876:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2e00/0xb25dda4f4e92d99e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740181.030890:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2e00/0xb25dda4f4e92d99e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740181.030901:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82331500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021919616:0@lo:101: 00000100:00100000:0.0:1790740181.030929:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740181.030945:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc8968d000 going to sleep for 11 seconds 00000100:00100000:0.0:1790740181.030958:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021919616 00000100:00100000:0.0:1790740181.030962:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021919616 00002000:00080000:2.0:1790740181.031154:0:8454:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790740181.031181:0:8454:0:(import.c:65:import_set_state_nolock()) ffff98db829b5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790740181.031224:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb8139180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1877727021919360:12345-0@lo:8: Request processed in 1356us (1474us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740181.031231:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790740181.031271:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98db82331180 x1877727021919360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790740191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740181.031282:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790740181.031288:0:3637:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1790740181.031294:0:3637:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1790740181.031298:0:3637:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1790740181.031300:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98dcaec8d800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1790740181.031308:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1790740181.031314:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82331180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877727021919360:0@lo:8: 00000004:00080000:2.0:1790740181.031334:0:8610:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1790740181.031382:0:8610:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 252317350231ns, next at 0ns, rc = 0 00080000:00080000:2.0:1790740181.031389:0:8610:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1790740181.035437:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1790740181.035455:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+20:6532:x1877727021919616:12345-0@lo:101: 00010000:00010000:0.0:1790740181.035476:0:6529:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740181.035496:0:6529:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcaeee3800/0xb25dda4f4e92d9a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92d99e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740181.035525:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcaeee3800/0xb25dda4f4e92d9a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92d99e expref: 21 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740181.035537:0:6529:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcaeee3800/0xb25dda4f4e92d9a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d99e expref: 21 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740181.035547:0:6529:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaeee3800, rc 0) 00000100:00100000:0.0:1790740181.037395:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:6532:x1877727021919616:12345-0@lo:101: Request processed in 1938us (6455us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740181.037406:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1790740181.037479:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82331500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021919616:0@lo:101: 00010000:00010000:0.0:1790740181.037503:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2e00/0xb25dda4f4e92d99e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d9a5 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740181.037527:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2e00/0xb25dda4f4e92d99e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92d9a5 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740181.037617:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82331500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021919744:0@lo:501: 00000100:00100000:0.0:1790740181.037666:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740181.037703:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc8968d000 going to sleep for 11 seconds 00000100:00100000:2.0:1790740181.039066:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021919744 00000100:00100000:2.0:1790740181.039080:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021919744 00000100:00100000:2.0:1790740181.039138:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1790740181.039149:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:6532:x1877727021919744:12345-0@lo:501: 00000100:00100000:2.0:1790740181.039281:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:6532:x1877727021919744:12345-0@lo:501: Request processed in 134us (1614us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790740181.039289:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000004:00080000:2.0:1790740181.039794:0:6514:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1790740181.041056:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82331500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021919744:0@lo:501: 10000000:01000000:0.0:1790740181.041105:0:6532:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1790740181.041118:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2e00/0xb25dda4f4e92d99e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d9a5 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740181.041140:0:6532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2e00/0xb25dda4f4e92d99e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d9a5 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790740181.051000:0:8611:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1790740181.051055:0:8611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98535180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8611:1877727021920000:0@lo:7: 00000100:00100000:1.0:1790740181.051096:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790740181.051111:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98535880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021919872:0@lo:13: 00000100:00100000:3.0:1790740181.051134:0:8611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740181.053108:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021920000 00000100:00100000:0.0:1790740181.053122:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021920000 00000100:00100000:0.0:1790740181.053195:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790740181.053205:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc98534380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8611:x1877727021920000:12345-0@lo:7: 00000100:00100000:1.0:1790740181.058939:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740181.059062:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021919872 00000100:00100000:1.0:1790740181.059072:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021919872 00000100:00100000:1.0:1790740181.059118:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790740181.059140:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5f6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1877727021919872:12345-0@lo:13: 00002000:00000024:1.0:1790740181.059178:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923841024 avail 3692318720 00000100:00100000:1.0:1790740181.059244:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5f6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1877727021919872:12345-0@lo:13: Request processed in 118us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740181.059251:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1790740181.059294:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98dc98535880 x1877727021919872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740197 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740181.059313:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98535880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021919872:0@lo:13: 00000001:00100000:3.0:1790740181.061925:0:8446:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1790740181.061936:0:8446:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00080000:0.0:1790740181.062483:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:0.0:1790740181.062977:0:8451:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1790740181.062984:0:8451:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1790740181.063098:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc98534380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8611:x1877727021920000:12345-0@lo:7: Request processed in 9891us (11971us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740181.063108:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790740181.065683:0:8611:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5fedd80 going to sleep for 11 seconds 00010000:00080000:2.0:1790740181.065733:0:8611:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98dc98535180 x1877727021920000/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790740197 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740181.065749:0:8611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98535180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8611:1877727021920000:0@lo:7: 00000004:00080000:2.0:1790740181.065764:0:8611:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1790740181.065807:0:8611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb8138a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8611:1877727021920128:0@lo:5: 00000100:00100000:2.0:1790740181.065863:0:8611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740181.065902:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021920128 00000100:00100000:2.0:1790740181.065908:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021920128 00000100:00100000:2.0:1790740181.065961:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790740181.065970:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb8138380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8611:x1877727021920128:12345-0@lo:5: 00002000:00080000:2.0:1790740181.065999:0:8454:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1790740181.066003:0:8454:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1790740181.072447:0:8611:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5deb480 going to sleep for 11 seconds 00000100:00100000:2.0:1790740181.072492:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb8138380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8611:x1877727021920128:12345-0@lo:5: Request processed in 6518us (6623us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1790740181.072502:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1790740181.074493:0:8611:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98dcb8138a80 x1877727021920128/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790740197 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740181.074513:0:8611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb8138a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8611:1877727021920128:0@lo:5: 00000004:00080000:3.0:1790740181.074528:0:8611:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1790740181.075482:0:8611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98534a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8611:1877727021920256:0@lo:700: 00000100:00100000:3.0:1790740181.075542:0:8611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740181.075684:0:8461:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 2 min 2 max 16 00000100:00100000:0.0:1790740181.075692:0:8461:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_002' 00000100:00100000:3.0:1790740181.075733:0:8611:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5fedd80 going to sleep for 11 seconds 00000100:00100000:2.0:1790740181.076908:0:8461:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021920256 00000100:00100000:2.0:1790740181.076918:0:8461:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021920256 00000100:00100000:3.0:1790740181.077117:0:8614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790740181.077140:0:8614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc98534000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:8611:x1877727021920256:12345-0@lo:700: 00000100:00100000:1.0:1790740181.080213:0:8460:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82333b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8605:x1877727021917824:12345-0@lo:700: Request processed in 87904us (89000us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740181.080229:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1790740181.081218:0:8605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98db82333800 x1877727021917824/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790740196 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740181.081244:0:8605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82333800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8605:1877727021917824:0@lo:700: 00000001:00080000:0.0:1790740181.088220:0:8446:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:2.0:1790740181.095389:0:8614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc98534000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8611:x1877727021920256:12345-0@lo:700: Request processed in 18255us (19837us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740181.095409:0:8614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790740181.096672:0:8611:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98dc98534a80 x1877727021920256/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790740197 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740181.096697:0:8611:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1790740181.096714:0:8611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98534a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8611:1877727021920256:0@lo:700: 00000004:02000040:2.0:1790740181.100528:0:8611:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:2.0:1790740181.107622:0:8611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb8138a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8611:1877727021920384:0@lo:5: 00000100:00100000:2.0:1790740181.107695:0:8611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740181.107854:0:8611:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5deb480 going to sleep for 11 seconds 00000100:00100000:3.0:1790740181.108942:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000004:00080000:0.0:1790740181.109142:0:8605:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1790740181.109170:0:8605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82331500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8605:1877727021920640:0@lo:7: 00000100:00100000:0.0:1790740181.109221:0:8605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740181.109447:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021920512:0@lo:13: 00000100:00100000:2.0:1790740181.109502:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740181.109723:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021920512 00000100:00100000:3.0:1790740181.109744:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021920512 00000100:00100000:3.0:1790740181.109797:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790740181.109807:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb8139500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021920512:12345-0@lo:13: 00002000:00000024:3.0:1790740181.109829:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923841024 avail 3692318720 00000100:00100000:3.0:1790740181.109885:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb8139500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021920512:12345-0@lo:13: Request processed in 79us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740181.109892:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790740181.109945:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98db82333800 x1877727021920512/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740197 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740181.109964:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021920512:0@lo:13: 00000100:00100000:0.0:1790740181.111543:0:8605:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc8968db40 going to sleep for 11 seconds 00000100:00100000:1.0:1790740181.111803:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021920384 00000100:00100000:1.0:1790740181.111813:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021920384 00000100:00100000:0.0:1790740181.112316:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021920640 00000100:00100000:0.0:1790740181.112330:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021920640 00000100:00100000:2.0:1790740181.112469:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790740181.112483:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb8139f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8611:x1877727021920384:12345-0@lo:5: 00002000:00080000:2.0:1790740181.125818:0:8454:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1790740181.125839:0:8454:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:3.0:1790740181.129897:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb8139f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8611:x1877727021920384:12345-0@lo:5: Request processed in 17410us (22194us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1790740181.129922:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790740181.129956:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790740181.129967:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82331f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8605:x1877727021920640:12345-0@lo:7: 00010000:00080000:2.0:1790740181.132448:0:8611:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98dcb8138a80 x1877727021920384/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790740197 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740181.132469:0:8611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb8138a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8611:1877727021920384:0@lo:5: 00000004:00080000:2.0:1790740181.132485:0:8611:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00002000:00080000:0.0:1790740181.145935:0:8454:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1790740181.145945:0:8454:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1790740181.146074:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82331f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8605:x1877727021920640:12345-0@lo:7: Request processed in 16107us (36847us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740181.146086:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1790740181.147659:0:8605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98db82331500 x1877727021920640/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790740197 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740181.147675:0:8605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82331500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8605:1877727021920640:0@lo:7: 00000004:00080000:2.0:1790740181.147689:0:8605:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:2.0:1790740181.147747:0:8605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82c89880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8605:1877727021920768:0@lo:5: 00000100:00100000:2.0:1790740181.147802:0:8605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740181.147851:0:8605:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc8569b840 going to sleep for 11 seconds 00000100:00100000:1.0:1790740181.147926:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021920768 00000100:00100000:1.0:1790740181.147934:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021920768 00000100:00100000:1.0:1790740181.147989:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790740181.148000:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82c88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8605:x1877727021920768:12345-0@lo:5: 00002000:00080000:1.0:1790740181.148029:0:8453:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1790740181.148107:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82c88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8605:x1877727021920768:12345-0@lo:5: Request processed in 110us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740181.148114:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1790740181.151012:0:8605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98db82c89880 x1877727021920768/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790740197 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740181.151084:0:8605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82c89880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8605:1877727021920768:0@lo:5: 00000004:00080000:2.0:1790740181.151101:0:8605:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1790740181.151465:0:8605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82330e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8605:1877727021920896:0@lo:5: 00000100:00100000:1.0:1790740181.151577:0:8605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740181.151618:0:8605:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc8968db40 going to sleep for 11 seconds 00000100:00100000:0.0:1790740181.151633:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021920896 00000100:00100000:0.0:1790740181.151642:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021920896 00000100:00100000:0.0:1790740181.151700:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790740181.151709:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5f6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8605:x1877727021920896:12345-0@lo:5: 00002000:00080000:0.0:1790740181.151752:0:8454:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1790740181.156177:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5f6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8605:x1877727021920896:12345-0@lo:5: Request processed in 4460us (4591us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1790740181.156190:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1790740181.157594:0:8605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98db82330e00 x1877727021920896/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790740197 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740181.157616:0:8605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82330e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8605:1877727021920896:0@lo:5: 00000004:00080000:0.0:1790740181.157633:0:8605:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1790740181.157680:0:8605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82332d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8605:1877727021921024:0@lo:900: 00000100:00100000:0.0:1790740181.157735:0:8605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740181.157767:0:8605:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc8968db40 going to sleep for 11 seconds 00000100:00100000:1.0:1790740181.158391:0:6547:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021921024 00000100:00100000:1.0:1790740181.158399:0:6547:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021921024 00000100:00100000:1.0:1790740181.158784:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790740181.158803:0:6547:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8605:x1877727021921024:12345-0@lo:900: 00000100:00100000:1.0:1790740181.159724:0:6547:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8605:x1877727021921024:12345-0@lo:900: Request processed in 920us (1986us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740181.159734:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1790740181.170104:0:8605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98db82332d80 x1877727021921024/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790740197 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740181.170139:0:8605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82332d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8605:1877727021921024:0@lo:900: 00010000:00010000:3.0:1790740181.483786:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740182.506259:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740183.530556:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740183.659294:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790740183.659321:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021921152:0@lo:41: 00000100:00100000:1.0:1790740183.659393:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740183.659480:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021921152 00000100:00100000:1.0:1790740183.659489:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021921152 00000100:00100000:1.0:1790740183.659543:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790740183.659553:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5f6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021921152:12345-0@lo:41: 00000004:00000024:1.0:1790740183.659594:0:7846:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1790740183.659646:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5f6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021921152:12345-0@lo:41: Request processed in 94us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740183.659653:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790740183.659715:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021921152:0@lo:41: 00010000:00010000:1.0:1790740184.555274:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790740184.703466:0:8827:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg403-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1790740185.579932:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1790740185.610653:0:8880:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790740185.610920:0:8880:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1790740185.714547:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790740185.714574:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727021921280:0@lo:41: 00000100:00100000:0.0:1790740185.714643:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740185.714711:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021921280 00000100:00100000:0.0:1790740185.714720:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021921280 00000100:00100000:0.0:1790740185.714780:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790740185.714790:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82333800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727021921280:12345-0@lo:41: 00000004:00000024:0.0:1790740185.714826:0:6540:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1790740185.714873:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82333800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727021921280:12345-0@lo:41: Request processed in 84us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740185.714879:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790740185.714919:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727021921280:0@lo:41: 00000100:00100000:1.0:1790740186.220277:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98535c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021921408:0@lo:13: 00000100:00100000:1.0:1790740186.220347:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740186.220413:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021921408 00000100:00100000:1.0:1790740186.220421:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021921408 00000100:00100000:1.0:1790740186.220467:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790740186.220474:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1877727021921408:12345-0@lo:13: 00002000:00000024:1.0:1790740186.220501:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790740186.220551:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1877727021921408:12345-0@lo:13: Request processed in 76us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740186.220557:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1790740186.220592:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98dc98535c00 x1877727021921408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740202 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740186.220907:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021921536:0@lo:13: 00000100:00100000:2.0:1790740186.220938:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740186.220990:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021921536 00000100:00100000:3.0:1790740186.220994:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021921536 00000100:00100000:3.0:1790740186.221018:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790740186.221023:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82c89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1877727021921536:12345-0@lo:13: 00002000:00000024:3.0:1790740186.221171:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1790740186.221234:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790740186.221402:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98535c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021921408:0@lo:13: 00000100:00100000:3.0:1790740186.221736:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82c89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1877727021921536:12345-0@lo:13: Request processed in 710us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740186.221743:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790740186.221870:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82331180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3641:1877727021921664:0@lo:400: 00000100:00100000:0.0:1790740186.221903:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740186.221924:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021922176:0@lo:400: 00000100:00100000:0.0:1790740186.221944:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740186.221958:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790740186.221962:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82331880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877727021922048:0@lo:400: 00000100:00100000:0.0:1790740186.221980:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740186.222009:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021921664 00000100:00100000:0.0:1790740186.222013:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021921664 00000100:00100000:3.0:1790740186.222210:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727021921920:0@lo:400: 00000100:00100000:3.0:1790740186.222234:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740186.222252:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1877727021922432:0@lo:400: 00000100:00100000:3.0:1790740186.222272:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740186.222287:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1790740186.222291:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877727021921792:0@lo:400: 00000100:00100000:3.0:1790740186.222308:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740186.222321:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1877727021922304:0@lo:400: 00000100:00100000:3.0:1790740186.222340:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740186.222361:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021922176 00000100:00100000:3.0:1790740186.222364:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021922176 00000100:00100000:3.0:1790740186.222384:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021921920 00000100:00100000:3.0:1790740186.222387:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021921920 00000100:00100000:3.0:1790740186.222398:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790740186.222410:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaefdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021922176:12345-0@lo:400: 00000100:00100000:3.0:1790740186.222455:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaefdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021922176:12345-0@lo:400: Request processed in 45us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740186.222461:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790740186.222473:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790740186.222478:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc98536a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727021921920:12345-0@lo:400: 00000100:00100000:3.0:1790740186.222508:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc98536a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727021921920:12345-0@lo:400: Request processed in 29us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740186.222513:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790740186.222543:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021922176:0@lo:400: 00000100:00100000:3.0:1790740186.222564:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727021921920:0@lo:400: 00000100:00100000:0.0:1790740186.222786:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1790740186.222797:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:3641:x1877727021921664:12345-0@lo:400: 00000100:00100000:0.0:1790740186.222843:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:3641:x1877727021921664:12345-0@lo:400: Request processed in 48us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740186.222849:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1790740186.223285:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82331180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3641:1877727021921664:0@lo:400: 00000100:00100000:3.0:1790740186.224144:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021922048 00000100:00100000:3.0:1790740186.224154:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021922048 00000100:00100000:3.0:1790740186.224188:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021922432 00000100:00100000:3.0:1790740186.224192:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021922432 00000100:00100000:3.0:1790740186.224220:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021921792 00000100:00100000:3.0:1790740186.224223:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021921792 00000100:00100000:3.0:1790740186.224234:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021922304 00000100:00100000:3.0:1790740186.224236:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021922304 00000100:00100000:3.0:1790740186.224252:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790740186.224259:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaefd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877727021922048:12345-0@lo:400: 00000100:00100000:3.0:1790740186.224333:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaefd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877727021922048:12345-0@lo:400: Request processed in 74us (2351us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740186.224340:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790740186.224356:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790740186.224361:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc98534700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877727021922432:12345-0@lo:400: 00000100:00100000:3.0:1790740186.224404:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc98534700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877727021922432:12345-0@lo:400: Request processed in 43us (2131us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740186.224410:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790740186.224422:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790740186.224428:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc98535c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877727021921792:12345-0@lo:400: 00000100:00100000:3.0:1790740186.224453:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc98535c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877727021921792:12345-0@lo:400: Request processed in 26us (2145us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740186.224459:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790740186.224468:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790740186.224473:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc98534a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1877727021922304:12345-0@lo:400: 00000100:00100000:3.0:1790740186.224494:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc98534a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1877727021922304:12345-0@lo:400: Request processed in 21us (2153us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740186.224499:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1790740186.224518:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790740186.224521:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1790740186.224545:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98db82331880 x1877727021922048/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740186.224558:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82331880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877727021922048:0@lo:400: 00010000:00080000:3.0:1790740186.224585:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98db82330380 x1877727021921792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740186.224594:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877727021921792:0@lo:400: 00010000:00080000:3.0:1790740186.224604:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98dcaefd8700 x1877727021922304/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740186.224611:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1877727021922304:0@lo:400: 00010000:00080000:3.0:1790740186.224632:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98dcaefd8000 x1877727021922432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740186.224640:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1877727021922432:0@lo:400: 00010000:00080000:2.0:1790740186.227345:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98db82332d80 x1877727021921536/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740202 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740186.227376:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021921536:0@lo:13: 00000001:00080000:0.0:1790740186.496849:0:8446:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00080000:0.0:1790740186.497277:0:8446:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1790740186.604821:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740187.629142:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740188.652055:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1790740188.705753:0:8981:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790740188.706300:0:8981:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1790740188.786908:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790740188.786945:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021922560:0@lo:41: 00000100:00100000:0.0:1790740188.787075:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740188.787149:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021922560 00000100:00100000:0.0:1790740188.787161:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021922560 00000100:00100000:0.0:1790740188.787221:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790740188.787245:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaefda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021922560:12345-0@lo:41: 00000004:00000024:0.0:1790740188.787293:0:6540:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1790740188.787348:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaefda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021922560:12345-0@lo:41: Request processed in 106us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740188.787356:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790740188.787518:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021922560:0@lo:41: 00010000:00010000:2.0:1790740189.678024:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1790740189.724355:0:9029:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790740189.724368:0:9029:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:2.0:1790740190.699640:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740190.826205:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790740190.826244:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021922688:0@lo:41: 00000100:00100000:0.0:1790740190.826340:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740190.826435:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021922688 00000100:00100000:0.0:1790740190.826447:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021922688 00000100:00100000:0.0:1790740190.826613:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790740190.826625:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaefda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021922688:12345-0@lo:41: 00000004:00000024:0.0:1790740190.826681:0:6541:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1790740190.829069:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaefda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021922688:12345-0@lo:41: Request processed in 2434us (2717us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740190.829086:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790740190.831050:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021922688:0@lo:41: 00000100:00100000:2.0:1790740191.338275:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877727021923200:0@lo:400: 00000100:00100000:0.0:1790740191.338342:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727021922816:0@lo:400: 00000100:00100000:2.0:1790740191.338372:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740191.338449:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740191.338463:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021923712:0@lo:400: 00000100:00100000:2.0:1790740191.338505:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740191.338548:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021922816 00000100:00100000:2.0:1790740191.338556:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021922816 00000100:00100000:2.0:1790740191.338604:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1790740191.338612:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:3638:x1877727021922816:12345-0@lo:400: 00000100:00100000:0.0:1790740191.338674:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021923328:0@lo:400: 00000100:00100000:2.0:1790740191.338687:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:3638:x1877727021922816:12345-0@lo:400: Request processed in 67us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740191.338697:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1790740191.338724:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740191.338751:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021923712 00000100:00100000:0.0:1790740191.338758:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021923840:0@lo:400: 00000100:00100000:2.0:1790740191.338771:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021923712 00000100:00100000:2.0:1790740191.338813:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790740191.338821:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82c8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021923712:12345-0@lo:400: 00000100:00100000:2.0:1790740191.338861:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82c8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021923712:12345-0@lo:400: Request processed in 41us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740191.338867:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790740191.339209:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740191.339273:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021923840 00000100:00100000:0.0:1790740191.339276:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727021922816:0@lo:400: 00000100:00100000:2.0:1790740191.339281:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021923840 00000100:00100000:0.0:1790740191.339308:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1790740191.339321:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021922944:0@lo:13: 00000100:00100000:2.0:1790740191.339330:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790740191.339344:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaefd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021923840:12345-0@lo:400: 00000100:00100000:3.0:1790740191.339473:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021923200 00000100:00100000:3.0:1790740191.339483:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021923200 00000100:00100000:3.0:1790740191.339895:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790740191.339905:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82c88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877727021923200:12345-0@lo:400: 00000100:00100000:2.0:1790740191.341713:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaefd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021923840:12345-0@lo:400: Request processed in 2362us (2494us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740191.341728:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1790740191.341807:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790740191.343092:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877727021923072:0@lo:400: 00000100:00100000:2.0:1790740191.343181:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740191.343250:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1877727021923584:0@lo:400: 00000100:00100000:2.0:1790740191.343276:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740191.343324:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021923968:0@lo:13: 00000100:00100000:2.0:1790740191.344080:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740191.344140:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021923072 00000100:00100000:2.0:1790740191.344151:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021923072 00000100:00100000:2.0:1790740191.344205:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021923584 00000100:00100000:2.0:1790740191.344208:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021923584 00000100:00100000:2.0:1790740191.344237:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790740191.344246:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877727021923072:12345-0@lo:400: 00000100:00100000:2.0:1790740191.344315:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877727021923072:12345-0@lo:400: Request processed in 70us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740191.344336:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790740191.345586:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790740191.345604:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82c8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877727021923584:12345-0@lo:400: 00000100:00100000:2.0:1790740191.345685:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82c8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877727021923584:12345-0@lo:400: Request processed in 89us (2408us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740191.345692:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1790740191.345736:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1790740191.345780:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98dcaefdb800 x1877727021923072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740191.345797:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877727021923072:0@lo:400: 00010000:00080000:2.0:1790740191.345811:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98dcaefd9500 x1877727021923584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740191.345819:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1877727021923584:0@lo:400: 00000100:00100000:2.0:1790740191.347727:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021923968 00000100:00100000:2.0:1790740191.347747:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021923968 00000100:00100000:2.0:1790740191.347810:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790740191.347820:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82c8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727021923968:12345-0@lo:13: 00000100:00100000:0.0:1790740191.348478:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740191.348553:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877727021923456:0@lo:400: 00000100:00100000:0.0:1790740191.348619:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740191.348655:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021923456 00000100:00100000:0.0:1790740191.348662:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021923456 00000100:00100000:0.0:1790740191.348708:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790740191.348716:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaefd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877727021923456:12345-0@lo:400: 00000100:00100000:0.0:1790740191.348795:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaefd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877727021923456:12345-0@lo:400: Request processed in 80us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740191.348804:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790740191.348976:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021923328 00000100:00100000:0.0:1790740191.349100:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021923328 00000100:00100000:0.0:1790740191.349134:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790740191.349151:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaefdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021923328:12345-0@lo:400: 00000100:00100000:0.0:1790740191.349195:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaefdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021923328:12345-0@lo:400: Request processed in 45us (10473us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740191.349202:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1790740191.349229:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790740191.349269:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98dcaefd9f80 x1877727021923712/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740191.349283:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1790740191.349302:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021923712:0@lo:400: 00010000:00080000:0.0:1790740191.349334:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98dcaefd9180 x1877727021923456/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740191.349345:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877727021923456:0@lo:400: 00002000:00000024:2.0:1790740191.349679:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790740191.349736:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82c8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727021923968:12345-0@lo:13: Request processed in 1916us (6377us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740191.349745:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790740191.349761:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021922944 00000100:00100000:2.0:1790740191.349765:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021922944 00000100:00100000:2.0:1790740191.349783:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790740191.349789:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaefdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021922944:12345-0@lo:13: 00002000:00000024:2.0:1790740191.349812:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790740191.350605:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021923328:0@lo:400: 00010000:00080000:0.0:1790740191.350638:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98dcaefd8e00 x1877727021923840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740191.350648:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1790740191.350667:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021923840:0@lo:400: 00000100:00100000:2.0:1790740191.351092:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaefdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021922944:12345-0@lo:13: Request processed in 1300us (2613us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740191.351102:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1790740191.351152:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98db82c89c00 x1877727021923968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740207 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740191.351172:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021923968:0@lo:13: 00000100:00100000:2.0:1790740191.351256:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82c88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877727021923200:12345-0@lo:400: Request processed in 11352us (12884us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740191.351267:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1790740191.351616:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98dcaefdbb80 x1877727021923200/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740191.351627:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877727021923200:0@lo:400: 00010000:00080000:0.0:1790740191.351655:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98db82c88700 x1877727021922944/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740207 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740191.351668:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021922944:0@lo:13: 00010000:00010000:0.0:1790740191.731588:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740192.747456:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740193.770202:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740193.898737:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790740193.898763:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021924096:0@lo:41: 00000100:00100000:1.0:1790740193.898862:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740193.898943:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021924096 00000100:00100000:1.0:1790740193.898952:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021924096 00000100:00100000:1.0:1790740193.899001:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790740193.899010:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5f6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021924096:12345-0@lo:41: 00000004:00000024:1.0:1790740193.899075:0:6540:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1790740193.899122:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5f6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021924096:12345-0@lo:41: Request processed in 113us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740193.899130:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790740193.899179:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021924096:0@lo:41: 00010000:00010000:2.0:1790740194.794849:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740195.818180:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740195.949006:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790740195.949053:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021924224:0@lo:41: 00000100:00100000:0.0:1790740195.949131:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740195.949255:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021924224 00000100:00100000:1.0:1790740195.949275:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021924224 00000100:00100000:1.0:1790740195.949334:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790740195.949344:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaefd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021924224:12345-0@lo:41: 00000004:00000024:1.0:1790740195.949393:0:6541:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1790740195.949443:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaefd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021924224:12345-0@lo:41: Request processed in 101us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740195.949450:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790740195.949629:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021924224:0@lo:41: 00000100:00100000:0.0:1790740196.459647:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98535180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727021924352:0@lo:400: 00000100:00100000:0.0:1790740196.459716:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740196.459764:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98534e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877727021924864:0@lo:400: 00000100:00100000:0.0:1790740196.459788:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740196.459815:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1790740196.459821:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98535880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727021924480:0@lo:400: 00000100:00100000:3.0:1790740196.459999:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021924352 00000100:00100000:3.0:1790740196.460008:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021924352 00000100:00100000:3.0:1790740196.460083:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1790740196.460093:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:3638:x1877727021924352:12345-0@lo:400: 00000100:00100000:3.0:1790740196.460141:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:3638:x1877727021924352:12345-0@lo:400: Request processed in 50us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740196.460160:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1790740196.460380:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740196.460399:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82330e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1877727021924992:0@lo:400: 00000100:00100000:0.0:1790740196.460421:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740196.460450:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98535180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727021924352:0@lo:400: 00000100:00100000:0.0:1790740196.460476:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98537480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877727021924608:0@lo:400: 00000100:00100000:0.0:1790740196.460694:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740196.460716:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021925120:0@lo:400: 00000100:00100000:0.0:1790740196.460740:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740196.460761:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1790740196.460767:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98535500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021924736:0@lo:400: 00000100:00100000:0.0:1790740196.460789:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740196.460808:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021925248:0@lo:400: 00000100:00100000:0.0:1790740196.460977:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740196.461009:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021924864 00000100:00100000:0.0:1790740196.461014:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021924864 00000100:00100000:0.0:1790740196.461069:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021924480 00000100:00100000:0.0:1790740196.461072:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021924480 00000100:00100000:0.0:1790740196.461084:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021924992 00000100:00100000:0.0:1790740196.461087:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021924992 00000100:00100000:0.0:1790740196.461100:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021924608 00000100:00100000:0.0:1790740196.461102:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021924608 00000100:00100000:0.0:1790740196.461115:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790740196.461121:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaefdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877727021924864:12345-0@lo:400: 00000100:00100000:3.0:1790740196.461266:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790740196.461276:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaefd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727021924480:12345-0@lo:400: 00000100:00100000:3.0:1790740196.461314:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaefd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727021924480:12345-0@lo:400: Request processed in 40us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740196.461321:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790740196.461337:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790740196.461342:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaefd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877727021924992:12345-0@lo:400: 00000100:00100000:3.0:1790740196.461368:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaefd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877727021924992:12345-0@lo:400: Request processed in 26us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740196.461374:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790740196.461392:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790740196.461397:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaefd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877727021924608:12345-0@lo:400: 00000100:00100000:3.0:1790740196.461427:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaefd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877727021924608:12345-0@lo:400: Request processed in 30us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740196.461433:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790740196.461668:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaefdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877727021924864:12345-0@lo:400: Request processed in 546us (1878us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740196.461674:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1790740196.461693:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790740196.461698:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790740196.461720:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98dc98535880 x1877727021924480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740196.461731:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98535880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727021924480:0@lo:400: 00010000:00080000:0.0:1790740196.461741:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98db82330e00 x1877727021924992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740196.461749:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82330e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1877727021924992:0@lo:400: 00010000:00080000:0.0:1790740196.461757:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98dc98534e00 x1877727021924864/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740196.461763:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98534e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877727021924864:0@lo:400: 00010000:00080000:0.0:1790740196.461794:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98dc98537480 x1877727021924608/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740196.461815:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98537480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877727021924608:0@lo:400: 00000100:00100000:2.0:1790740196.462648:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021925120 00000100:00100000:2.0:1790740196.462655:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021925120 00000100:00100000:2.0:1790740196.462694:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021925248 00000100:00100000:2.0:1790740196.462697:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021925248 00000100:00100000:2.0:1790740196.462714:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790740196.462721:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaefdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021925120:12345-0@lo:400: 00000100:00100000:2.0:1790740196.462782:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaefdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021925120:12345-0@lo:400: Request processed in 61us (2040us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740196.462789:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790740196.462804:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790740196.462810:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaefd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021925248:12345-0@lo:400: 00000100:00100000:3.0:1790740196.464384:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790740196.464404:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82331880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021925376:0@lo:13: 00000100:00100000:3.0:1790740196.464460:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740196.467068:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021925376 00000100:00100000:3.0:1790740196.467080:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021925376 00000100:00100000:3.0:1790740196.467141:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790740196.467162:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82331180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1877727021925376:12345-0@lo:13: 00002000:00000024:3.0:1790740196.467192:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790740196.467291:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82331180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1877727021925376:12345-0@lo:13: Request processed in 141us (2830us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740196.467299:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1790740196.467343:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98db82331880 x1877727021925376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740212 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740196.467363:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82331880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021925376:0@lo:13: 00000100:00100000:2.0:1790740196.467505:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaefd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021925248:12345-0@lo:400: Request processed in 4693us (6526us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740196.467516:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1790740196.467545:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790740196.467580:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98db82330380 x1877727021925248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740196.467605:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021925248:0@lo:400: 00010000:00080000:2.0:1790740196.467625:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98db82332d80 x1877727021925120/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740196.467634:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021925120:0@lo:400: 00000100:00100000:2.0:1790740196.467696:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790740196.467709:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021925504:0@lo:13: 00000100:00100000:2.0:1790740196.467744:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740196.467768:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021925504 00000100:00100000:2.0:1790740196.467772:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021925504 00000100:00100000:2.0:1790740196.467794:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790740196.467801:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82c8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021925504:12345-0@lo:13: 00002000:00000024:2.0:1790740196.467811:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790740196.467853:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82c8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021925504:12345-0@lo:13: Request processed in 52us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740196.467859:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1790740196.468167:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98db82c89c00 x1877727021925504/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740212 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740196.468181:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021925504:0@lo:13: 00000100:00100000:2.0:1790740196.475370:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021924736 00000100:00100000:2.0:1790740196.475384:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021924736 00000100:00100000:2.0:1790740196.475439:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790740196.475450:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaefdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021924736:12345-0@lo:400: 00000100:00100000:2.0:1790740196.477895:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaefdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021924736:12345-0@lo:400: Request processed in 2439us (17096us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740196.477909:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790740196.477978:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98535500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021924736:0@lo:400: 00010000:00010000:2.0:1790740196.843861:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740197.876860:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740198.890488:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740199.029899:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021925632:0@lo:41: 00000100:00100000:0.0:1790740199.029973:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740199.030119:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021925632 00000100:00100000:1.0:1790740199.030128:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021925632 00000100:00100000:1.0:1790740199.030183:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790740199.030193:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaefd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021925632:12345-0@lo:41: 00000004:00000024:1.0:1790740199.030226:0:6540:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1790740199.030272:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaefd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021925632:12345-0@lo:41: Request processed in 81us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740199.030280:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790740199.030357:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021925632:0@lo:41: 00010000:00010000:2.0:1790740199.914342:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740200.942432:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740201.067151:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790740201.067248:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021925760:0@lo:41: 00000100:00100000:0.0:1790740201.067347:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740201.067415:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021925760 00000100:00100000:0.0:1790740201.067422:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021925760 00000100:00100000:0.0:1790740201.067470:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790740201.067479:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc98535500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021925760:12345-0@lo:41: 00000004:00000024:0.0:1790740201.067515:0:6541:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1790740201.067580:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc98535500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021925760:12345-0@lo:41: Request processed in 101us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740201.067587:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790740201.067638:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021925760:0@lo:41: 00000020:01000004:0.0:1790740201.351818:0:9529:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790740201.351822:0:9529:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1790740201.351823:0:9529:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1790740201.351950:0:9529:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98dcb5f0a000 00000020:01000004:0.0:1790740201.351965:0:9529:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1790740201.352022:0:9529:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1790740201.352057:0:9529:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff98dcb6c699c0) 00000020:00000080:0.0:1790740201.352075:0:9529:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1790740201.403247:0:9529:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1790740201.403297:0:9529:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:2.0:1790740201.433325:0:9529:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1790740201.433581:0:9529:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1790740201.433594:0:9529:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790740201.433605:0:9529:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb25dda4f4e92d9b3 00000020:01000004:2.0:1790740201.433612:0:9529:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1790740201.433635:0:9529:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.103@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790740201.433640:0:9529:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790740201.433660:0:9529:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1790740201.433689:0:9529:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1790740201.433704:0:9529:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.103@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1790740201.454947:0:9529:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.103@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790740201.454983:0:9529:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.103@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1790740201.454987:0:9529:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790740201.454989:0:9529:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790740201.454990:0:9529:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790740201.454991:0:9529:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790740201.454992:0:9529:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790740201.454993:0:9529:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790740201.454995:0:9529:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790740201.454996:0:9529:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790740201.454997:0:9529:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790740201.454999:0:9529:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790740201.455000:0:9529:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790740201.455004:0:9529:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1790740201.455006:0:9529:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790740201.455008:0:9529:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790740201.455008:0:9529:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790740201.455009:0:9529:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790740201.455014:0:9529:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790740201.455015:0:9529:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790740201.455016:0:9529:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790740201.455017:0:9529:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790740201.455017:0:9529:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790740201.455018:0:9529:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790740201.455019:0:9529:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790740201.455071:0:9529:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1790740201.455092:0:9529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82c89c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9529:1877727021925888:0@lo:253: 00000100:00100000:2.0:1790740201.455162:0:9529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740201.455213:0:9529:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc88738180 going to sleep for 11 seconds 00000100:00100000:0.0:1790740201.455405:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021925888 00000100:00100000:0.0:1790740201.455413:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021925888 00000100:00100000:0.0:1790740201.455480:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1790740201.455489:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:9529:x1877727021925888:12345-0@lo:253: 20000000:01000000:0.0:1790740201.455531:0:6529:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1790740201.455535:0:6529:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1790740201.455540:0:6529:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1790740201.455543:0:6529:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1790740201.455768:0:6529:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790740201.455903:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:0.0:1790740201.455919:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1790740201.455936:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:0.0:1790740201.455943:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1790740201.455954:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:0.0:1790740201.455967:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:0.0:1790740201.456068:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:0.0:1790740201.456084:0:6529:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.103@tcp 20000000:01000000:0.0:1790740201.456086:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.103@tcp (null) (null) (null) 00000040:00080000:0.0:1790740201.456101:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:0.0:1790740201.456107:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1790740201.456122:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:0.0:1790740201.456127:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.103@tcp (null) (null) 00000040:00080000:0.0:1790740201.456140:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:0.0:1790740201.456146:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1790740201.456157:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:0.0:1790740201.456427:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:0.0:1790740201.456501:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:0.0:1790740201.456513:0:6529:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.103@tcp 20000000:01000000:0.0:1790740201.456514:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.103@tcp (null) (null) (null) 00000040:00080000:0.0:1790740201.456529:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:0.0:1790740201.456534:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1790740201.456546:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:0.0:1790740201.456551:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.204.103@tcp (null) (null) 00000040:00080000:0.0:1790740201.456573:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:0.0:1790740201.456579:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1790740201.456606:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:0.0:1790740201.456639:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:0.0:1790740201.461269:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:0.0:1790740201.461303:0:6529:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.103@tcp 20000000:01000000:0.0:1790740201.461306:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.103@tcp (null) (null) (null) 00000040:00080000:0.0:1790740201.461323:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:0.0:1790740201.461330:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1790740201.461417:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:0.0:1790740201.461426:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.103@tcp (null) (null) 00000040:00080000:0.0:1790740201.461442:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:0.0:1790740201.461449:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1790740201.461462:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:0.0:1790740201.461478:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:0.0:1790740201.461492:0:6529:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1790740201.461495:0:6529:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1790740201.461499:0:6529:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1790740201.461545:0:6529:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1790740201.461548:0:6529:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1790740201.472716:0:9535:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:0.0:1790740201.472779:0:9535:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:0.0:1790740201.472800:0:9535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:2.0:1790740201.473175:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:2.0:1790740201.473204:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:2.0:1790740201.473219:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:2.0:1790740201.473230:0:6529:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1790740201.473233:0:6529:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1790740201.479264:0:9536:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 26 1->4: lustre sys.timeout 20000000:01000000:1.0:1790740201.479321:0:9536:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 26 2->4: lustre sys.timeout 00000040:00080000:1.0:1790740201.479333:0:9536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1790740201.479824:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1790740201.479851:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:2.0:1790740201.479867:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:2.0:1790740201.479879:0:6529:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1790740201.479881:0:6529:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1790740201.481358:0:9537:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 27 1->4: lustre sys.timeout 20000000:01000000:1.0:1790740201.481395:0:9537:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 27 2->4: lustre sys.timeout 00000040:00080000:1.0:1790740201.481413:0:9537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:2.0:1790740201.481664:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:2.0:1790740201.481687:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:2.0:1790740201.481727:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:2.0:1790740201.481752:0:6529:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1790740201.481754:0:6529:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1790740201.487340:0:9538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:2.0:1790740201.487652:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:2.0:1790740201.487684:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:2.0:1790740201.487699:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:2.0:1790740201.487712:0:6529:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1790740201.487714:0:6529:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1790740201.488058:0:9539:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:0.0:1790740201.488080:0:9539:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:0.0:1790740201.488114:0:9539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:2.0:1790740201.488296:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:2.0:1790740201.488317:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:2.0:1790740201.488331:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 10000000:01000000:2.0:1790740201.488464:0:6529:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1790740201.488494:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98dc81488400/0xb25dda4f4e92d9ba lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740201.488512:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dca1968c00/0xb25dda4f4e92d8b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d8a9 expref: 21 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740201.488519:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dcb5dc8200/0xb25dda4f4e92d8da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d8d3 expref: 21 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740201.488525:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dc81489000/0xb25dda4f4e92d919 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d912 expref: 21 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740201.488531:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dc81488200/0xb25dda4f4e92d935 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d92e expref: 21 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740201.488538:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dcb5dc8600/0xb25dda4f4e92d95f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d958 expref: 21 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740201.488545:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dcaeee2800/0xb25dda4f4e92d97b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d974 expref: 21 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740201.488552:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dcaeee3800/0xb25dda4f4e92d9a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d99e expref: 21 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740201.488560:0:6529:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98dc81488400/0xb25dda4f4e92d9ba lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740201.488602:0:6529:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dcaeee3800/0xb25dda4f4e92d9a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92d99e expref: 21 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740201.488617:0:6529:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98dcaeee3800/0xb25dda4f4e92d9a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92d99e expref: 21 pid: 6529 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740201.488644:0:6529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82c8b800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6529:1877727021926016:0@lo:104: 00000100:00100000:2.0:1790740201.488718:0:6529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790740201.488880:0:6529:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dcaeee2800/0xb25dda4f4e92d97b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92d974 expref: 21 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740201.488889:0:6529:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98dcaeee2800/0xb25dda4f4e92d97b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92d974 expref: 21 pid: 6529 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740201.488897:0:6529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82c88380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6529:1877727021926144:0@lo:104: 00000100:00100000:2.0:1790740201.488919:0:6529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790740201.490539:0:6529:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dcb5dc8600/0xb25dda4f4e92d95f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92d958 expref: 21 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740201.490555:0:6529:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98dcb5dc8600/0xb25dda4f4e92d95f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92d958 expref: 21 pid: 6528 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740201.490567:0:6529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82c89500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6529:1877727021926272:0@lo:104: 00000100:00100000:2.0:1790740201.490605:0:6529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740201.490730:0:6519:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021926016 00000100:00100000:0.0:1790740201.490747:0:6519:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021926016 00010000:00010000:2.0:1790740201.490863:0:6529:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dc81488200/0xb25dda4f4e92d935 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92d92e expref: 21 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740201.490872:0:6529:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98dc81488200/0xb25dda4f4e92d935 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92d92e expref: 21 pid: 6528 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740201.490881:0:6529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82c88e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6529:1877727021926400:0@lo:104: 00000100:00100000:2.0:1790740201.490904:0:6529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740201.490929:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021926144 00000100:00100000:1.0:1790740201.490933:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021926144 00000100:00100000:1.0:1790740201.490955:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021926272 00000100:00100000:1.0:1790740201.490958:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021926272 00000100:00100000:1.0:1790740201.490972:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790740201.490980:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+5:6529:x1877727021926016:12345-0@lo:104: 00010000:00010000:1.0:1790740201.490992:0:6518:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2e00/0xb25dda4f4e92d99e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d9a5 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.491076:0:6518:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790740201.491092:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+5:6529:x1877727021926016:12345-0@lo:104: Request processed in 113us (2374us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740201.491099:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790740201.491116:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790740201.491121:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82c89180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+4:6529:x1877727021926144:12345-0@lo:104: 00010000:00010000:1.0:1790740201.491129:0:6518:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3200/0xb25dda4f4e92d974 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d97b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.491161:0:6518:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790740201.491166:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82c89180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+4:6529:x1877727021926144:12345-0@lo:104: Request processed in 46us (2247us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740201.491172:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790740201.491185:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790740201.491190:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82c89f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+3:6529:x1877727021926272:12345-0@lo:104: 00010000:00010000:1.0:1790740201.491197:0:6518:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3c00/0xb25dda4f4e92d958 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d95f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.491222:0:6518:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1790740201.491226:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82c89f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+3:6529:x1877727021926272:12345-0@lo:104: Request processed in 37us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740201.491231:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:1.0:1790740201.491249:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790740201.491254:0:6524:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2e00/0xb25dda4f4e92d99e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d9a5 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.491261:0:6524:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee2e00 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:1.0:1790740201.491265:0:6524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2e00/0xb25dda4f4e92d99e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92d9a5 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.491285:0:6524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2e00/0xb25dda4f4e92d99e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92d9a5 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790740201.491293:0:6524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2e00/0xb25dda4f4e92d99e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92d9a5 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740201.491298:0:6524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790740201.491322:0:6524:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2e00/0xb25dda4f4e92d99e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d9a5 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.491328:0:6524:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790740201.491424:0:6524:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2e00/0xb25dda4f4e92d99e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d9a5 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.491433:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2e00/0xb25dda4f4e92d99e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d9a5 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.491446:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790740201.491449:0:6524:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3200/0xb25dda4f4e92d974 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d97b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.491455:0:6524:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee3200 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:1.0:1790740201.491458:0:6524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3200/0xb25dda4f4e92d974 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92d97b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.491464:0:6524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3200/0xb25dda4f4e92d974 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92d97b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790740201.491471:0:6524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3200/0xb25dda4f4e92d974 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92d97b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740201.491482:0:6524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790740201.491496:0:6524:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3200/0xb25dda4f4e92d974 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d97b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.491501:0:6524:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790740201.491506:0:6524:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3200/0xb25dda4f4e92d974 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d97b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.491513:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3200/0xb25dda4f4e92d974 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d97b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.491521:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790740201.491523:0:6524:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3c00/0xb25dda4f4e92d958 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d95f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.491529:0:6524:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee3c00 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:1.0:1790740201.491532:0:6524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3c00/0xb25dda4f4e92d958 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92d95f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.491539:0:6524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3c00/0xb25dda4f4e92d958 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92d95f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790740201.491545:0:6524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3c00/0xb25dda4f4e92d958 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92d95f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740201.491550:0:6524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790740201.491562:0:6524:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3c00/0xb25dda4f4e92d958 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d95f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.491567:0:6524:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790740201.491590:0:6524:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3c00/0xb25dda4f4e92d958 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d95f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.491596:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3c00/0xb25dda4f4e92d958 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d95f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.491604:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740201.491606:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740201.491840:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740201.491856:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727021926528:0@lo:103: 00000100:00100000:1.0:1790740201.491892:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740201.491927:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790740201.491933:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727021926656:0@lo:103: 00000100:00100000:1.0:1790740201.491954:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740201.491979:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790740201.491986:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb81b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3641:1877727021926784:0@lo:103: 00000100:00100000:1.0:1790740201.492008:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740201.492052:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021926528 00000100:00100000:1.0:1790740201.492056:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021926528 00010000:00010000:1.0:1790740201.492075:0:6522:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dcaeee3800/0xb25dda4f4e92d9a5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d99e expref: 22 pid: 6529 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740201.492089:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021926656 00000100:00100000:1.0:1790740201.492091:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021926656 00010000:00010000:1.0:1790740201.492101:0:6522:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dcaeee2800/0xb25dda4f4e92d97b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d974 expref: 23 pid: 6529 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740201.492108:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021926784 00000100:00100000:1.0:1790740201.492110:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021926784 00010000:00010000:1.0:1790740201.492119:0:6522:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dcb5dc8600/0xb25dda4f4e92d95f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d958 expref: 24 pid: 6528 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740201.492143:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790740201.492149:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb81b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3638:x1877727021926528:12345-0@lo:103: 00010000:00010000:1.0:1790740201.492159:0:6522:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740201.492164:0:6522:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dcaeee3800/0xb25dda4f4e92d9a5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d99e expref: 24 pid: 6529 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.492175:0:6522:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dcaeee3800/0xb25dda4f4e92d9a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92d99e expref: 24 pid: 6529 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.492191:0:6522:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740201.492219:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb81b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3638:x1877727021926528:12345-0@lo:103: Request processed in 71us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740201.492226:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790740201.492240:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790740201.492246:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb81b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:3638:x1877727021926656:12345-0@lo:103: 00010000:00010000:1.0:1790740201.492252:0:6522:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740201.492256:0:6522:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dcaeee2800/0xb25dda4f4e92d97b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d974 expref: 23 pid: 6529 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.492264:0:6522:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dcaeee2800/0xb25dda4f4e92d97b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92d974 expref: 23 pid: 6529 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.492273:0:6522:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740201.492293:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb81b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:3638:x1877727021926656:12345-0@lo:103: Request processed in 48us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740201.492299:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790740201.492310:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790740201.492322:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb81b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+22:3641:x1877727021926784:12345-0@lo:103: 00010000:00010000:1.0:1790740201.492330:0:6522:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740201.492335:0:6522:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dcb5dc8600/0xb25dda4f4e92d95f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d958 expref: 22 pid: 6528 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.492343:0:6522:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dcb5dc8600/0xb25dda4f4e92d95f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92d958 expref: 22 pid: 6528 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740201.492462:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740201.492509:0:6522:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740201.492582:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb81b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+22:3641:x1877727021926784:12345-0@lo:103: Request processed in 260us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740201.492589:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790740201.492639:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727021926656:0@lo:103: 00000100:00100000:1.0:1790740201.492648:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727021926528:0@lo:103: 00010000:00010000:2.0:1790740201.492959:0:6529:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dc81489000/0xb25dda4f4e92d919 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92d912 expref: 21 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740201.492982:0:6529:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98dc81489000/0xb25dda4f4e92d919 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92d912 expref: 21 pid: 6529 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740201.492992:0:6529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82c88700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6529:1877727021926912:0@lo:104: 00000100:00100000:2.0:1790740201.493049:0:6529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790740201.493075:0:6529:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dcb5dc8200/0xb25dda4f4e92d8da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92d8d3 expref: 21 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740201.493082:0:6529:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98dcb5dc8200/0xb25dda4f4e92d8da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92d8d3 expref: 21 pid: 6528 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740201.493090:0:6529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f9b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6529:1877727021927040:0@lo:104: 00000100:00100000:2.0:1790740201.493123:0:6529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790740201.493140:0:6529:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dca1968c00/0xb25dda4f4e92d8b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92d8a9 expref: 21 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740201.493147:0:6529:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98dca1968c00/0xb25dda4f4e92d8b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92d8a9 expref: 21 pid: 6528 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740201.493155:0:6529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f99c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6529:1877727021927168:0@lo:104: 00000100:00100000:2.0:1790740201.493172:0:6529:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc887383c0 going to sleep for 11 seconds 00010000:00010000:2.0:1790740201.493186:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcaeee3800/0xb25dda4f4e92d9a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92d99e expref: 21 pid: 6529 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740201.493196:0:6529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82c8b800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6529:1877727021926016:0@lo:104: 00010000:00010000:2.0:1790740201.493205:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcaeee2800/0xb25dda4f4e92d97b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92d974 expref: 20 pid: 6529 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740201.493222:0:6529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82c88380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6529:1877727021926144:0@lo:104: 00010000:00010000:2.0:1790740201.493233:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcb5dc8600/0xb25dda4f4e92d95f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92d958 expref: 19 pid: 6528 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740201.493241:0:6529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82c89500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6529:1877727021926272:0@lo:104: 00000100:00100000:1.0:1790740201.493315:0:6518:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1790740201.493332:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740201.493343:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021926400 00000100:00100000:1.0:1790740201.493359:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021926400 00000100:00100000:1.0:1790740201.493382:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021926912 00000100:00100000:1.0:1790740201.493385:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021926912 00000100:00100000:1.0:1790740201.493393:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021927040 00000100:00100000:1.0:1790740201.493395:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021927040 00000100:00100000:1.0:1790740201.493402:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021927168 00000100:00100000:1.0:1790740201.493404:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021927168 00000100:00100000:1.0:1790740201.493414:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790740201.493420:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+6:6529:x1877727021926400:12345-0@lo:104: 00010000:00010000:1.0:1790740201.493431:0:6518:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff98dca1968a00/0xb25dda4f4e92d92e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d935 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.493490:0:6518:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790740201.493496:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+6:6529:x1877727021926400:12345-0@lo:104: Request processed in 77us (2591us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740201.493502:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790740201.493515:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790740201.493521:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82f98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+5:6529:x1877727021926912:12345-0@lo:104: 00010000:00010000:1.0:1790740201.493529:0:6518:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff98dc81489a00/0xb25dda4f4e92d912 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d919 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.493558:0:6518:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790740201.493563:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82f98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+5:6529:x1877727021926912:12345-0@lo:104: Request processed in 43us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740201.493568:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790740201.493580:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790740201.493585:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82b05450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+4:6529:x1877727021927040:12345-0@lo:104: 00010000:00010000:1.0:1790740201.493592:0:6518:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2200/0xb25dda4f4e92d8d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d8da expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.493629:0:6518:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1790740201.493634:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82b05450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+4:6529:x1877727021927040:12345-0@lo:104: Request processed in 50us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740201.493640:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790740201.493668:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790740201.493674:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb81b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+3:6529:x1877727021927168:12345-0@lo:104: 00010000:00010000:1.0:1790740201.493682:0:6518:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff98dc81489400/0xb25dda4f4e92d8a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d8b0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.493714:0:6518:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1790740201.493720:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb81b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+3:6529:x1877727021927168:12345-0@lo:104: Request processed in 46us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740201.493726:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1790740201.493753:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1790740201.493758:0:6523:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dca1968a00/0xb25dda4f4e92d92e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d935 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.493766:0:6523:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dca1968a00 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:1.0:1790740201.493770:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dca1968a00/0xb25dda4f4e92d92e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92d935 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.493778:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dca1968a00/0xb25dda4f4e92d92e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92d935 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790740201.493784:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dca1968a00/0xb25dda4f4e92d92e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92d935 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740201.493789:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790740201.493813:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dca1968a00/0xb25dda4f4e92d92e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d935 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.493820:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790740201.493829:0:6523:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dca1968a00/0xb25dda4f4e92d92e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d935 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.493835:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dca1968a00/0xb25dda4f4e92d92e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d935 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.493858:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790740201.493861:0:6523:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dc81489a00/0xb25dda4f4e92d912 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d919 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.493866:0:6523:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dc81489a00 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:1.0:1790740201.493869:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dc81489a00/0xb25dda4f4e92d912 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92d919 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.493876:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dc81489a00/0xb25dda4f4e92d912 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92d919 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790740201.493882:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dc81489a00/0xb25dda4f4e92d912 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92d919 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740201.493887:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790740201.493902:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dc81489a00/0xb25dda4f4e92d912 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d919 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.493908:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790740201.493921:0:6523:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dc81489a00/0xb25dda4f4e92d912 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d919 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.493929:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dc81489a00/0xb25dda4f4e92d912 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d919 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.493937:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790740201.493941:0:6523:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2200/0xb25dda4f4e92d8d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d8da expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.493956:0:6523:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee2200 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:1.0:1790740201.493959:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2200/0xb25dda4f4e92d8d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92d8da expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.493965:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2200/0xb25dda4f4e92d8d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92d8da expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790740201.493971:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2200/0xb25dda4f4e92d8d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92d8da expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740201.493976:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790740201.493989:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2200/0xb25dda4f4e92d8d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d8da expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.493995:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790740201.494000:0:6523:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2200/0xb25dda4f4e92d8d3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d8da expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.494006:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2200/0xb25dda4f4e92d8d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d8da expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.494015:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790740201.494018:0:6523:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dc81489400/0xb25dda4f4e92d8a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d8b0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.494023:0:6523:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dc81489400 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:1.0:1790740201.494026:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dc81489400/0xb25dda4f4e92d8a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92d8b0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.494066:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dc81489400/0xb25dda4f4e92d8a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92d8b0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790740201.494072:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dc81489400/0xb25dda4f4e92d8a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92d8b0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740201.494077:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790740201.494092:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dc81489400/0xb25dda4f4e92d8a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d8b0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.494097:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790740201.494102:0:6523:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dc81489400/0xb25dda4f4e92d8a9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d8b0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.494109:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dc81489400/0xb25dda4f4e92d8a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d8b0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.494122:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740201.494124:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740201.494125:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740201.494138:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82c89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3639:1877727021927552:0@lo:103: 00000100:00100000:1.0:1790740201.494168:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740201.494196:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790740201.494202:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3639:1877727021927424:0@lo:103: 00000100:00100000:1.0:1790740201.494223:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740201.494248:0:6520:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021927552 00000100:00100000:1.0:1790740201.494252:0:6520:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021927552 00010000:00010000:1.0:1790740201.494268:0:6520:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dcb5dc8200/0xb25dda4f4e92d8da lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d8d3 expref: 19 pid: 6528 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740201.494298:0:6520:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021927424 00000100:00100000:1.0:1790740201.494302:0:6520:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021927424 00010000:00010000:1.0:1790740201.494315:0:6520:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dc81489000/0xb25dda4f4e92d919 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d912 expref: 20 pid: 6529 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740201.494326:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790740201.494331:0:6520:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc86ac0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+20:3639:x1877727021927552:12345-0@lo:103: 00010000:00010000:1.0:1790740201.494339:0:6520:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740201.494343:0:6520:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dcb5dc8200/0xb25dda4f4e92d8da lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d8d3 expref: 20 pid: 6528 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.494352:0:6520:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dcb5dc8200/0xb25dda4f4e92d8da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92d8d3 expref: 20 pid: 6528 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.494365:0:6520:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740201.494390:0:6520:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc86ac0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+20:3639:x1877727021927552:12345-0@lo:103: Request processed in 60us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740201.494396:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790740201.494427:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790740201.494433:0:6520:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+19:3639:x1877727021927424:12345-0@lo:103: 00010000:00010000:1.0:1790740201.494440:0:6520:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740201.494444:0:6520:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dc81489000/0xb25dda4f4e92d919 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d912 expref: 19 pid: 6529 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.494451:0:6520:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dc81489000/0xb25dda4f4e92d919 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92d912 expref: 19 pid: 6529 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.494461:0:6520:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740201.494488:0:6520:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+19:3639:x1877727021927424:12345-0@lo:103: Request processed in 55us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740201.494493:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790740201.494522:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3639:1877727021927424:0@lo:103: 00000100:00100000:1.0:1790740201.494530:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82c89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3639:1877727021927552:0@lo:103: 00010000:00010000:1.0:1790740201.494547:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740201.494792:0:6529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82c88e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6529:1877727021926400:0@lo:104: 00010000:00010000:2.0:1790740201.494802:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dc81489000/0xb25dda4f4e92d919 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92d912 expref: 18 pid: 6529 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740201.494813:0:6529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82c88700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6529:1877727021926912:0@lo:104: 00010000:00010000:2.0:1790740201.494821:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcb5dc8200/0xb25dda4f4e92d8da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92d8d3 expref: 17 pid: 6528 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740201.494828:0:6529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f9b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6529:1877727021927040:0@lo:104: 00000100:00100000:2.0:1790740201.494835:0:6529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f99c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6529:1877727021927168:0@lo:104: 00010000:00010000:2.0:1790740201.494862:0:6529:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98dc81488400/0xb25dda4f4e92d9ba lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740201.495177:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727021927680:0@lo:103: 00000100:00100000:1.0:1790740201.495209:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740201.495245:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790740201.495253:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb81b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727021927296:0@lo:103: 00000100:00100000:1.0:1790740201.495272:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740201.495296:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021927680 00000100:00100000:1.0:1790740201.495301:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021927680 00010000:00010000:1.0:1790740201.495319:0:6521:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dca1968c00/0xb25dda4f4e92d8b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d8a9 expref: 17 pid: 6528 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740201.495338:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021927296 00000100:00100000:1.0:1790740201.495342:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021927296 00000100:00100000:2.0:1790740201.495438:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790740201.495446:0:6520:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82c89180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:3640:x1877727021927680:12345-0@lo:103: 00010000:00010000:2.0:1790740201.495456:0:6520:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740201.495461:0:6520:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dca1968c00/0xb25dda4f4e92d8b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d8a9 expref: 17 pid: 6528 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740201.495470:0:6520:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dca1968c00/0xb25dda4f4e92d8b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92d8a9 expref: 17 pid: 6528 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740201.495489:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dca1968c00/0xb25dda4f4e92d8b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92d8a9 expref: 17 pid: 6528 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740201.495499:0:6520:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740201.495531:0:6520:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82c89180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:3640:x1877727021927680:12345-0@lo:103: Request processed in 87us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740201.495538:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:1.0:1790740201.495586:0:6521:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dc81488200/0xb25dda4f4e92d935 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d92e expref: 16 pid: 6528 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740201.495726:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790740201.495745:0:6520:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:3640:x1877727021927296:12345-0@lo:103: 00010000:00010000:2.0:1790740201.495754:0:6520:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740201.495759:0:6520:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dc81488200/0xb25dda4f4e92d935 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d92e expref: 16 pid: 6528 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740201.495767:0:6520:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dc81488200/0xb25dda4f4e92d935 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92d92e expref: 16 pid: 6528 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740201.495776:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dc81488200/0xb25dda4f4e92d935 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92d92e expref: 16 pid: 6528 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740201.495786:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98dc81488400/0xb25dda4f4e92d9ba lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740201.495794:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dc81488400/0xb25dda4f4e92d9ba lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740201.495808:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98dc81488400/0xb25dda4f4e92d9ba lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740201.495816:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98dc81488400/0xb25dda4f4e92d9ba lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740201.495829:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98dc81488400/0xb25dda4f4e92d9ba lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740201.495835:0:6520:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98dc81488400/0xb25dda4f4e92d9ba lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740201.495840:0:6520:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dc81488400 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:2.0:1790740201.495844:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98dc81488400/0xb25dda4f4e92d9ba lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740201.495851:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98dc81488400/0xb25dda4f4e92d9ba lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740201.495864:0:6520:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98dc81488400/0xb25dda4f4e92d9ba lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740201.495873:0:6520:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740201.495899:0:6520:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:3640:x1877727021927296:12345-0@lo:103: Request processed in 166us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740201.495905:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1790740201.495923:0:6529:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98dc81488400/0xb25dda4f4e92d9ba lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740201.495931:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98dc81488400/0xb25dda4f4e92d9ba lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740201.495937:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dc81488400/0xb25dda4f4e92d9ba lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790740201.495950:0:6529:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1790740201.496021:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb81b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727021927296:0@lo:103: 00000100:00100000:1.0:1790740201.496059:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727021927680:0@lo:103: 00000100:00100000:3.0:1790740201.496225:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb81b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3641:1877727021926784:0@lo:103: 00000100:00100000:2.0:1790740201.503910:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+14:9529:x1877727021925888:12345-0@lo:253: Request processed in 48412us (48739us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740201.503927:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1790740201.504010:0:9529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82c89c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9529:1877727021925888:0@lo:253: 10000000:01000000:0.0:1790740201.504026:0:9529:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1790740201.504293:0:9529:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790740201.504307:0:9529:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790740201.504308:0:9529:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790740201.504309:0:9529:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1790740201.504311:0:9529:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790740201.504312:0:9529:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790740201.504313:0:9529:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790740201.504315:0:9529:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1790740201.504316:0:9529:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790740201.504317:0:9529:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1790740201.504424:0:9529:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98dcb5f0a000 from lustre-OST0001 10000000:01000000:0.0:1790740201.504455:0:9529:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1790740201.504458:0:9529:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1790740201.504466:0:9529:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98dc992499c0 local copy 10000000:01000000:0.0:1790740201.504470:0:9529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790740201.504507:0:9529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2c00/0xb25dda4f4e92d9c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740201.504519:0:9529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2c00/0xb25dda4f4e92d9c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740201.504529:0:9529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2c00/0xb25dda4f4e92d9c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740201.504546:0:9529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98537480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9529:1877727021927808:0@lo:101: 00000100:00100000:0.0:1790740201.504590:0:9529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740201.504795:0:9529:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcad2f3780 going to sleep for 11 seconds 00000100:00100000:3.0:1790740201.504960:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021927808 00000100:00100000:3.0:1790740201.504968:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021927808 00000100:00100000:3.0:1790740201.505127:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1790740201.505136:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+14:9529:x1877727021927808:12345-0@lo:101: 00010000:00010000:3.0:1790740201.505155:0:6528:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740201.505169:0:6528:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcb5dc8000/0xb25dda4f4e92d9c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92d9c1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740201.505192:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcb5dc8000/0xb25dda4f4e92d9c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92d9c1 expref: 15 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740201.505202:0:6528:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcb5dc8000/0xb25dda4f4e92d9c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d9c1 expref: 15 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740201.505212:0:6528:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc8000, rc 0) 00000100:00100000:3.0:1790740201.505246:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:9529:x1877727021927808:12345-0@lo:101: Request processed in 112us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740201.505252:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1790740201.505321:0:9529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98537480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9529:1877727021927808:0@lo:101: 00010000:00010000:0.0:1790740201.505334:0:9529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2c00/0xb25dda4f4e92d9c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xb25dda4f4e92d9c8 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740201.505343:0:9529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2c00/0xb25dda4f4e92d9c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb25dda4f4e92d9c8 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740201.505449:0:9529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98537480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9529:1877727021927936:0@lo:501: 00000100:00100000:0.0:1790740201.505476:0:9529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740201.506021:0:9529:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcad2f3780 going to sleep for 11 seconds 00000100:00100000:2.0:1790740201.506290:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021927936 00000100:00100000:2.0:1790740201.506296:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021927936 00000100:00100000:2.0:1790740201.506326:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1790740201.506333:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:9529:x1877727021927936:12345-0@lo:501: 00000100:00100000:2.0:1790740201.506473:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:9529:x1877727021927936:12345-0@lo:501: Request processed in 139us (995us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790740201.506480:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1790740201.506778:0:9529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98537480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9529:1877727021927936:0@lo:501: 10000000:01000000:0.0:1790740201.506795:0:9529:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1790740201.506816:0:9529:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1790740201.506823:0:9529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2c00/0xb25dda4f4e92d9c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb25dda4f4e92d9c8 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740201.506832:0:9529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2c00/0xb25dda4f4e92d9c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb25dda4f4e92d9c8 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740201.506840:0:9529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2c00/0xb25dda4f4e92d9c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb25dda4f4e92d9c8 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740201.506867:0:9529:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1790740201.506892:0:9529:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98dcb5f0a000 10000000:01000000:0.0:1790740201.506897:0:9529:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1790740201.506902:0:9529:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1790740201.506904:0:9529:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790740201.506909:0:9529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1790740201.506912:0:9529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1790740201.506932:0:9529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2200/0xb25dda4f4e92d9cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740201.506940:0:9529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2200/0xb25dda4f4e92d9cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740201.506962:0:9529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2200/0xb25dda4f4e92d9cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740201.506978:0:9529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98537480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9529:1877727021928064:0@lo:101: 00000100:00100000:0.0:1790740201.507011:0:9529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740201.507050:0:9529:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc86af0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790740201.507110:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021928064 00000100:00100000:2.0:1790740201.507116:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021928064 00000100:00100000:2.0:1790740201.507135:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1790740201.507141:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:9529:x1877727021928064:12345-0@lo:101: 00010000:00010000:2.0:1790740201.507149:0:6530:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740201.507160:0:6530:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dc81488400/0xb25dda4f4e92d9d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92d9cf expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740201.507177:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dc81488400/0xb25dda4f4e92d9d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92d9cf expref: 16 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740201.507187:0:6530:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dc81488400/0xb25dda4f4e92d9d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d9cf expref: 16 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740201.507194:0:6530:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dc81488400, rc 0) 00000100:00100000:2.0:1790740201.507234:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:9529:x1877727021928064:12345-0@lo:101: Request processed in 93us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740201.507240:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00010000:00010000:2.0:1790740201.507263:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790740201.507274:0:6523:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2c00/0xb25dda4f4e92d9c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xb25dda4f4e92d9c8 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740201.507281:0:6523:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee2c00 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:2.0:1790740201.507284:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2c00/0xb25dda4f4e92d9c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xb25dda4f4e92d9c8 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740201.507292:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2c00/0xb25dda4f4e92d9c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xb25dda4f4e92d9c8 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790740201.507300:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2c00/0xb25dda4f4e92d9c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xb25dda4f4e92d9c8 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740201.507305:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790740201.507322:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2c00/0xb25dda4f4e92d9c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb25dda4f4e92d9c8 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740201.507328:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1790740201.508546:0:9529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98537480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9529:1877727021928064:0@lo:101: 00010000:00010000:0.0:1790740201.508563:0:9529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2200/0xb25dda4f4e92d9cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d9d6 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740201.508573:0:9529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2200/0xb25dda4f4e92d9cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92d9d6 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740201.509479:0:6523:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2c00/0xb25dda4f4e92d9c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb25dda4f4e92d9c8 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740201.509491:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2c00/0xb25dda4f4e92d9c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb25dda4f4e92d9c8 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740201.509509:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740201.509511:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740201.509513:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740201.509524:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790740201.509539:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727021928192:0@lo:103: 00000100:00100000:2.0:1790740201.509592:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740201.509640:0:6520:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021928192 00000100:00100000:0.0:1790740201.509755:0:9529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98537480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9529:1877727021928320:0@lo:501: 00000100:00100000:0.0:1790740201.509782:0:9529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740201.509797:0:9529:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc86af0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790740201.509857:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021928320 00000100:00100000:3.0:1790740201.509864:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021928320 00000100:00100000:3.0:1790740201.509897:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1790740201.509905:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:9529:x1877727021928320:12345-0@lo:501: 00000100:00100000:3.0:1790740201.510048:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:9529:x1877727021928320:12345-0@lo:501: Request processed in 144us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740201.510056:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1790740201.510122:0:6520:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021928192 00000100:00100000:2.0:1790740201.510162:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790740201.510170:0:6520:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82f9b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:3640:x1877727021928192:12345-0@lo:103: 00010000:00010000:2.0:1790740201.510180:0:6520:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740201.510194:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcb5dc8000/0xb25dda4f4e92d9c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb25dda4f4e92d9c1 expref: 16 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740201.510205:0:6520:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740201.510232:0:6520:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82f9b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:3640:x1877727021928192:12345-0@lo:103: Request processed in 64us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740201.510237:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790740201.510263:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727021928192:0@lo:103: 00000100:00100000:0.0:1790740201.510525:0:9529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98537480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9529:1877727021928320:0@lo:501: 00000100:00100000:0.0:1790740201.510556:0:9529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98537480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9529:1877727021928448:0@lo:503: 00000100:00100000:0.0:1790740201.510595:0:9529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740201.510622:0:9529:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc86af0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790740201.510765:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021928448 00000100:00100000:3.0:1790740201.510771:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021928448 00000100:00100000:3.0:1790740201.510801:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1790740201.510808:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:9529:x1877727021928448:12345-0@lo:503: 00000100:00100000:3.0:1790740201.510895:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:9529:x1877727021928448:12345-0@lo:503: Request processed in 87us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740201.510901:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1790740201.510985:0:9529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98537480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9529:1877727021928448:0@lo:503: 00000040:00080000:1.0:1790740201.511267:0:9529:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790740201.511335:0:9529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82c89f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9529:1877727021928576:0@lo:502: 00000100:00100000:1.0:1790740201.511637:0:9529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740201.511762:0:9529:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5deb480 going to sleep for 11 seconds 00000100:00100000:2.0:1790740201.514851:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021928576 00000100:00100000:2.0:1790740201.514867:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021928576 00000100:00100000:2.0:1790740201.515013:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1790740201.515024:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99055c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:9529:x1877727021928576:12345-0@lo:502: 00000100:00100000:2.0:1790740201.515206:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99055c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:9529:x1877727021928576:12345-0@lo:502: Request processed in 183us (3568us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740201.515214:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1790740201.515365:0:9529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82c89f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9529:1877727021928576:0@lo:502: 00000040:00080000:1.0:1790740201.515644:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1790740201.515686:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1790740201.515702:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1790740201.515717:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1790740201.515732:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1790740201.515760:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1790740201.515793:0:9529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82c89f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9529:1877727021928704:0@lo:502: 00000100:00100000:1.0:1790740201.515836:0:9529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740201.516123:0:9529:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82de2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790740201.516225:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021928704 00000100:00100000:3.0:1790740201.516232:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021928704 00000100:00100000:3.0:1790740201.516259:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1790740201.516267:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99057c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:9529:x1877727021928704:12345-0@lo:502: 00000100:00100000:3.0:1790740201.516365:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99057c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:9529:x1877727021928704:12345-0@lo:502: Request processed in 98us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740201.516371:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1790740201.516501:0:9529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82c89f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9529:1877727021928704:0@lo:502: 00000040:00080000:1.0:1790740201.516541:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1790740201.516551:0:9529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:1.0:1790740201.517080:0:9540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790740201.517088:0:9540:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1790740201.517094:0:9540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740201.517096:0:9540:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1790740201.517102:0:9540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790740201.517117:0:9540:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff98dcbd5a3380) 00000020:00000080:1.0:1790740201.517146:0:9540:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:1.0:1790740201.517151:0:9540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790740201.517215:0:9540:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98dcb5f0a000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1790740201.517223:0:9540:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790740201.517227:0:9540:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb25dda4f4e92d9e4 00010000:00010000:1.0:1790740201.522194:0:9540:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:1.0:1790740201.522605:0:9540:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1790740201.526553:0:9540:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1790740201.526940:0:9540:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1790740201.533568:0:9540:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1790740201.534627:0:9540:0:(osd_compat.c:1354:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1790740201.549956:0:9540:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1790740201.556341:0:9540:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1790740201.556366:0:9540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790740201.556373:0:9540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790740201.556375:0:9540:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1790740201.556378:0:9540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790740201.556382:0:9540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790740201.556384:0:9540:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790740201.556387:0:9540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790740201.556389:0:9540:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1790740201.556415:0:9540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790740201.556418:0:9540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790740201.556419:0:9540:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:3.0:1790740201.556422:0:9540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1790740201.556540:0:9529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1790740201.556568:0:9529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1790740201.556583:0:9529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2200/0xb25dda4f4e92d9cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d9d6 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740201.556596:0:9529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2200/0xb25dda4f4e92d9cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d9d6 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740201.556604:0:9529:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98dcb5f0a000 from 1 10000000:01000000:3.0:1790740201.556607:0:9529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790740201.556640:0:9529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8400/0xb25dda4f4e92d9eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740201.556675:0:9529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8400/0xb25dda4f4e92d9eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740201.556687:0:9529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8400/0xb25dda4f4e92d9eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740201.556719:0:9529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82331880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9529:1877727021928832:0@lo:101: 00000100:00100000:3.0:1790740201.556795:0:9529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740201.556831:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021928832 00000100:00100000:3.0:1790740201.556838:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021928832 00000100:00100000:3.0:1790740201.556873:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1790740201.556882:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99057850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:9529:x1877727021928832:12345-0@lo:101: 00010000:00010000:3.0:1790740201.556895:0:6528:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740201.556908:0:6528:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcb5dc8000/0xb25dda4f4e92d9f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92d9eb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740201.556932:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcb5dc8000/0xb25dda4f4e92d9f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92d9eb expref: 16 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740201.556943:0:6528:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcb5dc8000/0xb25dda4f4e92d9f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d9eb expref: 16 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740201.556951:0:6528:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc8000, rc 0) 00000100:00100000:3.0:1790740201.556985:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99057850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:9529:x1877727021928832:12345-0@lo:101: Request processed in 104us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740201.556991:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1790740201.557047:0:9529:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82274780 going to sleep for 11 seconds 00000100:00100000:3.0:1790740201.557068:0:9529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82331880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9529:1877727021928832:0@lo:101: 00010000:00010000:3.0:1790740201.557088:0:9529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8400/0xb25dda4f4e92d9eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d9f2 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740201.557097:0:9529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8400/0xb25dda4f4e92d9eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92d9f2 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740201.557174:0:9529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82331880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9529:1877727021928960:0@lo:501: 00000100:00100000:3.0:1790740201.557197:0:9529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740201.557217:0:9529:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82274780 going to sleep for 11 seconds 00000100:00100000:0.0:1790740201.557292:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021928960 00000100:00100000:0.0:1790740201.557296:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021928960 00000100:00100000:0.0:1790740201.557326:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1790740201.557333:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99054c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:9529:x1877727021928960:12345-0@lo:501: 00000100:00100000:0.0:1790740201.557438:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99054c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:9529:x1877727021928960:12345-0@lo:501: Request processed in 106us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740201.557444:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1790740201.558097:0:9529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82331880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9529:1877727021928960:0@lo:501: 00000100:00100000:3.0:1790740201.558124:0:9529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82331880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9529:1877727021929088:0@lo:503: 00000100:00100000:3.0:1790740201.558889:0:9529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740201.558927:0:9529:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82274780 going to sleep for 11 seconds 00000100:00100000:0.0:1790740201.560270:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021929088 00000100:00100000:0.0:1790740201.560281:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021929088 00000100:00100000:0.0:1790740201.560330:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1790740201.560338:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99055450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:9529:x1877727021929088:12345-0@lo:503: 00000100:00100000:0.0:1790740201.561781:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99055450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:9529:x1877727021929088:12345-0@lo:503: Request processed in 1439us (2888us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740201.561792:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1790740201.561864:0:9529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82331880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9529:1877727021929088:0@lo:503: 00000040:00080000:0.0:1790740201.562524:0:9529:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790740201.562616:0:9529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98534e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9529:1877727021929216:0@lo:502: 00000100:00100000:0.0:1790740201.562813:0:9529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740201.562890:0:9529:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc985dab40 going to sleep for 11 seconds 00000100:00100000:3.0:1790740201.565917:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021929216 00000100:00100000:3.0:1790740201.565931:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021929216 00000100:00100000:3.0:1790740201.565989:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1790740201.565998:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99056850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:9529:x1877727021929216:12345-0@lo:502: 00000100:00100000:3.0:1790740201.566182:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99056850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:9529:x1877727021929216:12345-0@lo:502: Request processed in 185us (3369us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740201.566190:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1790740201.566401:0:9529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98534e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9529:1877727021929216:0@lo:502: 00000040:00080000:1.0:1790740201.566618:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1790740201.566666:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1790740201.566832:0:9529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82c89f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9529:1877727021929344:0@lo:502: 00000100:00100000:1.0:1790740201.566877:0:9529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740201.566914:0:9529:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82de2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790740201.566970:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021929344 00000100:00100000:0.0:1790740201.566975:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021929344 00000100:00100000:0.0:1790740201.567013:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1790740201.567020:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99054450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:9529:x1877727021929344:12345-0@lo:502: 00000100:00100000:0.0:1790740201.567131:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99054450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:9529:x1877727021929344:12345-0@lo:502: Request processed in 111us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740201.567138:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1790740201.567441:0:9529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82c89f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9529:1877727021929344:0@lo:502: 00000040:00080000:1.0:1790740201.567484:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1790740201.567492:0:9529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1790740201.568001:0:9544:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790740201.568010:0:9544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740201.568013:0:9544:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790740201.568020:0:9544:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98dcb5f0a000 00000020:00000080:1.0:1790740201.568022:0:9544:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790740201.568078:0:9544:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790740201.568082:0:9544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740201.568083:0:9544:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1790740201.568086:0:9544:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1790740201.568495:0:9529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1790740201.568523:0:9529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790740201.568547:0:9529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8400/0xb25dda4f4e92d9eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d9f2 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740201.568559:0:9529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8400/0xb25dda4f4e92d9eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d9f2 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740201.568614:0:9529:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790740201.568616:0:9529:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98dcb5f0a000 10000000:01000000:3.0:1790740201.568619:0:9529:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98dcb5f0a000 10000000:01000000:3.0:1790740201.568622:0:9529:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790740201.568627:0:9529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98dcb5f0a000 from 1 10000000:01000000:3.0:1790740201.568630:0:9529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790740201.568671:0:9529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8200/0xb25dda4f4e92d9f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740201.568679:0:9529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8200/0xb25dda4f4e92d9f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740201.568689:0:9529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8200/0xb25dda4f4e92d9f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740201.568802:0:9529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82333100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9529:1877727021929472:0@lo:101: 00000100:00100000:3.0:1790740201.568852:0:9529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740201.568922:0:9529:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82274600 going to sleep for 11 seconds 00000100:00100000:0.0:1790740201.576260:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021929472 00000100:00100000:0.0:1790740201.576275:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021929472 00000100:00100000:0.0:1790740201.576392:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1790740201.576403:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99057450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:9529:x1877727021929472:12345-0@lo:101: 00010000:00010000:0.0:1790740201.576434:0:6529:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740201.576451:0:6529:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcaeee3c00/0xb25dda4f4e92da00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92d9f9 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740201.576480:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcaeee3c00/0xb25dda4f4e92da00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92d9f9 expref: 17 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740201.576492:0:6529:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcaeee3c00/0xb25dda4f4e92da00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d9f9 expref: 17 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740201.576501:0:6529:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaeee3c00, rc 0) 00000100:00100000:0.0:1790740201.576577:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99057450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:9529:x1877727021929472:12345-0@lo:101: Request processed in 176us (7724us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740201.576584:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1790740201.577593:0:9529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82333100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9529:1877727021929472:0@lo:101: 00010000:00010000:0.0:1790740201.577615:0:9529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8200/0xb25dda4f4e92d9f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92da00 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740201.577626:0:9529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8200/0xb25dda4f4e92d9f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92da00 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740201.577843:0:9529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98535880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9529:1877727021929600:0@lo:501: 00000100:00100000:0.0:1790740201.577888:0:9529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740201.577969:0:9529:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc985da0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790740201.578011:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021929600 00000100:00100000:3.0:1790740201.578017:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021929600 00000100:00100000:0.0:1790740201.578188:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790740201.578200:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727021929728:0@lo:13: 00000100:00100000:0.0:1790740201.578269:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740201.578444:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021929728 00000100:00100000:2.0:1790740201.578449:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021929728 00000100:00100000:2.0:1790740201.578498:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790740201.578507:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc98535180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727021929728:12345-0@lo:13: 00002000:00000024:2.0:1790740201.578550:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790740201.578591:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc98535180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727021929728:12345-0@lo:13: Request processed in 86us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740201.578598:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1790740201.578672:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790740201.578711:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98db82f99c00 x1877727021929728/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740217 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740201.578726:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727021929728:0@lo:13: 00000100:00100000:3.0:1790740201.579001:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1790740201.579010:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99056c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:9529:x1877727021929600:12345-0@lo:501: 00000100:00100000:3.0:1790740201.579135:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99056c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:9529:x1877727021929600:12345-0@lo:501: Request processed in 127us (1247us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740201.579142:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1790740201.579298:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877727021929984:0@lo:400: 00000100:00100000:1.0:1790740201.579331:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740201.579365:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82c88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021930496:0@lo:400: 00000100:00100000:1.0:1790740201.579386:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740201.579424:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790740201.579429:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021930112:0@lo:400: 00000100:00100000:1.0:1790740201.579450:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740201.579478:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021929984 00000100:00100000:1.0:1790740201.579490:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021929984 00000100:00100000:1.0:1790740201.579523:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790740201.579529:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82c8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877727021929984:12345-0@lo:400: 00000100:00100000:1.0:1790740201.579566:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82c8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877727021929984:12345-0@lo:400: Request processed in 37us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740201.579573:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790740201.579589:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021930496 00000100:00100000:1.0:1790740201.579593:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021930496 00000100:00100000:1.0:1790740201.579624:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790740201.579631:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb81b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021930496:12345-0@lo:400: 00000100:00100000:1.0:1790740201.579673:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb81b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021930496:12345-0@lo:400: Request processed in 43us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740201.579679:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790740201.579709:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021930112 00000100:00100000:1.0:1790740201.579713:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021930112 00000100:00100000:1.0:1790740201.579749:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790740201.579755:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb81b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021930112:12345-0@lo:400: 00000100:00100000:1.0:1790740201.579786:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb81b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021930112:12345-0@lo:400: Request processed in 31us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740201.579792:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1790740201.579811:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790740201.579826:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82c88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877727021930240:0@lo:400: 00000100:00100000:1.0:1790740201.579851:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740201.579870:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1790740201.579875:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727021929856:0@lo:400: 00000100:00100000:1.0:1790740201.579895:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740201.579913:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82c89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1877727021930368:0@lo:400: 00000100:00100000:1.0:1790740201.579943:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740201.579966:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021930240 00000100:00100000:1.0:1790740201.579970:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021930240 00000100:00100000:1.0:1790740201.579994:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021929856 00000100:00100000:1.0:1790740201.579997:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021929856 00000100:00100000:1.0:1790740201.580007:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021930368 00000100:00100000:1.0:1790740201.580010:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021930368 00000100:00100000:1.0:1790740201.580022:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790740201.580049:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb81b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877727021930240:12345-0@lo:400: 00000100:00100000:1.0:1790740201.580086:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb81b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877727021930240:12345-0@lo:400: Request processed in 59us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740201.580093:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790740201.580105:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790740201.580111:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb81b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727021929856:12345-0@lo:400: 00000100:00100000:1.0:1790740201.580138:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb81b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727021929856:12345-0@lo:400: Request processed in 28us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740201.580144:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790740201.580154:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790740201.580159:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb81b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877727021930368:12345-0@lo:400: 00000100:00100000:1.0:1790740201.580184:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb81b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877727021930368:12345-0@lo:400: Request processed in 25us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740201.580190:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1790740201.580209:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790740201.580212:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1790740201.580233:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98db82c89f80 x1877727021929856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740217 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740201.580244:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727021929856:0@lo:400: 00010000:00080000:1.0:1790740201.580264:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98db82c89500 x1877727021930368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740217 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740201.580271:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82c89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1877727021930368:0@lo:400: 00010000:00080000:1.0:1790740201.580279:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98db82c88e00 x1877727021930240/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740217 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740201.580286:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82c88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877727021930240:0@lo:400: 00000100:00100000:1.0:1790740201.580312:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021930112:0@lo:400: 00010000:00080000:1.0:1790740201.580320:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98db82c89c00 x1877727021929984/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740217 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740201.580327:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877727021929984:0@lo:400: 00010000:00080000:1.0:1790740201.580336:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98db82c88380 x1877727021930496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740217 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740201.580343:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82c88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021930496:0@lo:400: 00000100:00100000:0.0:1790740201.580943:0:9529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98535880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9529:1877727021929600:0@lo:501: 00000100:00100000:0.0:1790740201.580981:0:9529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98535880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9529:1877727021930624:0@lo:503: 00000100:00100000:0.0:1790740201.581055:0:9529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740201.581082:0:9529:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc985da0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790740201.581204:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021930624 00000100:00100000:1.0:1790740201.581209:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021930624 00000100:00100000:1.0:1790740201.581242:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1790740201.581248:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99057050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:9529:x1877727021930624:12345-0@lo:503: 00000100:00100000:1.0:1790740201.581334:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99057050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:9529:x1877727021930624:12345-0@lo:503: Request processed in 85us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740201.581341:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1790740201.581485:0:9529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98535880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9529:1877727021930624:0@lo:503: 00000040:00080000:0.0:1790740201.582142:0:9529:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790740201.582225:0:9529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98535880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9529:1877727021930752:0@lo:502: 00000100:00100000:0.0:1790740201.582266:0:9529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740201.582295:0:9529:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc985da0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790740201.582389:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021930752 00000100:00100000:3.0:1790740201.582394:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021930752 00000100:00100000:3.0:1790740201.582973:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1790740201.582992:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99055050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:9529:x1877727021930752:12345-0@lo:502: 00000100:00100000:3.0:1790740201.583154:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99055050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:9529:x1877727021930752:12345-0@lo:502: Request processed in 164us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740201.583172:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1790740201.583278:0:9529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98535880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9529:1877727021930752:0@lo:502: 00000100:00100000:1.0:1790740201.583585:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021930880:0@lo:13: 00000100:00100000:1.0:1790740201.583628:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1790740201.583830:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1790740201.583859:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1790740201.583874:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1790740201.583888:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1790740201.583902:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1790740201.583914:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1790740201.583927:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1790740201.583941:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1790740201.583954:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1790740201.583968:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1790740201.583982:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1790740201.583996:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1790740201.584007:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1790740201.584018:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1790740201.584055:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1790740201.584072:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1790740201.584085:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1790740201.584097:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1790740201.584109:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1790740201.584121:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1790740201.584146:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000100:00100000:2.0:1790740201.584252:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021930880 00000100:00100000:2.0:1790740201.584258:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021930880 00000100:00100000:2.0:1790740201.584294:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790740201.584301:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82c88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021930880:12345-0@lo:13: 00002000:00000024:2.0:1790740201.584319:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790740201.584375:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82c88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021930880:12345-0@lo:13: Request processed in 74us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740201.584381:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1790740201.584509:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98db82f9aa00 x1877727021930880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740217 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740201.584527:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021930880:0@lo:13: 00000040:00080000:1.0:1790740201.584553:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1790740201.584574:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1790740201.584589:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1790740201.584602:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1790740201.584616:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1790740201.584629:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1790740201.584644:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1790740201.584659:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1790740201.584686:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1790740201.584701:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1790740201.584716:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1790740201.584730:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1790740201.584757:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1790740201.584774:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1790740201.584790:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1790740201.584816:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:1.0:1790740201.584829:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1790740201.584842:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:1.0:1790740201.584856:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:1.0:1790740201.584871:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:1.0:1790740201.584886:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:1.0:1790740201.584899:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:1.0:1790740201.584912:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:1.0:1790740201.584925:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:1.0:1790740201.584938:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:1.0:1790740201.584965:0:9529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82c89c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9529:1877727021931008:0@lo:502: 00000100:00100000:1.0:1790740201.585009:0:9529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740201.585545:0:9529:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82de2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790740201.585621:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021931008 00000100:00100000:0.0:1790740201.585627:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021931008 00000100:00100000:0.0:1790740201.585672:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1790740201.585680:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99056450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:9529:x1877727021931008:12345-0@lo:502: 00000100:00100000:0.0:1790740201.586127:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99056450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:9529:x1877727021931008:12345-0@lo:502: Request processed in 446us (1116us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740201.586134:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1790740201.586325:0:9529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82c89c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9529:1877727021931008:0@lo:502: 00000040:00080000:1.0:1790740201.586395:0:9529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:1.0:1790740201.586407:0:9529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:1.0:1790740201.586980:0:9545:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1790740201.586997:0:9545:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff98dcbd5a19c0) 00000020:00000080:1.0:1790740201.587019:0:9545:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:1.0:1790740201.587130:0:9545:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98dcb5f0a000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1790740201.587135:0:9545:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98dcb5f0a000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1790740201.587137:0:9545:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98dcb5f0a000 3 00010000:00080000:1.0:1790740201.587177:0:9545:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98db82ff7000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.103@tcp at head 00010000:00010000:3.0:1790740201.589820:0:9545:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:3.0:1790740201.590023:0:9545:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1790740201.590111:0:9545:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790740201.590123:0:9545:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xb25dda4f4e92da0e 00000100:00080000:3.0:1790740201.590133:0:9545:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790740201.590144:0:9545:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98db82ff7000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:3.0:1790740201.593410:0:9545:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98db82333100 x1877727021931136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790740201.593437:0:9545:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000020:01000004:0.0:1790740201.594192:0:9545:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1790740201.594208:0:9545:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff98dcb6c6cd40) 00000020:00000080:0.0:1790740201.594234:0:9545:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:0.0:1790740201.594333:0:9545:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98dcb5f0a000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1790740201.594337:0:9545:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98dcb5f0a000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1790740201.594339:0:9545:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98dcb5f0a000 3 00010000:00080000:0.0:1790740201.594381:0:9545:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98db82fd8800@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.103@tcp at head 00000100:00100000:2.0:1790740201.595335:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1877727021931136:0@lo:38: 00000100:00100000:2.0:1790740201.595409:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740201.596400:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021931136 00000100:00100000:1.0:1790740201.596417:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021931136 00000100:00100000:1.0:1790740201.596457:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790740201.596464:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82f9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1877727021931136:12345-0@lo:38: 00010000:00080000:1.0:1790740201.596489:0:6535:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 272 last 0 00000020:00000080:1.0:1790740201.596519:0:6535:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xb25dda4f4e92da1c 00000004:00100000:1.0:1790740201.596535:0:6535:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790740201.596569:0:6535:0:(import.c:65:import_set_state_nolock()) ffff98db82ff0000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1790740201.596622:0:9547:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff98db82331880 x1877727021931264/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740201.596633:0:9547:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82274f00 going to sleep for 0 seconds 00010000:00010000:0.0:1790740201.598276:0:9545:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:0.0:1790740201.598934:0:9545:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1790740201.598977:0:9545:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790740201.598990:0:9545:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xb25dda4f4e92da23 00000100:00080000:0.0:1790740201.598999:0:9545:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790740201.600519:0:9545:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff98db82fd8800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:0.0:1790740201.600566:0:9545:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98dc98535880 x1877727021931392/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790740201.600619:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82f9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1877727021931136:12345-0@lo:38: Request processed in 4152us (5207us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740201.600631:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1790740201.607237:0:9545:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000040:00080000:1.0:1790740201.609420:0:9545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:0.0:1790740201.609551:0:9529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:0.0:1790740201.609582:0:9529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790740201.609644:0:9529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8200/0xb25dda4f4e92d9f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92da00 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740201.609667:0:9529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8200/0xb25dda4f4e92d9f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92da00 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1790740201.609718:0:9529:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1790740201.609720:0:9529:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790740201.609721:0:9529:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790740201.609722:0:9529:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790740201.609723:0:9529:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790740201.609725:0:9529:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790740201.609726:0:9529:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790740201.609727:0:9529:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790740201.609729:0:9529:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790740201.609730:0:9529:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790740201.609742:0:9529:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790740201.609746:0:9529:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1790740201.609748:0:9529:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790740201.609750:0:9529:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790740201.609751:0:9529:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790740201.609752:0:9529:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790740201.609753:0:9529:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790740201.609760:0:9529:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790740201.609761:0:9529:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790740201.609762:0:9529:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790740201.609763:0:9529:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790740201.609764:0:9529:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790740201.609765:0:9529:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790740201.609792:0:9529:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1790740201.609810:0:9529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98534e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9529:1877727021931520:0@lo:253: 00000100:00100000:0.0:1790740201.609880:0:9529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740201.609922:0:9529:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc985da9c0 going to sleep for 11 seconds 00010000:00080000:3.0:1790740201.610712:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98db82333100 x1877727021931136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790740211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740201.610724:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790740201.610743:0:3637:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1790740201.610750:0:3637:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1790740201.610754:0:3637:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1790740201.610758:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98db82ff7000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1790740201.610765:0:3637:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000008cecad54): req@ffff98db82331880 x1877727021931264/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740201.610790:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1877727021931136:0@lo:38: 00000100:00100000:3.0:1790740201.610824:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98535880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1877727021931392:0@lo:38: 00000100:00100000:3.0:1790740201.610865:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740201.611053:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021931520 00000100:00100000:1.0:1790740201.611061:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021931520 00000100:00100000:1.0:1790740201.611102:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1790740201.611113:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99056050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:9529:x1877727021931520:12345-0@lo:253: 20000000:01000000:1.0:1790740201.611143:0:6528:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1790740201.611157:0:6528:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1790740201.611279:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021931392 00000100:00100000:1.0:1790740201.611283:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021931392 00000100:00100000:1.0:1790740201.611307:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790740201.611312:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82333100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1877727021931392:12345-0@lo:38: 00010000:00080000:1.0:1790740201.611331:0:6537:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 272 last 0 00000020:00000080:1.0:1790740201.611376:0:6537:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xb25dda4f4e92da2a 00000004:00100000:1.0:1790740201.611393:0:6537:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790740201.611423:0:6537:0:(import.c:65:import_set_state_nolock()) ffff98db82ff4800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790740201.611479:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82333100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1877727021931392:12345-0@lo:38: Request processed in 166us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740201.611493:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1790740201.611555:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98dc98535880 x1877727021931392/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790740211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740201.611564:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790740201.611569:0:3637:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1790740201.611574:0:3637:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1790740201.611577:0:3637:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1790740201.611579:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98db82fd8800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790740201.611584:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98535880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1877727021931392:0@lo:38: 00000100:00100000:0.0:1790740201.611867:0:9547:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740201.611894:0:9547:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82274f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790740201.611983:0:6547:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021931264 00000100:00100000:1.0:1790740201.611988:0:6547:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021931264 00000100:00080000:0.0:1790740201.612095:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790740201.612152:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790740201.612172:0:6547:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc98537480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9547:x1877727021931264:12345-0@lo:901: 00000100:00100000:1.0:1790740201.612254:0:6547:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc98537480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9547:x1877727021931264:12345-0@lo:901: Request processed in 96us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740201.612262:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1790740201.612426:0:9547:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98db82331880 x1877727021931264/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1790740217 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740201.612436:0:9547:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82331880 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9547:1877727021931264:0@lo:901: 20000000:01000000:1.0:1790740201.624506:0:6528:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790740201.624530:0:6528:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1790740201.624993:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99056050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:9529:x1877727021931520:12345-0@lo:253: Request processed in 13878us (15109us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740201.625006:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 20000000:01000000:0.0:1790740201.625072:0:6551:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1790740201.625078:0:6551:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1790740201.625098:0:6551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98dcaeee3200/0xb25dda4f4e92da31 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740201.625115:0:6551:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dcaeee3400/0xb25dda4f4e92d927 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d920 expref: 16 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740201.625123:0:6551:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dcb5dc9e00/0xb25dda4f4e92d96d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d966 expref: 16 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740201.625131:0:6551:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98dcaeee3200/0xb25dda4f4e92da31 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740201.625164:0:9529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98534e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9529:1877727021931520:0@lo:253: 10000000:01000000:2.0:1790740201.625179:0:9529:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1790740201.625182:0:9529:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00010000:00010000:0.0:1790740201.625182:0:6551:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dcb5dc9e00/0xb25dda4f4e92d96d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92d966 expref: 16 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790740201.625184:0:9529:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790740201.625186:0:9529:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790740201.625187:0:9529:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790740201.625188:0:9529:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790740201.625189:0:9529:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790740201.625191:0:9529:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790740201.625192:0:9529:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790740201.625193:0:9529:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790740201.625195:0:9529:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790740201.625196:0:9529:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790740201.625210:0:9529:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1790740201.625212:0:6551:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98dcb5dc9e00/0xb25dda4f4e92d96d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92d966 expref: 16 pid: 6528 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740201.625225:0:6551:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98535880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6551:1877727021931648:0@lo:104: 00000100:00100000:0.0:1790740201.625263:0:6551:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790740201.625309:0:6551:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dcaeee3400/0xb25dda4f4e92d927 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92d920 expref: 16 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740201.625317:0:6551:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98dcaeee3400/0xb25dda4f4e92d927 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92d920 expref: 16 pid: 6530 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740201.625324:0:6551:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefd8a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6551:1877727021931776:0@lo:104: 00000100:00100000:0.0:1790740201.625343:0:6551:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740201.625368:0:6551:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc985da240 going to sleep for 11 seconds 00000100:00100000:3.0:1790740201.625452:0:6519:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021931648 00000100:00100000:3.0:1790740201.625460:0:6519:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021931648 00000100:00100000:3.0:1790740201.625490:0:6519:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021931776 00000100:00100000:3.0:1790740201.625493:0:6519:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021931776 00000100:00100000:3.0:1790740201.625505:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790740201.625513:0:6519:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc98534e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+4:6551:x1877727021931648:12345-0@lo:104: 00010000:00010000:3.0:1790740201.625526:0:6519:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9000/0xb25dda4f4e92d966 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d96d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740201.625578:0:6519:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790740201.625584:0:6519:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc98534e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+4:6551:x1877727021931648:12345-0@lo:104: Request processed in 72us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740201.625590:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790740201.625604:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790740201.625614:0:6551:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98535880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6551:1877727021931648:0@lo:104: 00000100:00100000:3.0:1790740201.625622:0:6519:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb8138a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+3:6551:x1877727021931776:12345-0@lo:104: 00010000:00010000:3.0:1790740201.625630:0:6519:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff98dc81489e00/0xb25dda4f4e92d920 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d927 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740201.625685:0:6519:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790740201.625690:0:6519:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb8138a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+3:6551:x1877727021931776:12345-0@lo:104: Request processed in 81us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740201.625696:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790740201.625812:0:6551:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefd8a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6551:1877727021931776:0@lo:104: 00010000:00010000:0.0:1790740201.625827:0:6551:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98dcaeee3200/0xb25dda4f4e92da31 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.625843:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790740201.625850:0:6524:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9000/0xb25dda4f4e92d966 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d96d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.625857:0:6524:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc9000 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:1.0:1790740201.625868:0:6524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9000/0xb25dda4f4e92d966 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92d96d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.625877:0:6524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9000/0xb25dda4f4e92d966 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92d96d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790740201.625885:0:6524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9000/0xb25dda4f4e92d966 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92d96d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740201.625891:0:6524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790740201.625924:0:6524:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9000/0xb25dda4f4e92d966 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d96d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.625932:0:6524:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1790740201.625979:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727021931904:0@lo:103: 00000100:00100000:3.0:1790740201.626006:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790740201.626087:0:6524:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9000/0xb25dda4f4e92d966 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d96d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.626094:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9000/0xb25dda4f4e92d966 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d96d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.626104:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790740201.626107:0:6524:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dc81489e00/0xb25dda4f4e92d920 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d927 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.626111:0:6524:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dc81489e00 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:1.0:1790740201.626114:0:6524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dc81489e00/0xb25dda4f4e92d920 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92d927 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.626121:0:6524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dc81489e00/0xb25dda4f4e92d920 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92d927 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790740201.626136:0:6524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dc81489e00/0xb25dda4f4e92d920 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92d927 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740201.626141:0:6524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790740201.626157:0:6524:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dc81489e00/0xb25dda4f4e92d920 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d927 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.626162:0:6524:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1790740201.626226:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021931904 00000100:00100000:0.0:1790740201.626230:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021931904 00010000:00010000:0.0:1790740201.626248:0:6522:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dcb5dc9e00/0xb25dda4f4e92d96d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d966 expref: 17 pid: 6528 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740201.626301:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790740201.626309:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82330a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:3638:x1877727021931904:12345-0@lo:103: 00010000:00010000:0.0:1790740201.626320:0:6522:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740201.626330:0:6522:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dcb5dc9e00/0xb25dda4f4e92d96d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d966 expref: 17 pid: 6528 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740201.626339:0:6522:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dcb5dc9e00/0xb25dda4f4e92d96d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92d966 expref: 17 pid: 6528 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740201.626352:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcb5dc9e00/0xb25dda4f4e92d96d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92d966 expref: 17 pid: 6528 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740201.626362:0:6522:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790740201.629916:0:6524:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dc81489e00/0xb25dda4f4e92d920 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d927 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.629935:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dc81489e00/0xb25dda4f4e92d920 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d927 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.629958:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740201.629960:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740201.629962:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740201.629987:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3639:1877727021932032:0@lo:103: 00000100:00100000:1.0:1790740201.630095:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740201.630178:0:6521:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1790740201.630188:0:6521:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1790740201.630302:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021932032 00000100:00100000:1.0:1790740201.630310:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021932032 00010000:00010000:1.0:1790740201.630339:0:6521:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dcaeee3400/0xb25dda4f4e92d927 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d920 expref: 17 pid: 6530 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740201.630486:0:6521:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1790740201.630495:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790740201.630504:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82c88e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:3639:x1877727021932032:12345-0@lo:103: 00010000:00010000:1.0:1790740201.630532:0:6521:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740201.630538:0:6521:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dcaeee3400/0xb25dda4f4e92d927 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d920 expref: 17 pid: 6530 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.630550:0:6521:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dcaeee3400/0xb25dda4f4e92d927 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92d920 expref: 17 pid: 6530 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.630567:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcaeee3400/0xb25dda4f4e92d927 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92d920 expref: 17 pid: 6530 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.630581:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98dcaeee3200/0xb25dda4f4e92da31 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.630590:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcaeee3200/0xb25dda4f4e92da31 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790740201.630605:0:6521:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009541360s 00010000:00010000:1.0:1790740201.630748:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98dcaeee3200/0xb25dda4f4e92da31 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.630756:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98dcaeee3200/0xb25dda4f4e92da31 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.630763:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98dcaeee3200/0xb25dda4f4e92da31 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.630771:0:6521:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98dcaeee3200/0xb25dda4f4e92da31 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.630778:0:6521:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee3200 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:1.0:1790740201.630782:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98dcaeee3200/0xb25dda4f4e92da31 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.630797:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98dcaeee3200/0xb25dda4f4e92da31 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.630816:0:6521:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98dcaeee3200/0xb25dda4f4e92da31 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740201.630827:0:6521:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740201.630856:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82330a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:3638:x1877727021931904:12345-0@lo:103: Request processed in 4547us (4847us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740201.630861:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82c88e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:3639:x1877727021932032:12345-0@lo:103: Request processed in 360us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740201.630866:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790740201.630868:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790740201.630903:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3639:1877727021932032:0@lo:103: 00010000:00010000:0.0:1790740201.630977:0:6551:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98dcaeee3200/0xb25dda4f4e92da31 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740201.630987:0:6551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98dcaeee3200/0xb25dda4f4e92da31 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740201.630992:0:6551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcaeee3200/0xb25dda4f4e92da31 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740201.631075:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1790740201.632803:0:9529:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1790740201.632968:0:9529:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1790740201.633321:0:9529:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1790740201.633547:0:9529:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00000100:00100000:3.0:1790740201.633730:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727021931904:0@lo:103: 00080000:10000000:2.0:1790740201.633962:0:9529:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1790740201.634522:0:9529:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:3.0:1790740201.636318:0:9529:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1790740201.645018:0:9529:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1790740201.645028:0:9529:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1790740201.645129:0:9529:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1790740201.645174:0:9529:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.103@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1790740201.645193:0:9529:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1790740201.645220:0:9529:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1790740201.646102:0:9529:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790740201.646271:0:9529:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1790740201.964886:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1790740202.898746:0:9602:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790740202.899521:0:9602:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1790740202.986284:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740204.015209:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740204.140136:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021932160:0@lo:41: 00000100:00100000:2.0:1790740204.140201:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740204.140282:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021932160 00000100:00100000:2.0:1790740204.140289:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021932160 00000100:00100000:2.0:1790740204.140335:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790740204.140343:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82f9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021932160:12345-0@lo:41: 00000004:00000024:2.0:1790740204.140379:0:6540:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1790740204.140470:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82f9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021932160:12345-0@lo:41: Request processed in 127us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740204.140478:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790740204.140539:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021932160:0@lo:41: 00010000:00010000:2.0:1790740205.035768:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740206.058465:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740206.187326:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021932288:0@lo:41: 00000100:00100000:0.0:1790740206.187410:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740206.187578:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021932288 00000100:00100000:3.0:1790740206.187587:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021932288 00000100:00100000:3.0:1790740206.187638:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790740206.187659:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaefd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021932288:12345-0@lo:41: 00000004:00000024:3.0:1790740206.187693:0:6541:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1790740206.187743:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaefd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021932288:12345-0@lo:41: Request processed in 96us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740206.187750:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790740206.187842:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021932288:0@lo:41: 00000100:00100000:2.0:1790740206.698449:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3639:1877727021932416:0@lo:400: 00000100:00100000:1.0:1790740206.698502:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877727021932800:0@lo:400: 00000100:00100000:1.0:1790740206.698552:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740206.698602:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021933312:0@lo:400: 00000100:00100000:3.0:1790740206.698616:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021932544:0@lo:13: 00000100:00100000:1.0:1790740206.698631:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740206.698670:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740206.698685:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1790740206.698695:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82c89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877727021932672:0@lo:400: 00000100:00100000:3.0:1790740206.698701:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021932928:0@lo:400: 00000100:00100000:1.0:1790740206.698731:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740206.698741:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740206.698755:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1877727021933184:0@lo:400: 00000100:00100000:3.0:1790740206.698768:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021933440:0@lo:400: 00000100:00100000:1.0:1790740206.698786:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740206.698801:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740206.698810:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5df3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1877727021933696:0@lo:400: 00000100:00100000:3.0:1790740206.698830:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1790740206.698838:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877727021933056:0@lo:400: 00000100:00100000:1.0:1790740206.698864:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740206.698881:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740206.698900:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1877727021933568:0@lo:400: 00000100:00100000:1.0:1790740206.698904:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021932800 00000100:00100000:1.0:1790740206.698912:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021932800 00000100:00100000:3.0:1790740206.698932:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740206.698956:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021932672 00000100:00100000:1.0:1790740206.698967:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021932672 00000100:00100000:3.0:1790740206.698979:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021932544 00000100:00100000:3.0:1790740206.698985:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021932544 00000100:00100000:1.0:1790740206.698990:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021933184 00000100:00100000:1.0:1790740206.698995:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021933184 00000100:00100000:2.0:1790740206.699180:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740206.699494:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021933696 00000100:00100000:1.0:1790740206.699498:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021933696 00000100:00100000:1.0:1790740206.699516:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021933056 00000100:00100000:1.0:1790740206.699519:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021933056 00000100:00100000:1.0:1790740206.699541:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021933568 00000100:00100000:1.0:1790740206.699544:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021933568 00000100:00100000:3.0:1790740206.699562:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790740206.699567:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790740206.699578:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877727021932800:12345-0@lo:400: 00000100:00100000:3.0:1790740206.699588:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82330380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021932544:12345-0@lo:13: 00002000:00000024:3.0:1790740206.699626:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790740206.699652:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877727021932800:12345-0@lo:400: Request processed in 77us (1099us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740206.699660:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790740206.699679:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790740206.699686:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82330380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021932544:12345-0@lo:13: Request processed in 112us (1016us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740206.699688:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877727021932672:12345-0@lo:400: 00000100:00100000:3.0:1790740206.699700:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790740206.699724:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877727021932672:12345-0@lo:400: Request processed in 38us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740206.699730:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021932416 00000100:00100000:1.0:1790740206.699731:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790740206.699737:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021932416 00000100:00100000:1.0:1790740206.699747:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790740206.699756:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1877727021933184:12345-0@lo:400: 00000100:00100000:3.0:1790740206.699771:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1790740206.699783:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99054050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:3639:x1877727021932416:12345-0@lo:400: 00000100:00100000:1.0:1790740206.699783:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1877727021933184:12345-0@lo:400: Request processed in 27us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740206.699796:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790740206.699809:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790740206.699816:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1877727021933696:12345-0@lo:400: 00000100:00100000:3.0:1790740206.699836:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99054050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:3639:x1877727021932416:12345-0@lo:400: Request processed in 56us (1303us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740206.699844:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1790740206.699853:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1877727021933696:12345-0@lo:400: Request processed in 36us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740206.699870:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790740206.699883:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790740206.699889:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82331880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877727021933056:12345-0@lo:400: 00000100:00100000:1.0:1790740206.699920:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82331880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877727021933056:12345-0@lo:400: Request processed in 30us (1040us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740206.699926:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790740206.699942:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790740206.699950:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ce2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877727021933568:12345-0@lo:400: 00000100:00100000:1.0:1790740206.699994:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ce2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877727021933568:12345-0@lo:400: Request processed in 45us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740206.699999:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790740206.700019:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021933312 00000100:00100000:1.0:1790740206.700023:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021933312 00000100:00100000:1.0:1790740206.700141:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021933440 00000100:00100000:1.0:1790740206.700146:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021933440 00000100:00100000:1.0:1790740206.700161:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790740206.700167:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021933312:12345-0@lo:400: 00000100:00100000:1.0:1790740206.700198:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021933312:12345-0@lo:400: Request processed in 31us (1568us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740206.700203:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790740206.700215:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790740206.700221:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82332d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021933440:12345-0@lo:400: 00000100:00100000:1.0:1790740206.700252:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82332d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021933440:12345-0@lo:400: Request processed in 32us (1453us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740206.700259:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1790740206.700311:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db82c89500 x1877727021932672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740206.700332:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82c89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877727021932672:0@lo:400: 00010000:00080000:1.0:1790740206.700347:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcb5f6df80 x1877727021933184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740206.700355:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1877727021933184:0@lo:400: 00010000:00080000:1.0:1790740206.700366:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcb5df3b80 x1877727021933696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740206.700374:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5df3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1877727021933696:0@lo:400: 00010000:00080000:1.0:1790740206.700385:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db82c89f80 x1877727021932800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740206.700392:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877727021932800:0@lo:400: 00010000:00080000:1.0:1790740206.700400:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcb5f6c380 x1877727021933312/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740206.700407:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021933312:0@lo:400: 00010000:00080000:3.0:1790740206.701824:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcb5f6d180 x1877727021933056/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740206.701840:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877727021933056:0@lo:400: 00010000:00080000:3.0:1790740206.704490:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcb5f6e680 x1877727021933568/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740206.704517:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1877727021933568:0@lo:400: 00010000:00080000:3.0:1790740206.704552:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db82f9a680 x1877727021932544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740222 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740206.704572:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021932544:0@lo:13: 00000100:00080000:2.0:1790740206.705862:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790740206.705909:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021932928 00000100:00100000:2.0:1790740206.705920:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021932928 00000100:00100000:2.0:1790740206.705981:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790740206.705992:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021932928:12345-0@lo:400: 00010000:00080000:3.0:1790740206.706423:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcb5f6ea00 x1877727021933440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740206.706437:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021932928:12345-0@lo:400: Request processed in 445us (7695us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740206.706440:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021933440:0@lo:400: 00000100:00100000:2.0:1790740206.706449:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790740206.706484:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021932928:0@lo:400: 00000100:00100000:1.0:1790740206.718633:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3639:1877727021932416:0@lo:400: 00000100:00080000:1.0:1790740206.718680:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790740206.718687:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790740206.722604:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790740206.723281:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021933824:0@lo:13: 00000100:00100000:3.0:1790740206.723362:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740206.723670:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021933824 00000100:00100000:3.0:1790740206.723679:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021933824 00000100:00100000:3.0:1790740206.723726:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790740206.723735:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ce2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021933824:12345-0@lo:13: 00002000:00000024:3.0:1790740206.723759:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790740206.723805:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ce2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021933824:12345-0@lo:13: Request processed in 71us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740206.723812:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1790740206.724538:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db82f9b800 x1877727021933824/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740222 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740206.724561:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021933824:0@lo:13: 00010000:00010000:2.0:1790740207.086498:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790740207.732368:0:6532:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1790740207.732377:0:6532:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98dcaedda800 from 39 10000000:01000000:0.0:1790740207.732383:0:6532:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790740207.732427:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2800/0xb25dda4f4e92da38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740207.732440:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2800/0xb25dda4f4e92da38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740207.732452:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2800/0xb25dda4f4e92da38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740207.732477:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98535880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021933952:0@lo:101: 00000100:00100000:0.0:1790740207.732546:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740207.732614:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82c983c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740207.732714:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021933952 00000100:00100000:2.0:1790740207.732723:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021933952 00000100:00100000:2.0:1790740207.732774:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1790740207.732785:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99055850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:6532:x1877727021933952:12345-0@lo:101: 00010000:00010000:2.0:1790740207.732797:0:6528:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740207.732809:0:6528:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dc81489200/0xb25dda4f4e92da3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92da38 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740207.732847:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dc81489200/0xb25dda4f4e92da3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92da38 expref: 16 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740207.732856:0:6528:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dc81489200/0xb25dda4f4e92da3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92da38 expref: 16 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740207.732865:0:6528:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dc81489200, rc 0) 00000100:00100000:2.0:1790740207.732907:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99055850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:6532:x1877727021933952:12345-0@lo:101: Request processed in 125us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740207.732915:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1790740207.732961:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98535880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021933952:0@lo:101: 00010000:00010000:2.0:1790740207.732975:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2800/0xb25dda4f4e92da38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92da3f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740207.732983:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2800/0xb25dda4f4e92da38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92da3f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740207.733064:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f9bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021934080:0@lo:501: 00000100:00100000:2.0:1790740207.733088:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740207.733102:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82e52540 going to sleep for 11 seconds 00000100:00100000:2.0:1790740207.733116:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021934080 00000100:00100000:2.0:1790740207.733120:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021934080 00000100:00100000:2.0:1790740207.733141:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1790740207.733148:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99054850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:6532:x1877727021934080:12345-0@lo:501: 00000100:00100000:2.0:1790740207.733396:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99054850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:6532:x1877727021934080:12345-0@lo:501: Request processed in 247us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740207.733403:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1790740207.733441:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f9bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021934080:0@lo:501: 00000100:00100000:2.0:1790740207.733466:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f9bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021934208:0@lo:503: 00000100:00100000:2.0:1790740207.733505:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740207.733518:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82e52540 going to sleep for 11 seconds 00000100:00100000:2.0:1790740207.733529:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021934208 00000100:00100000:2.0:1790740207.733533:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021934208 00000100:00100000:2.0:1790740207.733552:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1790740207.733558:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:6532:x1877727021934208:12345-0@lo:503: 00000100:00100000:2.0:1790740207.733777:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:6532:x1877727021934208:12345-0@lo:503: Request processed in 218us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740207.733783:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1790740207.733822:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f9bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021934208:0@lo:503: 00000100:00100000:2.0:1790740207.734004:0:9793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f9bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9793:1877727021934336:0@lo:502: 00000100:00100000:2.0:1790740207.734066:0:9793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740207.734084:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021934336 00000100:00100000:2.0:1790740207.734087:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021934336 00000100:00100000:2.0:1790740207.734106:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1790740207.734113:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:9793:x1877727021934336:12345-0@lo:502: 00000100:00100000:2.0:1790740207.734186:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:9793:x1877727021934336:12345-0@lo:502: Request processed in 73us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740207.734193:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1790740207.734221:0:9793:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcaec6d780 going to sleep for 11 seconds 00000100:00100000:2.0:1790740207.735886:0:9793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f9bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9793:1877727021934336:0@lo:502: 00000100:00100000:2.0:1790740207.735953:0:9793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f9bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9793:1877727021934464:0@lo:502: 00000100:00100000:2.0:1790740207.736010:0:9793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740207.736124:0:9793:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcaec6d780 going to sleep for 11 seconds 00000100:00100000:0.0:1790740207.751178:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021934464 00000100:00100000:0.0:1790740207.751196:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021934464 00000100:00100000:0.0:1790740207.751284:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1790740207.751294:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:9793:x1877727021934464:12345-0@lo:502: 00000100:00100000:0.0:1790740207.751484:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:9793:x1877727021934464:12345-0@lo:502: Request processed in 191us (15472us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740207.751492:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1790740207.751693:0:9793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f9bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9793:1877727021934464:0@lo:502: 00000040:00080000:3.0:1790740207.751730:0:9793:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1790740207.751874:0:6532:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1790740207.751895:0:6532:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790740207.751905:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2800/0xb25dda4f4e92da38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92da3f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740207.751925:0:6532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2800/0xb25dda4f4e92da38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92da3f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740207.751936:0:6532:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1790740207.751939:0:6532:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1790740207.751942:0:6532:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1790740207.751975:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2e00/0xb25dda4f4e92da46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740207.751984:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2e00/0xb25dda4f4e92da46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740207.751994:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2e00/0xb25dda4f4e92da46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740207.752014:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98535880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021934592:0@lo:101: 00000100:00100000:0.0:1790740207.752086:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740207.752114:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82c989c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790740207.752139:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021934592 00000100:00100000:0.0:1790740207.752143:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021934592 00000100:00100000:0.0:1790740207.752165:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1790740207.752171:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:6532:x1877727021934592:12345-0@lo:101: 00010000:00010000:0.0:1790740207.752180:0:6529:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740207.752192:0:6529:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcaeee3200/0xb25dda4f4e92da4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92da46 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740207.752213:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcaeee3200/0xb25dda4f4e92da4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92da46 expref: 17 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740207.752249:0:6529:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcaeee3200/0xb25dda4f4e92da4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92da46 expref: 17 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740207.752258:0:6529:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaeee3200, rc 0) 00000100:00100000:0.0:1790740207.752290:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:6532:x1877727021934592:12345-0@lo:101: Request processed in 118us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740207.752296:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1790740207.752327:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98535880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021934592:0@lo:101: 00010000:00010000:0.0:1790740207.752340:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2e00/0xb25dda4f4e92da46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92da4d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740207.752349:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2e00/0xb25dda4f4e92da46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92da4d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740207.752394:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98535880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021934720:0@lo:501: 00000100:00100000:0.0:1790740207.752418:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740207.752431:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82c989c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790740207.752440:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021934720 00000100:00100000:0.0:1790740207.752444:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021934720 00000100:00100000:0.0:1790740207.752459:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1790740207.752464:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:6532:x1877727021934720:12345-0@lo:501: 00000100:00100000:0.0:1790740207.752562:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:6532:x1877727021934720:12345-0@lo:501: Request processed in 97us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740207.752569:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1790740207.752595:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98535880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021934720:0@lo:501: 00000100:00100000:0.0:1790740207.752635:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98535880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021934848:0@lo:503: 00000100:00100000:0.0:1790740207.752674:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740207.752687:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82c989c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790740207.752698:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021934848 00000100:00100000:0.0:1790740207.752701:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021934848 00000100:00100000:0.0:1790740207.752717:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1790740207.752722:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:6532:x1877727021934848:12345-0@lo:503: 00000100:00100000:0.0:1790740207.752786:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:6532:x1877727021934848:12345-0@lo:503: Request processed in 63us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740207.752792:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1790740207.752829:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98535880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021934848:0@lo:503: 00000100:00100000:0.0:1790740207.767941:0:9794:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98535880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9794:1877727021934976:0@lo:502: 00000100:00100000:0.0:1790740207.768179:0:9794:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740207.768350:0:9794:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82c98600 going to sleep for 11 seconds 00000100:00100000:3.0:1790740207.768399:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021934976 00000100:00100000:3.0:1790740207.768406:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021934976 00000100:00100000:3.0:1790740207.768457:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1790740207.768466:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:9794:x1877727021934976:12345-0@lo:502: 00000100:00100000:3.0:1790740207.768586:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:9794:x1877727021934976:12345-0@lo:502: Request processed in 120us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740207.768594:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1790740207.768924:0:9794:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98535880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9794:1877727021934976:0@lo:502: 00000020:01000000:0.0:1790740207.768953:0:9794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790740207.768963:0:9794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740207.768965:0:9794:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790740207.768970:0:9794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790740207.768972:0:9794:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1790740207.769865:0:9794:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98535880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9794:1877727021935104:0@lo:502: 00000100:00100000:0.0:1790740207.769926:0:9794:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740207.769972:0:9794:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82c98600 going to sleep for 11 seconds 00000100:00100000:3.0:1790740207.770604:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021935104 00000100:00100000:3.0:1790740207.770613:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021935104 00000100:00100000:3.0:1790740207.770671:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1790740207.770686:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:9794:x1877727021935104:12345-0@lo:502: 00000100:00100000:3.0:1790740207.770797:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:9794:x1877727021935104:12345-0@lo:502: Request processed in 112us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740207.770816:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1790740207.770925:0:9794:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98535880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9794:1877727021935104:0@lo:502: 00000020:01000000:0.0:1790740207.770952:0:9794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790740207.770958:0:9794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740207.770960:0:9794:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:0.0:1790740207.770964:0:9794:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1790740207.771609:0:6532:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1790740207.771639:0:6532:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1790740207.771649:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2e00/0xb25dda4f4e92da46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92da4d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740207.771662:0:6532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2e00/0xb25dda4f4e92da46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92da4d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740207.771672:0:6532:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1790740207.771674:0:6532:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98dca0cb4800 from 39 10000000:01000000:3.0:1790740207.771677:0:6532:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790740207.771706:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9200/0xb25dda4f4e92da54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740207.771716:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9200/0xb25dda4f4e92da54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740207.771726:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9200/0xb25dda4f4e92da54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740207.771742:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ce2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021935232:0@lo:101: 00000100:00100000:3.0:1790740207.771780:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740207.771819:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5fbfe40 going to sleep for 11 seconds 00000100:00100000:1.0:1790740207.771919:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021935232 00000100:00100000:1.0:1790740207.771925:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021935232 00000100:00100000:1.0:1790740207.771963:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1790740207.771971:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:6532:x1877727021935232:12345-0@lo:101: 00010000:00010000:1.0:1790740207.771991:0:6528:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740207.772004:0:6528:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dca1968a00/0xb25dda4f4e92da5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92da54 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740207.772068:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dca1968a00/0xb25dda4f4e92da5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92da54 expref: 18 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740207.772079:0:6528:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dca1968a00/0xb25dda4f4e92da5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92da54 expref: 18 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740207.772087:0:6528:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dca1968a00, rc 0) 00000100:00100000:1.0:1790740207.772121:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+18:6532:x1877727021935232:12345-0@lo:101: Request processed in 152us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740207.772127:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1790740207.772158:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ce2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021935232:0@lo:101: 00010000:00010000:1.0:1790740207.772169:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9200/0xb25dda4f4e92da54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92da5b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740207.772178:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9200/0xb25dda4f4e92da54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92da5b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740207.772239:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021935360:0@lo:501: 00000100:00100000:1.0:1790740207.772265:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740207.772280:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb62b0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790740207.772292:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021935360 00000100:00100000:1.0:1790740207.772296:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021935360 00000100:00100000:1.0:1790740207.772318:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1790740207.772324:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+18:6532:x1877727021935360:12345-0@lo:501: 00000100:00100000:1.0:1790740207.772637:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+18:6532:x1877727021935360:12345-0@lo:501: Request processed in 311us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740207.772645:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1790740207.772683:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021935360:0@lo:501: 00000100:00100000:1.0:1790740207.772709:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021935488:0@lo:503: 00000100:00100000:1.0:1790740207.772749:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740207.772763:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb62b0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790740207.772774:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021935488 00000100:00100000:1.0:1790740207.772778:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021935488 00000100:00100000:1.0:1790740207.772796:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1790740207.772802:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+18:6532:x1877727021935488:12345-0@lo:503: 00000100:00100000:1.0:1790740207.772877:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+18:6532:x1877727021935488:12345-0@lo:503: Request processed in 75us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740207.772884:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1790740207.772920:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021935488:0@lo:503: 00000100:00100000:1.0:1790740207.773410:0:9795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9795:1877727021935616:0@lo:502: 00000100:00100000:1.0:1790740207.773450:0:9795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740207.773469:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021935616 00000100:00100000:1.0:1790740207.773472:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021935616 00000100:00100000:1.0:1790740207.773493:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1790740207.773498:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+18:9795:x1877727021935616:12345-0@lo:502: 00000100:00100000:1.0:1790740207.773569:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+18:9795:x1877727021935616:12345-0@lo:502: Request processed in 70us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740207.773575:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1790740207.773605:0:9795:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb62b0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790740207.773628:0:9795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9795:1877727021935616:0@lo:502: 00000100:00100000:1.0:1790740207.773666:0:9795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9795:1877727021935744:0@lo:502: 00000100:00100000:1.0:1790740207.773697:0:9795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740207.773720:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021935744 00000100:00100000:1.0:1790740207.773724:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021935744 00000100:00100000:1.0:1790740207.773742:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1790740207.773747:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+18:9795:x1877727021935744:12345-0@lo:502: 00000100:00100000:1.0:1790740207.773800:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+18:9795:x1877727021935744:12345-0@lo:502: Request processed in 52us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740207.773807:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1790740207.773833:0:9795:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc99069840 going to sleep for 11 seconds 00000100:00100000:1.0:1790740207.773843:0:9795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9795:1877727021935744:0@lo:502: 00000040:00080000:1.0:1790740207.773860:0:9795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1790740207.773904:0:6532:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1790740207.773920:0:6532:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790740207.773928:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9200/0xb25dda4f4e92da54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92da5b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740207.773936:0:6532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9200/0xb25dda4f4e92da54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92da5b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740207.773945:0:6532:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790740207.773947:0:6532:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98dca0cb4800 from 6 10000000:01000000:1.0:1790740207.773950:0:6532:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790740207.773973:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dca1968c00/0xb25dda4f4e92da62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740207.773981:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dca1968c00/0xb25dda4f4e92da62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740207.773988:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dca1968c00/0xb25dda4f4e92da62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740207.774008:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021935872:0@lo:101: 00000100:00100000:1.0:1790740207.774921:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740207.774957:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc99069840 going to sleep for 11 seconds 00000100:00100000:0.0:1790740207.775296:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021935872 00000100:00100000:0.0:1790740207.775303:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021935872 00000100:00100000:0.0:1790740207.775348:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1790740207.775357:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+18:6532:x1877727021935872:12345-0@lo:101: 00010000:00010000:0.0:1790740207.775370:0:6528:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740207.775388:0:6528:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcaeee3400/0xb25dda4f4e92da69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92da62 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740207.775408:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcaeee3400/0xb25dda4f4e92da69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92da62 expref: 19 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740207.775418:0:6528:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcaeee3400/0xb25dda4f4e92da69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92da62 expref: 19 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740207.775425:0:6528:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaeee3400, rc 0) 00000100:00100000:0.0:1790740207.775473:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+19:6532:x1877727021935872:12345-0@lo:101: Request processed in 119us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740207.775479:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1790740207.775519:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021935872:0@lo:101: 00010000:00010000:0.0:1790740207.775535:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dca1968c00/0xb25dda4f4e92da62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92da69 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740207.775543:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dca1968c00/0xb25dda4f4e92da62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92da69 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740207.775595:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98535880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021936000:0@lo:256: 00000100:00100000:0.0:1790740207.775642:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740207.775664:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82c986c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790740207.775675:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021936000 00000100:00100000:0.0:1790740207.775684:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021936000 00000100:00100000:0.0:1790740207.775699:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1790740207.775704:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+19:6532:x1877727021936000:12345-0@lo:256: 20000000:01000000:0.0:1790740207.775716:0:6528:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790740207.775730:0:6528:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790740207.775733:0:6528:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1790740207.775803:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+19:6532:x1877727021936000:12345-0@lo:256: Request processed in 98us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740207.775810:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1790740207.775851:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98535880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021936000:0@lo:256: 10000000:01000000:0.0:1790740207.775890:0:6532:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790740207.775896:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dca1968c00/0xb25dda4f4e92da62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92da69 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740207.775905:0:6532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dca1968c00/0xb25dda4f4e92da62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92da69 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740207.775912:0:6532:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1790740207.775915:0:6532:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:0.0:1790740207.775917:0:6532:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1790740207.775933:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2c00/0xb25dda4f4e92da70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740207.775940:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2c00/0xb25dda4f4e92da70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740207.775947:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2c00/0xb25dda4f4e92da70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740207.775957:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98535880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021936128:0@lo:101: 00000100:00100000:0.0:1790740207.776000:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740207.776014:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82c986c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790740207.776025:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021936128 00000100:00100000:0.0:1790740207.776386:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021936128 00000100:00100000:0.0:1790740207.776408:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1790740207.776415:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+19:6532:x1877727021936128:12345-0@lo:101: 00010000:00010000:0.0:1790740207.776422:0:6528:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740207.776433:0:6528:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcaeee3800/0xb25dda4f4e92da77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92da70 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740207.776446:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcaeee3800/0xb25dda4f4e92da77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92da70 expref: 20 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740207.776454:0:6528:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcaeee3800/0xb25dda4f4e92da77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92da70 expref: 20 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740207.776460:0:6528:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaeee3800, rc 0) 00000100:00100000:0.0:1790740207.776491:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+20:6532:x1877727021936128:12345-0@lo:101: Request processed in 77us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740207.776497:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1790740207.776526:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98535880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021936128:0@lo:101: 00010000:00010000:0.0:1790740207.776536:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2c00/0xb25dda4f4e92da70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92da77 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740207.776543:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2c00/0xb25dda4f4e92da70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92da77 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740207.776588:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98535880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021936256:0@lo:501: 00000100:00100000:0.0:1790740207.776633:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740207.776652:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82c986c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790740207.776661:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021936256 00000100:00100000:0.0:1790740207.776665:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021936256 00000100:00100000:0.0:1790740207.776679:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1790740207.776684:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+20:6532:x1877727021936256:12345-0@lo:501: 00000100:00100000:0.0:1790740207.776776:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+20:6532:x1877727021936256:12345-0@lo:501: Request processed in 91us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740207.776782:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1790740207.776805:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98535880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021936256:0@lo:501: 00000100:00100000:0.0:1790740207.776828:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98535880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021936384:0@lo:503: 00000100:00100000:0.0:1790740207.776932:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740207.776946:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82c986c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790740207.776956:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021936384 00000100:00100000:0.0:1790740207.776959:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021936384 00000100:00100000:0.0:1790740207.776975:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1790740207.777178:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+20:6532:x1877727021936384:12345-0@lo:503: 00000100:00100000:0.0:1790740207.777529:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+20:6532:x1877727021936384:12345-0@lo:503: Request processed in 547us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740207.777536:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1790740207.785853:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98535880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021936384:0@lo:503: 00000100:00100000:2.0:1790740207.786488:0:9796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f98380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9796:1877727021936512:0@lo:502: 00000100:00100000:2.0:1790740207.786571:0:9796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740207.786625:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021936512 00000100:00100000:2.0:1790740207.786632:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021936512 00000100:00100000:2.0:1790740207.786676:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1790740207.786686:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+20:9796:x1877727021936512:12345-0@lo:502: 00000100:00100000:2.0:1790740207.786805:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+20:9796:x1877727021936512:12345-0@lo:502: Request processed in 120us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740207.786813:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1790740207.801587:0:9796:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcaec6d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740207.801655:0:9796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f98380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9796:1877727021936512:0@lo:502: 00000020:01000000:2.0:1790740207.801697:0:9796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790740207.801706:0:9796:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1790740207.801714:0:9796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740207.801717:0:9796:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1790740207.801722:0:9796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790740207.801726:0:9796:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.103@tcp to nid 0x20000c0a8cc67 (192.168.204.103@tcp) 00000020:01000000:2.0:1790740207.801752:0:9796:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1790740207.801755:0:9796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790740207.801772:0:9796:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff98dcbc2399c0) 00000020:00000080:2.0:1790740207.801796:0:9796:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1790740207.801802:0:9796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790740207.801913:0:9796:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1790740207.801919:0:9796:0:(osd_handler.c:8931:osd_obd_connect()) connect #5 00000020:00000080:2.0:1790740207.801926:0:9796:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb25dda4f4e92da85 00010000:00080000:2.0:1790740207.801957:0:9796:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98db83c5c000@lustre-OST0001-osc-MDT0001: add connection 192.168.204.103@tcp at head 00010000:00010000:2.0:1790740207.802213:0:9796:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:2.0:1790740207.802349:0:9796:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1790740207.802362:0:9796:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1790740207.803096:0:9796:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790740207.803224:0:9796:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790740207.803362:0:9796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1790740207.803451:0:9796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1790740207.816146:0:9800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790740207.816156:0:9800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1790740207.819451:0:9796:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1790740207.819466:0:9796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1790740207.819508:0:9796:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1790740207.819536:0:9796:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb25dda4f4e92da8c 00000100:00080000:1.0:1790740207.819546:0:9796:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790740207.819558:0:9796:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff98db83c5c000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:1.0:1790740207.819593:0:9796:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98db83cc4700 x1877727021936640/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790740207.819633:0:9796:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1790740207.819688:0:9796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790740207.819692:0:9796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740207.819694:0:9796:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1790740207.819697:0:9796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790740207.819701:0:9796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740207.819702:0:9796:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790740207.819705:0:9796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790740207.819707:0:9796:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1790740207.819708:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877727021936640:0@lo:8: 00000100:00100000:1.0:1790740207.819729:0:9796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9796:1877727021936768:0@lo:502: 00000100:00100000:2.0:1790740207.819779:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740207.819779:0:9796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740207.819859:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021936768 00000100:00100000:0.0:1790740207.819868:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021936768 00000100:00100000:0.0:1790740207.819909:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1790740207.819918:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+20:9796:x1877727021936768:12345-0@lo:502: 00000100:00100000:0.0:1790740207.820066:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+20:9796:x1877727021936768:12345-0@lo:502: Request processed in 148us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740207.820081:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1790740207.820215:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790740207.820226:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021937280:0@lo:400: 00000100:00100000:0.0:1790740207.820255:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740207.820286:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877727021937152:0@lo:400: 00000100:00100000:0.0:1790740207.820318:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740207.820342:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021937792:0@lo:400: 00000100:00100000:0.0:1790740207.820362:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740207.820378:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790740207.820383:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021937664:0@lo:400: 00000100:00100000:0.0:1790740207.820403:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740207.820429:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021937152 00000100:00100000:0.0:1790740207.820433:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021937152 00000100:00100000:0.0:1790740207.820461:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790740207.820468:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877727021937152:12345-0@lo:400: 00000100:00100000:2.0:1790740207.820475:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021937280 00000100:00100000:2.0:1790740207.820479:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021937280 00000100:00100000:0.0:1790740207.820502:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877727021937152:12345-0@lo:400: Request processed in 35us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740207.820504:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790740207.820509:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790740207.820510:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc98535880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021937280:12345-0@lo:400: 00000100:00100000:0.0:1790740207.820524:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021936640 00000100:00100000:0.0:1790740207.820528:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021936640 00000100:00100000:0.0:1790740207.820538:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021937792 00000100:00100000:0.0:1790740207.820540:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021937792 00000100:00100000:2.0:1790740207.820543:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc98535880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021937280:12345-0@lo:400: Request processed in 34us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740207.820549:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790740207.820553:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021937664 00000100:00100000:0.0:1790740207.820555:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021937664 00000100:00100000:0.0:1790740207.820566:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790740207.820572:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021937792:12345-0@lo:400: 00000100:00100000:0.0:1790740207.820603:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021937792:12345-0@lo:400: Request processed in 31us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740207.820626:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790740207.820638:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790740207.820643:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021937664:12345-0@lo:400: 00000100:00100000:0.0:1790740207.820670:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021937664:12345-0@lo:400: Request processed in 27us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740207.820674:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790740207.820683:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790740207.820686:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82f98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3637:x1877727021936640:12345-0@lo:8: 00010000:00080000:0.0:1790740207.820707:0:8454:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 279 last 0 00000020:00000080:0.0:1790740207.820729:0:8454:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb25dda4f4e92da93 00002000:00100000:0.0:1790740207.820742:0:8454:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff98db82fd9000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b03 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1790740207.820746:0:8454:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:0.0:1790740207.820750:0:8454:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1790740207.820805:0:8454:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1790740207.821056:0:8454:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1790740207.821081:0:8454:0:(import.c:65:import_set_state_nolock()) ffff98dcb81fe800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790740207.821124:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82f98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3637:x1877727021936640:12345-0@lo:8: Request processed in 435us (1345us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740207.821130:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1790740207.821172:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db82f98a80 x1877727021937664/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740207.821186:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021937664:0@lo:400: 00010000:00080000:0.0:1790740207.821197:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db82f98700 x1877727021937792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1790740207.821202:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83cc4700 x1877727021936640/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790740217 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740207.821205:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021937792:0@lo:400: 00000100:00100000:2.0:1790740207.821210:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790740207.821216:0:3637:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00100000:0.0:1790740207.821220:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021937280:0@lo:400: 00000100:00080000:2.0:1790740207.821222:0:3637:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1790740207.821227:0:3637:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00010000:00080000:0.0:1790740207.821228:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db82f99f80 x1877727021937152/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790740207.821230:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98db83c5c000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790740207.821236:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877727021937152:0@lo:400: 00000004:00080000:2.0:1790740207.821241:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1790740207.821245:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877727021936640:0@lo:8: 00000004:00080000:2.0:1790740207.821263:0:9800:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1790740207.821322:0:9800:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 279107289676ns, next at 0ns, rc = 0 00080000:00080000:2.0:1790740207.821328:0:9800:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1790740207.821374:0:9801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f9a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9801:1877727021938176:0@lo:700: 00000100:00100000:2.0:1790740207.821403:0:9801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740207.821422:0:9801:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcaec6dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1790740207.822063:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727021936896:0@lo:400: 00000100:00100000:3.0:1790740207.822104:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740207.822139:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877727021937408:0@lo:400: 00000100:00100000:3.0:1790740207.822161:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740207.822177:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1877727021937920:0@lo:400: 00000100:00100000:3.0:1790740207.822197:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740207.822217:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1790740207.822235:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021937024:0@lo:400: 00000100:00100000:3.0:1790740207.822259:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740207.822286:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1877727021937536:0@lo:400: 00000100:00100000:3.0:1790740207.822304:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740207.822320:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1877727021938048:0@lo:400: 00000100:00100000:3.0:1790740207.822337:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740207.822633:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021936896 00000100:00100000:3.0:1790740207.822642:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021936896 00000100:00100000:3.0:1790740207.822675:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021937408 00000100:00100000:3.0:1790740207.822677:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021937408 00000100:00100000:3.0:1790740207.822689:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021937920 00000100:00100000:3.0:1790740207.822691:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021937920 00000100:00100000:3.0:1790740207.822700:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021937536 00000100:00100000:3.0:1790740207.822702:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021937536 00000100:00100000:3.0:1790740207.822711:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021938048 00000100:00100000:3.0:1790740207.822713:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021938048 00000100:00100000:3.0:1790740207.822727:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790740207.822733:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ce3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727021936896:12345-0@lo:400: 00000100:00100000:3.0:1790740207.822784:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ce3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727021936896:12345-0@lo:400: Request processed in 50us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740207.822791:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790740207.822806:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790740207.822812:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ce3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877727021937408:12345-0@lo:400: 00000100:00100000:3.0:1790740207.822850:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ce3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877727021937408:12345-0@lo:400: Request processed in 38us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740207.822856:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790740207.822868:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790740207.822874:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877727021937920:12345-0@lo:400: 00000100:00100000:3.0:1790740207.822901:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877727021937920:12345-0@lo:400: Request processed in 28us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740207.822907:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790740207.822917:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790740207.822923:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ce1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877727021937536:12345-0@lo:400: 00000100:00100000:3.0:1790740207.822950:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ce1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877727021937536:12345-0@lo:400: Request processed in 28us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740207.822955:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790740207.822966:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790740207.822971:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ce1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877727021938048:12345-0@lo:400: 00000100:00100000:3.0:1790740207.822995:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ce1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877727021938048:12345-0@lo:400: Request processed in 24us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740207.823000:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1790740207.823063:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db82f99880 x1877727021937536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740207.823076:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1877727021937536:0@lo:400: 00010000:00080000:3.0:1790740207.823087:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db82f9b800 x1877727021938048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740207.823095:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1877727021938048:0@lo:400: 00010000:00080000:3.0:1790740207.823117:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db82f99180 x1877727021936896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740207.823125:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727021936896:0@lo:400: 00010000:00080000:3.0:1790740207.823134:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db82f9ad80 x1877727021937408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740207.823142:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877727021937408:0@lo:400: 00010000:00080000:3.0:1790740207.823150:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db82f9bb80 x1877727021937920/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740207.823157:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1877727021937920:0@lo:400: 00000100:00100000:2.0:1790740207.823594:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021937024 00000100:00100000:2.0:1790740207.823600:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021937024 00000100:00100000:2.0:1790740207.823650:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790740207.823658:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ce0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021937024:12345-0@lo:400: 00000100:00100000:2.0:1790740207.823704:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ce0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021937024:12345-0@lo:400: Request processed in 47us (1442us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740207.823709:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790740207.823770:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021937024:0@lo:400: 00000004:00080000:3.0:1790740207.828019:0:7466:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:1.0:1790740207.828200:0:9796:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc99069840 going to sleep for 11 seconds 00000100:00100000:1.0:1790740207.828241:0:9796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9796:1877727021936768:0@lo:502: 00000020:01000000:1.0:1790740207.828286:0:9796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790740207.828295:0:9796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740207.828298:0:9796:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:1.0:1790740207.828313:0:9796:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000100:00100000:1.0:1790740207.828479:0:8460:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021938176 00000100:00100000:1.0:1790740207.828487:0:8460:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021938176 00000100:00100000:1.0:1790740207.828550:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000020:01000000:2.0:1790740207.828554:0:6532:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 00000100:00100000:1.0:1790740207.828559:0:8460:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82f9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9801:x1877727021938176:12345-0@lo:700: 10000000:01000000:2.0:1790740207.828585:0:6532:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1790740207.828596:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2c00/0xb25dda4f4e92da70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92da77 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740207.828606:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc4000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8460:1877727021938304:0@lo:700: 00010000:00010000:2.0:1790740207.828607:0:6532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2c00/0xb25dda4f4e92da70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92da77 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740207.828625:0:6532:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1790740207.828627:0:6532:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98dc82d23800 from 39 10000000:01000000:2.0:1790740207.828630:0:6532:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790740207.828652:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dc81489000/0xb25dda4f4e92da9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740207.828659:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dc81489000/0xb25dda4f4e92da9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740207.828667:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dc81489000/0xb25dda4f4e92da9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740207.828676:0:8460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740207.828685:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f99c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021938432:0@lo:101: 00000100:00100000:1.0:1790740207.828700:0:8460:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc9853ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1790740207.828712:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740207.828717:0:6542:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021938304 00000100:00100000:1.0:1790740207.828720:0:6542:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021938304 00000100:00100000:2.0:1790740207.828731:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcaec6d780 going to sleep for 11 seconds 00000100:00100000:1.0:1790740207.828743:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790740207.828747:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021938432 00000100:00100000:1.0:1790740207.828749:0:6542:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8460:x1877727021938304:12345-0@lo:700: 00000100:00100000:2.0:1790740207.828750:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021938432 00000100:00100000:2.0:1790740207.828782:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1790740207.828787:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+20:6532:x1877727021938432:12345-0@lo:101: 00010000:00010000:2.0:1790740207.828796:0:6529:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740207.828808:0:6529:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dc81488200/0xb25dda4f4e92daa1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92da9a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740207.828829:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dc81488200/0xb25dda4f4e92daa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92da9a expref: 21 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740207.828855:0:6529:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dc81488200/0xb25dda4f4e92daa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92da9a expref: 21 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740207.828864:0:6529:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dc81488200, rc 0) 00000100:00080000:3.0:1790740207.828886:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790740207.828897:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:6532:x1877727021938432:12345-0@lo:101: Request processed in 110us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740207.828904:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1790740207.828939:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f99c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021938432:0@lo:101: 00010000:00010000:2.0:1790740207.828951:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dc81489000/0xb25dda4f4e92da9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92daa1 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740207.828959:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dc81489000/0xb25dda4f4e92da9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92daa1 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740207.829016:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f99c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021938560:0@lo:501: 00000100:00100000:2.0:1790740207.829059:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740207.829076:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcaec6d780 going to sleep for 11 seconds 00000100:00100000:1.0:1790740207.830194:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021938560 00000100:00100000:1.0:1790740207.830204:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021938560 00000100:00100000:1.0:1790740207.830285:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1790740207.830294:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:6532:x1877727021938560:12345-0@lo:501: 00000100:00100000:1.0:1790740207.830430:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:6532:x1877727021938560:12345-0@lo:501: Request processed in 137us (1369us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740207.830437:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1790740207.835865:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f99c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021938560:0@lo:501: 00000100:00100000:1.0:1790740207.835932:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021938688:0@lo:503: 00000100:00100000:1.0:1790740207.836055:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740207.836093:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb62b0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790740207.836273:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021938688 00000100:00100000:3.0:1790740207.836280:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021938688 00000100:00100000:3.0:1790740207.836334:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1790740207.836344:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:6532:x1877727021938688:12345-0@lo:503: 00000100:00100000:3.0:1790740207.836451:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:6532:x1877727021938688:12345-0@lo:503: Request processed in 108us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740207.836458:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1790740207.836505:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021938688:0@lo:503: 00000100:00100000:2.0:1790740207.837988:0:9802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f98000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9802:1877727021938816:0@lo:502: 00000100:00100000:2.0:1790740207.838076:0:9802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740207.838106:0:9802:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcae015300 going to sleep for 11 seconds 00000100:00100000:3.0:1790740207.838304:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021938816 00000100:00100000:3.0:1790740207.838312:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021938816 00000100:00100000:3.0:1790740207.838344:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1790740207.838351:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:9802:x1877727021938816:12345-0@lo:502: 00000100:00100000:3.0:1790740207.838470:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:9802:x1877727021938816:12345-0@lo:502: Request processed in 118us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740207.838478:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 40000000:02000000:2.0:1790740207.838819:0:6542:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:3.0:1790740207.841206:0:9802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f98000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9802:1877727021938816:0@lo:502: 00000100:00100000:3.0:1790740207.841296:0:9802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ce1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9802:1877727021938944:0@lo:502: 00000100:00100000:3.0:1790740207.841368:0:9802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740207.841419:0:9802:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5debe40 going to sleep for 11 seconds 00000100:00100000:1.0:1790740207.841483:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021938944 00000100:00100000:1.0:1790740207.841491:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021938944 00000100:00100000:1.0:1790740207.841543:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1790740207.841552:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:9802:x1877727021938944:12345-0@lo:502: 00000100:00100000:1.0:1790740207.841690:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:9802:x1877727021938944:12345-0@lo:502: Request processed in 138us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740207.841697:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1790740207.843135:0:9802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ce1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9802:1877727021938944:0@lo:502: 00000040:00080000:3.0:1790740207.843180:0:9802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1790740207.843256:0:6532:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1790740207.843277:0:6532:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790740207.843288:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dc81489000/0xb25dda4f4e92da9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92daa1 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740207.843299:0:6532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dc81489000/0xb25dda4f4e92da9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92daa1 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740207.843309:0:6532:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790740207.843312:0:6532:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98dc82d23800 from 6 10000000:01000000:3.0:1790740207.843315:0:6532:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790740207.843349:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8600/0xb25dda4f4e92daa8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740207.843358:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8600/0xb25dda4f4e92daa8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740207.843367:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8600/0xb25dda4f4e92daa8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740207.843395:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ce1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021939072:0@lo:101: 00000100:00100000:3.0:1790740207.843440:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740207.843478:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5debe40 going to sleep for 11 seconds 00000100:00100000:1.0:1790740207.843625:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021939072 00000100:00100000:1.0:1790740207.843631:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021939072 00000100:00100000:1.0:1790740207.843665:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1790740207.843673:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:6532:x1877727021939072:12345-0@lo:101: 00010000:00010000:1.0:1790740207.843684:0:6529:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740207.843696:0:6529:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dca1969000/0xb25dda4f4e92daaf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92daa8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740207.843720:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dca1969000/0xb25dda4f4e92daaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92daa8 expref: 22 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740207.843731:0:6529:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dca1969000/0xb25dda4f4e92daaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92daa8 expref: 22 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740207.843738:0:6529:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dca1969000, rc 0) 00000100:00100000:1.0:1790740207.843775:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+22:6532:x1877727021939072:12345-0@lo:101: Request processed in 102us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740207.843781:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1790740207.843813:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ce1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021939072:0@lo:101: 00010000:00010000:1.0:1790740207.843825:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8600/0xb25dda4f4e92daa8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92daaf expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740207.843833:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8600/0xb25dda4f4e92daa8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92daaf expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740207.843889:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021939200:0@lo:256: 00000100:00100000:1.0:1790740207.843920:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740207.843933:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc85697000 going to sleep for 11 seconds 00000100:00100000:1.0:1790740207.843944:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021939200 00000100:00100000:1.0:1790740207.843948:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021939200 00000100:00100000:1.0:1790740207.843963:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1790740207.843968:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+22:6532:x1877727021939200:12345-0@lo:256: 20000000:01000000:1.0:1790740207.846150:0:6529:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790740207.846189:0:6529:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790740207.846193:0:6529:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1790740207.846341:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+22:6532:x1877727021939200:12345-0@lo:256: Request processed in 2369us (2417us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740207.846353:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1790740207.846425:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021939200:0@lo:256: 10000000:01000000:1.0:1790740207.846478:0:6532:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790740207.846488:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8600/0xb25dda4f4e92daa8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92daaf expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740207.846500:0:6532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8600/0xb25dda4f4e92daa8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92daaf expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740207.846509:0:6532:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1790740207.846512:0:6532:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1790740207.846515:0:6532:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1790740207.846545:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dca1969800/0xb25dda4f4e92dab6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740207.846564:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dca1969800/0xb25dda4f4e92dab6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740207.846574:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dca1969800/0xb25dda4f4e92dab6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740207.846593:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021939328:0@lo:101: 00000100:00100000:1.0:1790740207.846635:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740207.846655:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc85697000 going to sleep for 11 seconds 00000100:00100000:1.0:1790740207.846673:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021939328 00000100:00100000:1.0:1790740207.846678:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021939328 00000100:00100000:1.0:1790740207.846706:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1790740207.846714:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+22:6532:x1877727021939328:12345-0@lo:101: 00010000:00010000:1.0:1790740207.846726:0:6529:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740207.846738:0:6529:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dca1969c00/0xb25dda4f4e92dabd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92dab6 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740207.846761:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dca1969c00/0xb25dda4f4e92dabd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92dab6 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740207.846771:0:6529:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dca1969c00/0xb25dda4f4e92dabd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92dab6 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740207.846780:0:6529:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dca1969c00, rc 0) 00000100:00100000:1.0:1790740207.846825:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:6532:x1877727021939328:12345-0@lo:101: Request processed in 112us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740207.846831:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1790740207.846860:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021939328:0@lo:101: 00010000:00010000:1.0:1790740207.846878:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dca1969800/0xb25dda4f4e92dab6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92dabd expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740207.846887:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dca1969800/0xb25dda4f4e92dab6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92dabd expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740207.846936:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021939456:0@lo:501: 00000100:00100000:1.0:1790740207.846963:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740207.846975:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc85697000 going to sleep for 11 seconds 00000100:00100000:1.0:1790740207.847000:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021939456 00000100:00100000:1.0:1790740207.847004:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021939456 00000100:00100000:1.0:1790740207.847022:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1790740207.847028:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:6532:x1877727021939456:12345-0@lo:501: 00000100:00100000:1.0:1790740207.847157:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:6532:x1877727021939456:12345-0@lo:501: Request processed in 129us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740207.847164:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1790740207.847191:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021939456:0@lo:501: 00000100:00100000:1.0:1790740207.847216:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021939584:0@lo:503: 00000100:00100000:1.0:1790740207.847254:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740207.847267:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc85697000 going to sleep for 11 seconds 00000100:00100000:1.0:1790740207.847278:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021939584 00000100:00100000:1.0:1790740207.847281:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021939584 00000100:00100000:1.0:1790740207.847297:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1790740207.847302:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:6532:x1877727021939584:12345-0@lo:503: 00000100:00100000:1.0:1790740207.847378:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:6532:x1877727021939584:12345-0@lo:503: Request processed in 75us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740207.847385:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1790740207.847427:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021939584:0@lo:503: 00000100:00100000:3.0:1790740207.849446:0:9803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ce0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9803:1877727021939712:0@lo:502: 00000100:00100000:3.0:1790740207.849523:0:9803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740207.849571:0:9803:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5deb180 going to sleep for 11 seconds 00000100:00100000:0.0:1790740207.850063:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021939712 00000100:00100000:0.0:1790740207.850071:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021939712 00000100:00100000:0.0:1790740207.850113:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1790740207.850123:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:9803:x1877727021939712:12345-0@lo:502: 00000100:00100000:0.0:1790740207.850257:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:9803:x1877727021939712:12345-0@lo:502: Request processed in 136us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740207.850264:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1790740207.850461:0:9803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ce0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9803:1877727021939712:0@lo:502: 00000020:01000000:3.0:1790740207.850493:0:9803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790740207.850501:0:9803:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1790740207.850508:0:9803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790740207.850510:0:9803:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1790740207.850517:0:9803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790740207.850521:0:9803:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.103@tcp to nid 0x20000c0a8cc67 (192.168.204.103@tcp) 00000020:01000000:3.0:1790740207.850544:0:9803:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1790740207.850548:0:9803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790740207.850564:0:9803:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff98dcaefcb380) 00000020:00000080:3.0:1790740207.850588:0:9803:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:3.0:1790740207.850596:0:9803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790740207.850697:0:9803:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1790740207.850702:0:9803:0:(osd_handler.c:8931:osd_obd_connect()) connect #7 00000020:00000080:3.0:1790740207.850709:0:9803:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb25dda4f4e92dacb 00010000:00080000:3.0:1790740207.850740:0:9803:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98dcb5cc0000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.103@tcp at head 00010000:00010000:3.0:1790740207.850976:0:9803:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:3.0:1790740207.851125:0:9803:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1790740207.851138:0:9803:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1790740207.851305:0:9803:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790740207.851426:0:9803:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790740207.851685:0:9803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1790740207.851780:0:9803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1790740207.856703:0:9804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790740207.856710:0:9804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1790740207.857671:0:9803:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790740207.857683:0:9803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1790740207.857719:0:9803:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1790740207.857745:0:9803:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb25dda4f4e92dad2 00000100:00080000:0.0:1790740207.857757:0:9803:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790740207.857770:0:9803:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98dcb5cc0000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:0.0:1790740207.857807:0:9803:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98db83e1e300 x1877727021939840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790740207.857866:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877727021939840:0@lo:8: 00000100:00100000:3.0:1790740207.857942:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740207.858057:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021939840 00000100:00100000:0.0:1790740207.858064:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021939840 00000100:00100000:0.0:1790740207.858094:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790740207.858101:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ce0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3637:x1877727021939840:12345-0@lo:8: 00010000:00080000:0.0:1790740207.858127:0:8454:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 279 last 0 00000020:00000080:0.0:1790740207.858153:0:8454:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb25dda4f4e92dad9 00002000:00100000:0.0:1790740207.858166:0:8454:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff98db83e49000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b03 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1790740207.858176:0:8454:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1790740207.858179:0:8454:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1790740207.858242:0:8454:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1790740207.858268:0:8454:0:(import.c:65:import_set_state_nolock()) ffff98db83e4b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790740207.858394:0:6542:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8460:x1877727021938304:12345-0@lo:700: Request processed in 29642us (29716us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740207.858404:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1790740207.858713:0:8460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83cc4000 x1877727021938304/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790740223 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740207.858727:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc4000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8460:1877727021938304:0@lo:700: 40000000:02000000:2.0:1790740207.858738:0:8460:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:0.0:1790740207.867239:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ce0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1877727021939840:12345-0@lo:8: Request processed in 9126us (9286us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740207.867256:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1790740207.867296:0:9803:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1790740207.867392:0:9803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790740207.867399:0:9803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740207.867401:0:9803:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1790740207.867405:0:9803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790740207.867409:0:9803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740207.867411:0:9803:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790740207.867414:0:9803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790740207.867416:0:9803:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1790740207.867460:0:9803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9803:1877727021939968:0@lo:502: 00000100:00100000:0.0:1790740207.867537:0:9803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740207.867568:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021939968 00000100:00100000:0.0:1790740207.867575:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021939968 00000100:00100000:0.0:1790740207.867629:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1790740207.867638:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:9803:x1877727021939968:12345-0@lo:502: 00000100:00100000:0.0:1790740207.867743:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:9803:x1877727021939968:12345-0@lo:502: Request processed in 106us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740207.867750:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1790740207.867796:0:9803:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82c98240 going to sleep for 11 seconds 00000100:00100000:0.0:1790740207.867817:0:9803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:9803:1877727021939968:0@lo:502: 00000020:01000000:0.0:1790740207.867844:0:9803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790740207.867853:0:9803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740207.867856:0:9803:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:0.0:1790740207.867859:0:9803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:0.0:1790740207.867912:0:6532:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:0.0:1790740207.867932:0:6532:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1790740207.867942:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dca1969800/0xb25dda4f4e92dab6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92dabd expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740207.867954:0:6532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dca1969800/0xb25dda4f4e92dab6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92dabd expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740207.867964:0:6532:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1790740207.867966:0:6532:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98dc992499c0 from 1 10000000:01000000:0.0:1790740207.867970:0:6532:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790740207.868008:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3600/0xb25dda4f4e92dae0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740207.868018:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3600/0xb25dda4f4e92dae0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740207.868027:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3600/0xb25dda4f4e92dae0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740207.868075:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021940096:0@lo:101: 00000100:00100000:0.0:1790740207.868102:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740207.868117:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82c98240 going to sleep for 11 seconds 00000100:00100000:0.0:1790740207.868131:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021940096 00000100:00100000:0.0:1790740207.868135:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021940096 00000100:00100000:0.0:1790740207.868158:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1790740207.868165:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca1332050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:6532:x1877727021940096:12345-0@lo:101: 00010000:00010000:0.0:1790740207.868173:0:6528:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740207.868192:0:6528:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcaeee2000/0xb25dda4f4e92dae7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92dae0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740207.868214:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcaeee2000/0xb25dda4f4e92dae7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92dae0 expref: 24 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740207.868225:0:6528:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcaeee2000/0xb25dda4f4e92dae7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92dae0 expref: 24 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740207.868233:0:6528:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaeee2000, rc 0) 00000100:00100000:0.0:1790740207.868264:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca1332050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:6532:x1877727021940096:12345-0@lo:101: Request processed in 100us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740207.868270:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1790740207.868300:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021940096:0@lo:101: 00010000:00010000:0.0:1790740207.868313:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3600/0xb25dda4f4e92dae0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92dae7 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740207.868322:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3600/0xb25dda4f4e92dae0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92dae7 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740207.868369:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021940224:0@lo:501: 00000100:00100000:0.0:1790740207.868392:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740207.868404:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82c98240 going to sleep for 11 seconds 00000100:00100000:0.0:1790740207.868414:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021940224 00000100:00100000:0.0:1790740207.868417:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021940224 00000100:00100000:0.0:1790740207.868441:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1790740207.868447:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca1333c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:6532:x1877727021940224:12345-0@lo:501: 00000100:00100000:0.0:1790740207.868509:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca1333c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:6532:x1877727021940224:12345-0@lo:501: Request processed in 62us (117us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790740207.868523:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1790740207.868549:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021940224:0@lo:501: 10000000:01000000:0.0:1790740207.868568:0:6532:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1790740207.868574:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3600/0xb25dda4f4e92dae0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92dae7 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740207.868582:0:6532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3600/0xb25dda4f4e92dae0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92dae7 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1790740207.880451:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83e1e300 x1877727021939840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790740217 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740207.880468:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790740207.880478:0:3637:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1790740207.880487:0:3637:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1790740207.880493:0:3637:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1790740207.880497:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98dcb5cc0000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1790740207.880511:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1790740207.880517:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877727021939840:0@lo:8: 00000004:00080000:3.0:1790740207.880571:0:9804:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1790740207.880644:0:9804:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 279166611652ns, next at 0ns, rc = 0 00080000:00080000:3.0:1790740207.880651:0:9804:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0000: async commit OSD 00000001:00100000:2.0:1790740207.882827:0:9531:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1790740207.882915:0:9531:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1790740207.883069:0:8460:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82f9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9801:x1877727021938176:12345-0@lo:700: Request processed in 54508us (61661us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740207.883082:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1790740207.883127:0:9801:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db82f9a680 x1877727021938176/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790740223 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740207.883140:0:9801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f9a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9801:1877727021938176:0@lo:700: 00000004:00080000:3.0:1790740207.883497:0:6514:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1790740207.898575:0:9801:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1790740207.898611:0:9801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ce1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9801:1877727021940480:0@lo:7: 00000100:00100000:3.0:1790740207.898691:0:9801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740207.898727:0:9801:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5deb840 going to sleep for 11 seconds 00000100:00100000:3.0:1790740207.898741:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ce2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021940352:0@lo:13: 00000100:00100000:3.0:1790740207.898764:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740207.898797:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021940352 00000100:00100000:3.0:1790740207.898806:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021940352 00000100:00100000:3.0:1790740207.898849:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790740207.898872:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ce0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021940352:12345-0@lo:13: 00002000:00000024:3.0:1790740207.898900:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:3.0:1790740207.898943:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ce0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021940352:12345-0@lo:13: Request processed in 73us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740207.898950:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1790740207.898990:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83ce2d80 x1877727021940352/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740223 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740207.899022:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ce2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021940352:0@lo:13: 00000100:00100000:1.0:1790740207.899131:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021940480 00000100:00100000:1.0:1790740207.899138:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021940480 00000100:00100000:1.0:1790740207.899167:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790740207.899174:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ce0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9801:x1877727021940480:12345-0@lo:7: 00000100:00100000:0.0:1790740207.906474:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021940608:0@lo:13: 00000100:00100000:0.0:1790740207.906550:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740207.906611:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021940608 00000100:00100000:0.0:1790740207.906629:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021940608 00000100:00100000:0.0:1790740207.906685:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790740207.906693:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021940608:12345-0@lo:13: 00002000:00000024:0.0:1790740207.906716:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:0.0:1790740207.906761:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021940608:12345-0@lo:13: Request processed in 69us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740207.906768:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1790740207.906788:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1790740207.906819:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83e1e680 x1877727021940608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740223 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740207.906839:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021940608:0@lo:13: 00000004:00080000:0.0:1790740207.906857:0:9805:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1790740207.906874:0:9805:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9805:1877727021940736:0@lo:7: 00000100:00100000:0.0:1790740207.906914:0:9805:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740207.906937:0:8453:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1790740207.906942:0:8453:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1790740207.907311:0:9805:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82c98240 going to sleep for 11 seconds 00000100:00100000:0.0:1790740207.909357:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021940736 00000100:00100000:0.0:1790740207.909369:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021940736 00000100:00100000:0.0:1790740207.909487:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790740207.909498:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9805:x1877727021940736:12345-0@lo:7: 00002000:00080000:1.0:1790740207.914800:0:8451:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1790740207.914808:0:8451:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1790740207.914902:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ce0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9801:x1877727021940480:12345-0@lo:7: Request processed in 15724us (16206us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740207.914912:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1790740207.914963:0:9801:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83ce1880 x1877727021940480/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790740223 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740207.914978:0:9801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ce1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9801:1877727021940480:0@lo:7: 00000004:00080000:1.0:1790740207.914991:0:9801:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1790740207.915052:0:9801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9801:1877727021940864:0@lo:5: 00000100:00100000:1.0:1790740207.915082:0:9801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740207.915110:0:9801:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc85697d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790740207.915126:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021940864 00000100:00100000:1.0:1790740207.915131:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021940864 00000100:00100000:1.0:1790740207.915166:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790740207.915173:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9801:x1877727021940864:12345-0@lo:5: 00002000:00080000:1.0:1790740207.915196:0:8453:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1790740207.915293:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9801:x1877727021940864:12345-0@lo:5: Request processed in 120us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740207.915301:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1790740207.915330:0:9801:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83cc6a00 x1877727021940864/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790740223 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740207.915351:0:9801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9801:1877727021940864:0@lo:5: 00000004:00080000:1.0:1790740207.915360:0:9801:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1790740207.915381:0:9801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9801:1877727021940992:0@lo:5: 00000100:00100000:1.0:1790740207.915403:0:9801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740207.915416:0:9801:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc85697d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790740207.915426:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021940992 00000100:00100000:1.0:1790740207.915429:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021940992 00000100:00100000:1.0:1790740207.915445:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790740207.915450:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9801:x1877727021940992:12345-0@lo:5: 00002000:00080000:1.0:1790740207.915470:0:8453:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:1.0:1790740207.917280:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:9801:x1877727021940992:12345-0@lo:5: Request processed in 1762us (1809us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1790740207.917292:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1790740207.917386:0:9801:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83cc6a00 x1877727021940992/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790740223 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740207.917400:0:9801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9801:1877727021940992:0@lo:5: 00000004:00080000:1.0:1790740207.917412:0:9801:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1790740207.917446:0:9801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9801:1877727021941120:0@lo:900: 00000100:00100000:1.0:1790740207.917478:0:9801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740207.917498:0:9801:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc85697d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790740207.917514:0:6547:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021941120 00000100:00100000:1.0:1790740207.917518:0:6547:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021941120 00000100:00100000:1.0:1790740207.917559:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790740207.917567:0:6547:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9801:x1877727021941120:12345-0@lo:900: 00000100:00100000:1.0:1790740207.917823:0:6547:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9801:x1877727021941120:12345-0@lo:900: Request processed in 256us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740207.917830:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1790740207.917854:0:9801:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83cc7100 x1877727021941120/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790740223 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740207.917863:0:9801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9801:1877727021941120:0@lo:900: 00002000:00080000:0.0:1790740207.918773:0:9806:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1790740207.918778:0:9806:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1790740207.918841:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9805:x1877727021940736:12345-0@lo:7: Request processed in 9344us (11925us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740207.918848:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1790740207.919103:0:9805:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83e1e680 x1877727021940736/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790740223 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740207.919115:0:9805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9805:1877727021940736:0@lo:7: 00000004:00080000:1.0:1790740207.919126:0:9805:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1790740207.919152:0:9805:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9805:1877727021941248:0@lo:5: 00000100:00100000:1.0:1790740207.919178:0:9805:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740207.919205:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021941248 00000100:00100000:1.0:1790740207.919209:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021941248 00000100:00100000:1.0:1790740207.919304:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790740207.919311:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9805:x1877727021941248:12345-0@lo:5: 00002000:00080000:1.0:1790740207.919333:0:8453:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1790740207.919336:0:8453:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1790740207.919581:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9805:x1877727021941248:12345-0@lo:5: Request processed in 270us (402us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1790740207.919588:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790740207.919609:0:9805:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc85697d80 going to sleep for 11 seconds 00010000:00080000:1.0:1790740207.919632:0:9805:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83cc7100 x1877727021941248/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790740223 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740207.919643:0:9805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9805:1877727021941248:0@lo:5: 00000004:00080000:1.0:1790740207.919661:0:9805:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1790740207.919685:0:9805:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9805:1877727021941376:0@lo:700: 00000100:00100000:1.0:1790740207.919711:0:9805:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740207.919786:0:9805:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc85697d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790740207.923162:0:8461:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021941376 00000100:00100000:3.0:1790740207.923175:0:8461:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021941376 00000100:00100000:0.0:1790740207.923332:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790740207.923341:0:8461:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:9805:x1877727021941376:12345-0@lo:700: 00000001:00080000:0.0:1790740207.937698:0:9531:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000001:00080000:0.0:1790740207.937714:0:9531:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:0.0:1790740207.937825:0:8461:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9805:x1877727021941376:12345-0@lo:700: Request processed in 14481us (18109us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740207.937838:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1790740207.938167:0:9805:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83cc4380 x1877727021941376/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790740223 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740207.938180:0:9805:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1790740207.938195:0:9805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9805:1877727021941376:0@lo:700: 00000004:02000040:1.0:1790740207.941314:0:9805:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:1.0:1790740207.949676:0:9805:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9805:1877727021941504:0@lo:5: 00000100:00100000:1.0:1790740207.949738:0:9805:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740207.949852:0:9805:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc85697d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790740207.950421:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021941504 00000100:00100000:3.0:1790740207.950429:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021941504 00000100:00100000:3.0:1790740207.950478:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790740207.950486:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9805:x1877727021941504:12345-0@lo:5: 00002000:00080000:1.0:1790740207.958452:0:8451:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1790740207.958472:0:8451:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:1.0:1790740207.960747:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9805:x1877727021941504:12345-0@lo:5: Request processed in 10255us (11002us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1790740207.960760:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1790740207.960910:0:9805:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83cc4380 x1877727021941504/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790740223 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740207.960935:0:9805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9805:1877727021941504:0@lo:5: 00000004:00080000:2.0:1790740207.960952:0:9805:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:0.0:1790740208.106290:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740209.135211:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740209.261912:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790740209.261937:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021941632:0@lo:41: 00000100:00100000:1.0:1790740209.262007:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740209.266275:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021941632 00000100:00100000:2.0:1790740209.266292:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021941632 00000100:00100000:2.0:1790740209.266369:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790740209.266379:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727021941632:12345-0@lo:41: 00000004:00000024:2.0:1790740209.266415:0:7846:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790740209.266525:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727021941632:12345-0@lo:41: Request processed in 146us (4517us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740209.266532:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790740209.268457:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021941632:0@lo:41: 00000001:02000400:1.0:1790740209.962397:0:9903:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg403-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1790740210.160829:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1790740210.990602:0:9955:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790740210.990858:0:9955:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1790740211.178189:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740211.306599:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ce2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727021941760:0@lo:41: 00000100:00100000:1.0:1790740211.306675:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740211.306874:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021941760 00000100:00100000:3.0:1790740211.306882:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021941760 00000100:00100000:3.0:1790740211.306939:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790740211.306948:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727021941760:12345-0@lo:41: 00000004:00000024:3.0:1790740211.306982:0:6540:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1790740211.307056:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727021941760:12345-0@lo:41: Request processed in 109us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740211.307062:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790740211.307323:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ce2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727021941760:0@lo:41: 00000001:00080000:2.0:1790740211.756344:0:9531:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:0.0:1790740211.818432:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ce0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021941888:0@lo:13: 00000100:00100000:0.0:1790740211.818505:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740211.818594:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790740211.818601:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021942016:0@lo:13: 00000100:00100000:0.0:1790740211.818622:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740211.818696:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021941888 00000100:00100000:2.0:1790740211.818705:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021941888 00000100:00100000:2.0:1790740211.818752:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021942016 00000100:00100000:2.0:1790740211.818755:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021942016 00000100:00100000:2.0:1790740211.818782:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790740211.818791:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021941888:12345-0@lo:13: 00002000:00000024:2.0:1790740211.818818:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790740211.818863:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021941888:12345-0@lo:13: Request processed in 72us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740211.818869:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790740211.818884:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790740211.818889:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021942016:12345-0@lo:13: 00002000:00000024:2.0:1790740211.818897:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790740211.818936:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021942016:12345-0@lo:13: Request processed in 47us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740211.818942:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1790740211.818989:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db82f9a680 x1877727021942016/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740227 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740211.819008:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021942016:0@lo:13: 00010000:00080000:2.0:1790740211.819021:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83ce0000 x1877727021941888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740227 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740211.819053:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ce0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021941888:0@lo:13: 00000100:00080000:0.0:1790740211.819176:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790740212.202399:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740213.227352:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740213.354296:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790740213.354324:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021942144:0@lo:13: 00000100:00100000:0.0:1790740213.354399:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740213.354454:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3639:1877727021942272:0@lo:400: 00000100:00100000:0.0:1790740213.354483:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740213.354504:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021942784:0@lo:400: 00000100:00100000:1.0:1790740213.354551:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877727021942400:0@lo:400: 00000100:00100000:1.0:1790740213.354599:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740213.354622:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1877727021942912:0@lo:400: 00000100:00100000:1.0:1790740213.354793:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740213.354818:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1877727021943424:0@lo:400: 00000100:00100000:2.0:1790740213.354844:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021942400 00000100:00100000:2.0:1790740213.354853:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021942400 00000100:00100000:1.0:1790740213.354856:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740213.354878:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1790740213.354884:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021942528:0@lo:400: 00000100:00100000:2.0:1790740213.354907:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021942912 00000100:00100000:2.0:1790740213.354911:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021942912 00000100:00100000:1.0:1790740213.354934:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740213.354942:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021943424 00000100:00100000:2.0:1790740213.354946:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021943424 00000100:00100000:1.0:1790740213.354959:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5df3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1877727021943040:0@lo:400: 00000100:00100000:2.0:1790740213.354967:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790740213.354977:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82c89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877727021942400:12345-0@lo:400: 00000100:00100000:1.0:1790740213.354986:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740213.354997:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1877727021943552:0@lo:400: 00000100:00100000:1.0:1790740213.355020:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740213.355071:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021943040 00000100:00100000:1.0:1790740213.355076:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021943040 00000100:00100000:2.0:1790740213.355081:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82c89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877727021942400:12345-0@lo:400: Request processed in 105us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740213.355090:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790740213.355101:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021943552 00000100:00100000:1.0:1790740213.355105:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021943552 00000100:00100000:2.0:1790740213.355114:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790740213.355122:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82c89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877727021942912:12345-0@lo:400: 00000100:00100000:1.0:1790740213.355128:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790740213.355138:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82c89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877727021943424:12345-0@lo:400: 00000100:00100000:2.0:1790740213.355155:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82c89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877727021942912:12345-0@lo:400: Request processed in 34us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740213.355162:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790740213.355178:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790740213.355183:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82c89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877727021943424:12345-0@lo:400: Request processed in 45us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740213.355190:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877727021943040:12345-0@lo:400: 00000100:00100000:1.0:1790740213.355193:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790740213.355210:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790740213.355227:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877727021943552:12345-0@lo:400: 00000100:00100000:2.0:1790740213.355235:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877727021943040:12345-0@lo:400: Request processed in 47us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740213.355242:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790740213.355280:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877727021943552:12345-0@lo:400: Request processed in 55us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740213.355286:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790740213.355327:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021942528 00000100:00100000:1.0:1790740213.355331:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021942528 00000100:00100000:1.0:1790740213.355352:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790740213.355358:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021942528:12345-0@lo:400: 00000100:00100000:1.0:1790740213.355390:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021942528:12345-0@lo:400: Request processed in 32us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740213.355397:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790740213.355438:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021942528:0@lo:400: 00010000:00080000:1.0:1790740213.355453:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcb5df3b80 x1877727021943040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740213.355462:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5df3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1877727021943040:0@lo:400: 00010000:00080000:1.0:1790740213.355471:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcb5f6c380 x1877727021943552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740213.355480:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1877727021943552:0@lo:400: 00010000:00080000:1.0:1790740213.355489:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83cc6d80 x1877727021942400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740213.355497:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877727021942400:0@lo:400: 00010000:00080000:1.0:1790740213.355520:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83cc4a80 x1877727021942912/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740213.355525:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740213.355536:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1877727021942912:0@lo:400: 00010000:00080000:1.0:1790740213.355554:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcb5f6d180 x1877727021943424/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740213.355579:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1877727021943424:0@lo:400: 00000100:00100000:0.0:1790740213.355587:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021943296:0@lo:400: 00000100:00100000:0.0:1790740213.355615:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740213.355646:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021943808:0@lo:400: 00000100:00100000:0.0:1790740213.355667:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740213.355684:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1790740213.355689:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877727021942656:0@lo:400: 00000100:00100000:0.0:1790740213.355706:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740213.355721:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727021943168:0@lo:400: 00000100:00100000:0.0:1790740213.355740:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740213.355756:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727021943680:0@lo:400: 00000100:00100000:3.0:1790740213.355765:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021942656 00000100:00100000:3.0:1790740213.355770:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021942656 00000100:00100000:0.0:1790740213.355780:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740213.355808:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021942144 00000100:00100000:0.0:1790740213.355813:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021942144 00000100:00100000:0.0:1790740213.355844:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790740213.355852:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727021942144:12345-0@lo:13: 00002000:00000024:0.0:1790740213.355873:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790740213.355890:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790740213.355900:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877727021942656:12345-0@lo:400: 00000100:00100000:0.0:1790740213.355912:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727021942144:12345-0@lo:13: Request processed in 60us (1513us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740213.355928:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790740213.355945:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877727021942656:12345-0@lo:400: Request processed in 46us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740213.355957:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021942272 00000100:00100000:3.0:1790740213.355961:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790740213.355963:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021942272 00000100:00100000:0.0:1790740213.355994:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1790740213.356001:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca1332850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3639:x1877727021942272:12345-0@lo:400: 00000100:00100000:0.0:1790740213.356053:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca1332850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3639:x1877727021942272:12345-0@lo:400: Request processed in 53us (1569us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740213.356059:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00080000:0.0:1790740213.356084:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790740213.356089:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790740213.356091:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790740213.356101:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021943296 00000100:00100000:0.0:1790740213.356105:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021943296 00000100:00100000:0.0:1790740213.356131:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021943808 00000100:00100000:0.0:1790740213.356134:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021943808 00000100:00100000:0.0:1790740213.356144:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021943168 00000100:00100000:0.0:1790740213.356146:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021943168 00000100:00100000:0.0:1790740213.356157:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021943680 00000100:00100000:0.0:1790740213.356159:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021943680 00000100:00100000:0.0:1790740213.356173:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790740213.356180:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727021943296:12345-0@lo:400: 00000100:00100000:0.0:1790740213.356213:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727021943296:12345-0@lo:400: Request processed in 33us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740213.356219:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790740213.356230:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790740213.356236:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727021943808:12345-0@lo:400: 00000100:00100000:0.0:1790740213.356263:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727021943808:12345-0@lo:400: Request processed in 27us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740213.356280:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790740213.356293:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790740213.356300:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727021943168:12345-0@lo:400: 00000100:00100000:0.0:1790740213.356333:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727021943168:12345-0@lo:400: Request processed in 34us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740213.356338:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790740213.356349:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790740213.356355:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727021943680:12345-0@lo:400: 00000100:00100000:0.0:1790740213.356385:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727021943680:12345-0@lo:400: Request processed in 31us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740213.356391:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1790740213.356413:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790740213.356416:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790740213.356440:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83cc5c00 x1877727021942656/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740213.356451:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877727021942656:0@lo:400: 00010000:00080000:0.0:1790740213.356464:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcb5f6ea00 x1877727021943168/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740213.356473:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727021943168:0@lo:400: 00010000:00080000:0.0:1790740213.356487:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcb5f6df80 x1877727021943680/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740213.356494:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1790740213.356505:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727021943680:0@lo:400: 00000100:00100000:0.0:1790740213.356532:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3639:1877727021942272:0@lo:400: 00010000:00080000:0.0:1790740213.356555:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcb5f6e680 x1877727021943296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740213.356563:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021943296:0@lo:400: 00010000:00080000:0.0:1790740213.356572:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db82c88700 x1877727021943808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740213.356578:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1790740213.356587:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021943808:0@lo:400: 00010000:00080000:0.0:1790740213.356597:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db82f9a680 x1877727021942144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740229 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740213.356610:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021942144:0@lo:13: 00000100:00100000:1.0:1790740213.358899:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790740213.358920:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021943936:0@lo:13: 00000100:00100000:1.0:1790740213.358983:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740213.359131:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021943936 00000100:00100000:1.0:1790740213.359139:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021943936 00000100:00100000:1.0:1790740213.359181:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790740213.359188:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021943936:12345-0@lo:13: 00002000:00000024:1.0:1790740213.359208:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790740213.359246:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021943936:12345-0@lo:13: Request processed in 59us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740213.359252:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1790740213.359287:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83d6bb80 x1877727021943936/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740229 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740213.359304:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021943936:0@lo:13: 00000100:00100000:2.0:1790740213.361722:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021942784 00000100:00100000:2.0:1790740213.361733:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021942784 00000100:00100000:2.0:1790740213.361818:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790740213.361836:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727021942784:12345-0@lo:400: 00000100:00100000:2.0:1790740213.361951:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727021942784:12345-0@lo:400: Request processed in 125us (6441us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740213.361959:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790740213.362052:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021942784:0@lo:400: 00000020:00000004:1.0:1790740213.781385:0:10057:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790740213.781599:0:10057:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1790740214.250131:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740214.379224:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021944064:0@lo:41: 00000100:00100000:1.0:1790740214.379290:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740214.379357:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021944064 00000100:00100000:1.0:1790740214.379364:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021944064 00000100:00100000:1.0:1790740214.379405:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790740214.379412:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021944064:12345-0@lo:41: 00000004:00000024:1.0:1790740214.379444:0:6540:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790740214.379512:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021944064:12345-0@lo:41: Request processed in 99us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740214.379519:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790740214.379562:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021944064:0@lo:41: 00000020:00000004:0.0:1790740214.685188:0:10105:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790740214.685198:0:10105:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:2.0:1790740215.211250:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740215.211319:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000920192 00000100:00100000:0.0:1790740215.211329:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000920192 00000100:00100000:0.0:1790740215.211376:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 182 00000100:00100000:0.0:1790740215.211384:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2401:x1877727000920192:12345-192.168.204.3@tcp:250: 00010000:00080000:0.0:1790740215.211419:0:6530:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 160ca934-a0b3-4cb3-b255-c8d008823f6f@192.168.204.3@tcp t0 exp 0000000000000000 cur 286 last 0 00000020:00000080:0.0:1790740215.211447:0:6530:0:(genops.c:1384:class_connect()) connect: client 160ca934-a0b3-4cb3-b255-c8d008823f6f, cookie 0xb25dda4f4e92daee 00000100:00080000:0.0:1790740215.211590:0:6530:0:(import.c:65:import_set_state_nolock()) ffff98db83e4d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790740215.211659:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+5:2401:x1877727000920192:12345-192.168.204.3@tcp:250: Request processed in 274us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740215.211667:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 182 00000100:00100000:3.0:1790740215.237484:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740215.237639:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000920320 00000100:00100000:0.0:1790740215.237649:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000920320 00000100:00100000:0.0:1790740215.237721:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 183 00000100:00100000:0.0:1790740215.237730:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+5:6185:x1877727000920320:12345-192.168.204.3@tcp:101: 00010000:00010000:0.0:1790740215.237747:0:6528:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740215.237765:0:6528:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcaeee3e00/0xb25dda4f4e92daf5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23aee expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740215.237795:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcaeee3e00/0xb25dda4f4e92daf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23aee expref: 6 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740215.237807:0:6528:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcaeee3e00/0xb25dda4f4e92daf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23aee expref: 6 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740215.237817:0:6528:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaeee3e00, rc 0) 00000100:00100000:0.0:1790740215.237881:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+6:6185:x1877727000920320:12345-192.168.204.3@tcp:101: Request processed in 151us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740215.237887:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 183 00000100:00100000:1.0:1790740215.242133:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740215.242313:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000920448 00000100:00100000:2.0:1790740215.242323:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000920448 00000100:00100000:2.0:1790740215.242375:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 184 00000100:00100000:2.0:1790740215.242383:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+6:6185:x1877727000920448:12345-192.168.204.3@tcp:501: 00000100:00100000:2.0:1790740215.242512:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+6:6185:x1877727000920448:12345-192.168.204.3@tcp:501: Request processed in 129us (388us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790740215.242530:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 184 00000100:00100000:3.0:1790740215.244365:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740215.244449:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000920576 00000100:00100000:2.0:1790740215.244458:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000920576 00000100:00100000:0.0:1790740215.244687:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 185 00000100:00100000:0.0:1790740215.244698:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+6:6185:x1877727000920576:12345-192.168.204.3@tcp:101: 00010000:00010000:0.0:1790740215.244712:0:6529:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740215.244729:0:6529:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcaeee2600/0xb25dda4f4e92dafc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23af5 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740215.244755:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcaeee2600/0xb25dda4f4e92dafc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23af5 expref: 7 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740215.244767:0:6529:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcaeee2600/0xb25dda4f4e92dafc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23af5 expref: 7 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740215.244793:0:6529:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaeee2600, rc 0) 00000100:00100000:0.0:1790740215.244846:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+7:6185:x1877727000920576:12345-192.168.204.3@tcp:101: Request processed in 151us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740215.244854:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 185 00000100:00100000:3.0:1790740215.249211:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740215.249352:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000920704 00000100:00100000:0.0:1790740215.249362:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000920704 00000100:00100000:0.0:1790740215.249420:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 186 00000100:00100000:0.0:1790740215.249429:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+7:6185:x1877727000920704:12345-192.168.204.3@tcp:501: 00000100:00100000:0.0:1790740215.249588:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+8:6185:x1877727000920704:12345-192.168.204.3@tcp:501: Request processed in 160us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740215.249596:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 186 00000100:00100000:1.0:1790740215.258139:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740215.258229:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000920832 00000100:00100000:2.0:1790740215.258239:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000920832 00000100:00100000:2.0:1790740215.258292:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 187 00000100:00100000:2.0:1790740215.258302:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+8:6185:x1877727000920832:12345-192.168.204.3@tcp:503: 00000100:00100000:2.0:1790740215.258442:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+8:6185:x1877727000920832:12345-192.168.204.3@tcp:503: Request processed in 141us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740215.258450:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 187 00000100:00100000:3.0:1790740215.265824:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740215.269439:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000920960 00000100:00100000:2.0:1790740215.269454:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000920960 00000100:00100000:2.0:1790740215.269541:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 188 00000100:00100000:2.0:1790740215.269550:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+8:6203:x1877727000920960:12345-192.168.204.3@tcp:502: 00000100:00100000:2.0:1790740215.269720:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+8:6203:x1877727000920960:12345-192.168.204.3@tcp:502: Request processed in 170us (3904us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740215.269728:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 188 00010000:00010000:1.0:1790740215.276085:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740215.342289:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740215.342396:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000921088 00000100:00100000:0.0:1790740215.342407:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000921088 00000100:00100000:0.0:1790740215.342462:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 189 00000100:00100000:0.0:1790740215.342483:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+8:6203:x1877727000921088:12345-192.168.204.3@tcp:502: 00000100:00100000:0.0:1790740215.342645:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+8:6203:x1877727000921088:12345-192.168.204.3@tcp:502: Request processed in 174us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740215.342654:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 189 00000100:00100000:1.0:1790740215.351104:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740215.351201:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000921216 00000100:00100000:0.0:1790740215.351212:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000921216 00000100:00100000:0.0:1790740215.351270:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 190 00000100:00100000:0.0:1790740215.351280:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+8:6185:x1877727000921216:12345-192.168.204.3@tcp:101: 00010000:00010000:0.0:1790740215.351296:0:6530:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740215.351313:0:6530:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcaeee3000/0xb25dda4f4e92db03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23b26 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740215.351361:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcaeee3000/0xb25dda4f4e92db03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23b26 expref: 9 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740215.351373:0:6530:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcaeee3000/0xb25dda4f4e92db03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23b26 expref: 9 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740215.351383:0:6530:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaeee3000, rc 0) 00000100:00100000:0.0:1790740215.351436:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+9:6185:x1877727000921216:12345-192.168.204.3@tcp:101: Request processed in 159us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740215.351443:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 190 00000100:00100000:3.0:1790740215.355230:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740215.355325:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000921344 00000100:00100000:2.0:1790740215.355335:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000921344 00000100:00100000:2.0:1790740215.355392:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 191 00000100:00100000:2.0:1790740215.355402:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+9:6185:x1877727000921344:12345-192.168.204.3@tcp:256: 20000000:01000000:2.0:1790740215.355426:0:6529:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1790740215.355448:0:6529:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1790740215.355452:0:6529:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1790740215.355456:0:6529:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1790740215.355459:0:6529:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1790740215.355461:0:6529:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1790740215.358161:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+9:6185:x1877727000921344:12345-192.168.204.3@tcp:256: Request processed in 2750us (2928us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740215.358176:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 191 00000100:00100000:3.0:1790740215.361169:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740215.364755:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000921472 00000100:00100000:2.0:1790740215.364769:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000921472 00000100:00100000:2.0:1790740215.365564:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 192 00000100:00100000:2.0:1790740215.365576:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+9:6185:x1877727000921472:12345-192.168.204.3@tcp:101: 00010000:00010000:2.0:1790740215.365593:0:6528:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740215.365610:0:6528:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dc81488600/0xb25dda4f4e92db0a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23b2d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740215.365657:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dc81488600/0xb25dda4f4e92db0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23b2d expref: 10 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740215.365669:0:6528:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dc81488600/0xb25dda4f4e92db0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23b2d expref: 10 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740215.365679:0:6528:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dc81488600, rc 0) 00000100:00100000:2.0:1790740215.365750:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+10:6185:x1877727000921472:12345-192.168.204.3@tcp:101: Request processed in 177us (4590us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740215.365758:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 192 00000100:00100000:1.0:1790740215.369791:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740215.370061:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000921600 00000100:00100000:0.0:1790740215.370071:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000921600 00000100:00100000:0.0:1790740215.370127:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 193 00000100:00100000:0.0:1790740215.370135:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+10:6185:x1877727000921600:12345-192.168.204.3@tcp:501: 00000100:00100000:0.0:1790740215.370273:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+10:6185:x1877727000921600:12345-192.168.204.3@tcp:501: Request processed in 138us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740215.370281:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 193 00000100:00100000:3.0:1790740215.373133:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740215.373212:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000921728 00000100:00100000:0.0:1790740215.373222:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000921728 00000100:00100000:0.0:1790740215.373274:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 194 00000100:00100000:0.0:1790740215.373282:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+10:6185:x1877727000921728:12345-192.168.204.3@tcp:503: 00000100:00100000:0.0:1790740215.373419:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+10:6185:x1877727000921728:12345-192.168.204.3@tcp:503: Request processed in 137us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740215.373427:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 194 00000100:00100000:3.0:1790740215.380242:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740215.380342:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000921856 00000100:00100000:2.0:1790740215.380352:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000921856 00000100:00100000:2.0:1790740215.380416:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 195 00000100:00100000:2.0:1790740215.380425:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99055c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+10:6207:x1877727000921856:12345-192.168.204.3@tcp:502: 00000100:00100000:2.0:1790740215.380667:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99055c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+10:6207:x1877727000921856:12345-192.168.204.3@tcp:502: Request processed in 242us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740215.380675:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 195 00000100:00100000:2.0:1790740215.383496:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740215.383588:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000921984 00000100:00100000:1.0:1790740215.383597:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000921984 00000100:00100000:1.0:1790740215.383645:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 196 00000100:00100000:1.0:1790740215.383655:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99057c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+10:6207:x1877727000921984:12345-192.168.204.3@tcp:502: 00000100:00100000:1.0:1790740215.383792:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99057c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+10:6207:x1877727000921984:12345-192.168.204.3@tcp:502: Request processed in 138us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740215.383800:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 196 00000100:00100000:3.0:1790740215.389924:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740215.389963:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740215.390149:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000922112 00000100:00100000:0.0:1790740215.390171:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000922112 00000100:00100000:0.0:1790740215.390213:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000922368 00000100:00100000:0.0:1790740215.390215:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000922368 00000100:00100000:0.0:1790740215.390240:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 7 00000100:00100000:0.0:1790740215.390247:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ce3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1877727000922112:12345-192.168.204.3@tcp:38: 00010000:00080000:0.0:1790740215.390273:0:7760:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 7bed19f2-4c98-4684-89e7-a6871565665d@192.168.204.3@tcp t0 exp 0000000000000000 cur 286 last 0 00000020:00000080:0.0:1790740215.390319:0:7760:0:(genops.c:1384:class_connect()) connect: client 7bed19f2-4c98-4684-89e7-a6871565665d, cookie 0xb25dda4f4e92db11 00000004:00100000:0.0:1790740215.390342:0:7760:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1790740215.390610:0:7760:0:(import.c:65:import_set_state_nolock()) ffff98db83e4a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790740215.390674:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ce3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+6:2401:x1877727000922112:12345-192.168.204.3@tcp:38: Request processed in 425us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740215.390682:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 7 00000100:00100000:0.0:1790740215.390699:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 8 00000100:00100000:0.0:1790740215.390703:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ce1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1877727000922368:12345-192.168.204.3@tcp:38: 00010000:00080000:0.0:1790740215.390716:0:7760:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 7bed19f2-4c98-4684-89e7-a6871565665d@192.168.204.3@tcp t0 exp 0000000000000000 cur 286 last 0 00000020:00000080:0.0:1790740215.390742:0:7760:0:(genops.c:1384:class_connect()) connect: client 7bed19f2-4c98-4684-89e7-a6871565665d, cookie 0xb25dda4f4e92db18 00000004:00100000:0.0:1790740215.390753:0:7760:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1790740215.390906:0:7760:0:(import.c:65:import_set_state_nolock()) ffff98dcae18f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790740215.391356:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ce1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+6:2401:x1877727000922368:12345-192.168.204.3@tcp:38: Request processed in 649us (1390us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740215.391364:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 8 00010000:00010000:0.0:1790740216.298400:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740216.398394:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740216.398442:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740216.398512:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000922496 00000100:00100000:0.0:1790740216.398523:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000922496 00000100:00100000:0.0:1790740216.398602:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000922240 00000100:00100000:0.0:1790740216.398606:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000922240 00000100:00100000:0.0:1790740216.398633:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 9 00000100:00100000:0.0:1790740216.398659:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ce0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+6:0:x1877727000922496:12345-192.168.204.3@tcp:41: 00000100:00080000:2.0:1790740216.398686:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790740216.398692:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:0.0:1790740216.398699:0:7760:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1790740216.398770:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ce0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+6:0:x1877727000922496:12345-192.168.204.3@tcp:41: Request processed in 114us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740216.398777:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 9 00000100:00100000:0.0:1790740216.398796:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 10 00000100:00100000:0.0:1790740216.398803:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+6:0:x1877727000922240:12345-192.168.204.3@tcp:41: 00000004:00000024:0.0:1790740216.398819:0:7760:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1790740216.398857:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+6:0:x1877727000922240:12345-192.168.204.3@tcp:41: Request processed in 53us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740216.398864:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 10 00000100:00100000:0.0:1790740216.405347:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740216.405662:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000922624 00000100:00100000:3.0:1790740216.405673:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000922624 00000100:00100000:3.0:1790740216.405737:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 11 00000100:00100000:3.0:1790740216.405748:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+6:6185:x1877727000922624:12345-192.168.204.3@tcp:41: 00000004:00000024:3.0:1790740216.405779:0:7760:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1790740216.405867:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+6:6185:x1877727000922624:12345-192.168.204.3@tcp:41: Request processed in 121us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740216.405874:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 11 00000100:00100000:2.0:1790740216.410200:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740216.410587:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000922752 00000100:00100000:3.0:1790740216.410597:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000922752 00000100:00100000:3.0:1790740216.410660:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 12 00000100:00100000:3.0:1790740216.410670:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82f9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+6:6185:x1877727000922752:12345-192.168.204.3@tcp:40: 00000100:00100000:3.0:1790740216.410773:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82f9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+6:6185:x1877727000922752:12345-192.168.204.3@tcp:40: Request processed in 103us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740216.410781:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 12 00000100:00100000:0.0:1790740216.416162:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740216.416214:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740216.416247:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740216.416356:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000922880 00000100:00100000:2.0:1790740216.416372:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000922880 00000100:00100000:2.0:1790740216.416417:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000923008 00000100:00100000:2.0:1790740216.416421:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000923008 00000100:00100000:2.0:1790740216.416439:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 16 00000100:00100000:2.0:1790740216.416447:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2401:x1877727000922880:12345-192.168.204.3@tcp:8: 00010000:00080000:2.0:1790740216.416521:0:9806:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 7bed19f2-4c98-4684-89e7-a6871565665d@192.168.204.3@tcp t0 exp 0000000000000000 cur 287 last 0 00000020:00000080:2.0:1790740216.416735:0:9806:0:(genops.c:1384:class_connect()) connect: client 7bed19f2-4c98-4684-89e7-a6871565665d, cookie 0xb25dda4f4e92db1f 00002000:00100000:2.0:1790740216.416748:0:9806:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7bed19f2-4c98-4684-89e7-a6871565665d/ffff98db83e05800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790740216.416767:0:9806:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790740216.417143:0:9806:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790740216.417180:0:9806:0:(import.c:65:import_set_state_nolock()) ffff98db83e07800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790740216.417259:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7bed19f2-4c98-4684-89e7-a6871565665d+6:2401:x1877727000922880:12345-192.168.204.3@tcp:8: Request processed in 810us (1106us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740216.417268:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 16 00000100:00100000:3.0:1790740216.417283:0:6546:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000923136 00000100:00100000:3.0:1790740216.417292:0:6546:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000923136 00000100:00100000:2.0:1790740216.417293:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 17 00000100:00100000:2.0:1790740216.417300:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2401:x1877727000923008:12345-192.168.204.3@tcp:8: 00010000:00080000:2.0:1790740216.417321:0:9806:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 7bed19f2-4c98-4684-89e7-a6871565665d@192.168.204.3@tcp t0 exp 0000000000000000 cur 287 last 0 00000100:00100000:3.0:1790740216.417335:0:6546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 4 00000100:00100000:3.0:1790740216.417346:0:6546:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7bed19f2-4c98-4684-89e7-a6871565665d+6:6185:x1877727000923136:12345-192.168.204.3@tcp:900: 00000100:00100000:3.0:1790740216.417385:0:6546:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7bed19f2-4c98-4684-89e7-a6871565665d+6:6185:x1877727000923136:12345-192.168.204.3@tcp:900: Request processed in 43us (1171us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740216.417393:0:6546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 4 00000020:00000080:2.0:1790740216.417846:0:9806:0:(genops.c:1384:class_connect()) connect: client 7bed19f2-4c98-4684-89e7-a6871565665d, cookie 0xb25dda4f4e92db26 00002000:00100000:2.0:1790740216.417854:0:9806:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7bed19f2-4c98-4684-89e7-a6871565665d/ffff98db83e06800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790740216.417869:0:9806:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790740216.418194:0:9806:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790740216.418216:0:9806:0:(import.c:65:import_set_state_nolock()) ffff98db83e03000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790740216.418259:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7bed19f2-4c98-4684-89e7-a6871565665d+6:2401:x1877727000923008:12345-192.168.204.3@tcp:8: Request processed in 957us (2010us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740216.418267:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 17 00000100:00100000:3.0:1790740216.419408:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740216.419668:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000923264 00000100:00100000:2.0:1790740216.419678:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000923264 00000100:00100000:2.0:1790740216.419732:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 197 00000100:00100000:2.0:1790740216.419741:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99057850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+10:2403:x1877727000923264:12345-192.168.204.3@tcp:400: 00000100:00100000:2.0:1790740216.420092:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99057850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+10:2403:x1877727000923264:12345-192.168.204.3@tcp:400: Request processed in 351us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740216.420101:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 197 00000100:00100000:0.0:1790740216.424709:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740216.425280:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000923392 00000100:00100000:2.0:1790740216.425291:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000923392 00000100:00100000:2.0:1790740216.425361:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 0 00000100:00100000:2.0:1790740216.425381:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82c88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+6:6185:x1877727000923392:12345-192.168.204.3@tcp:33: 00000100:00100000:1.0:1790740216.426398:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021944192:0@lo:41: 00000100:00100000:1.0:1790740216.426462:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740216.426543:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021944192 00000100:00100000:1.0:1790740216.426773:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021944192 00000100:00100000:1.0:1790740216.426825:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790740216.426834:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021944192:12345-0@lo:41: 00000004:00000024:1.0:1790740216.426856:0:7846:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1790740216.426918:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021944192:12345-0@lo:41: Request processed in 84us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740216.426925:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790740216.426997:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021944192:0@lo:41: 00000004:00080000:2.0:1790740216.455684:0:6538:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 30203us 00000004:00200000:1.0:1790740216.480465:0:6538:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1790740216.481795:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82c88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+6:6185:x1877727000923392:12345-192.168.204.3@tcp:33: Request processed in 56408us (57087us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740216.481807:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 0 00000100:00100000:3.0:1790740216.784796:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740216.784929:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000923520 00000100:00100000:0.0:1790740216.784940:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000923520 00000100:00100000:0.0:1790740216.785012:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 13 00000100:00100000:0.0:1790740216.785022:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ce1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+6:6226:x1877727000923520:12345-192.168.204.3@tcp:101: 00010000:00010000:0.0:1790740216.785073:0:7760:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740216.785156:0:7760:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92db2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23b5e expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740216.785249:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061400/0xb25dda4f4e92db34 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740216.785274:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061400/0xb25dda4f4e92db34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740216.785291:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061400/0xb25dda4f4e92db34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790740216.785344:0:7760:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790740216.785349:0:7760:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790740216.785363:0:7760:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061400/0xb25dda4f4e92db34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740216.785388:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92db2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23b5e expref: 8 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740216.785409:0:7760:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061400/0xb25dda4f4e92db34 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23b5e expref: 7 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740216.785418:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98db82949200) 00010000:00010000:0.0:1790740216.785421:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790740216.785425:0:7760:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaf061400, rc 0) 00000100:00100000:0.0:1790740216.785503:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ce1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+7:6226:x1877727000923520:12345-192.168.204.3@tcp:101: Request processed in 482us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740216.785511:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 13 00000100:00100000:0.0:1790740216.938280:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727021944320:0@lo:13: 00000100:00100000:0.0:1790740216.938386:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740216.938891:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021944320 00000100:00100000:1.0:1790740216.938900:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021944320 00000100:00100000:1.0:1790740216.938963:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790740216.938972:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd552680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727021944320:12345-0@lo:13: 00002000:00000024:1.0:1790740216.938994:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790740216.939128:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790740216.939142:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ce1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021944448:0@lo:13: 00000100:00100000:3.0:1790740216.939173:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790740216.939200:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790740216.939218:0:8456:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1790740216.939225:0:8456:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:3.0:1790740216.939326:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021944448 00000100:00100000:3.0:1790740216.939330:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021944448 00000100:00080000:3.0:1790740216.939354:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790740216.939422:0:10118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790740216.939429:0:10118:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ce2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021944448:12345-0@lo:13: 00002000:00000024:3.0:1790740216.939439:0:10118:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790740216.939482:0:10118:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ce2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021944448:12345-0@lo:13: Request processed in 54us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740216.939489:0:10118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1790740216.939541:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83ce1f80 x1877727021944448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740232 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740216.939572:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ce1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021944448:0@lo:13: 00000100:00100000:1.0:1790740216.960357:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd552680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727021944320:12345-0@lo:13: Request processed in 21376us (21960us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740216.960374:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1790740216.961758:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db82f98000 x1877727021944320/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740232 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740216.961798:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727021944320:0@lo:13: 00010000:00010000:1.0:1790740217.324248:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740218.346530:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740218.474241:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790740218.474266:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021944576:0@lo:13: 00000100:00100000:2.0:1790740218.474332:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740218.474713:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfc13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021944960:0@lo:400: 00000100:00100000:3.0:1790740218.474742:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740218.474760:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfc11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1877727021945472:0@lo:400: 00000100:00100000:3.0:1790740218.475104:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740218.475127:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfc12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1877727021945984:0@lo:400: 00000100:00100000:3.0:1790740218.475151:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740218.475167:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1790740218.475172:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfc13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877727021945088:0@lo:400: 00000100:00100000:3.0:1790740218.475189:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740218.475201:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfc11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021945600:0@lo:400: 00000100:00100000:3.0:1790740218.475220:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740218.475240:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfc11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021946112:0@lo:400: 00000100:00100000:3.0:1790740218.475256:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740218.475281:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021945472 00000100:00100000:3.0:1790740218.475287:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021945472 00000100:00100000:3.0:1790740218.475331:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021945984 00000100:00100000:3.0:1790740218.475333:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021945984 00000100:00100000:3.0:1790740218.475347:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021945088 00000100:00100000:3.0:1790740218.475349:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021945088 00000100:00100000:3.0:1790740218.475453:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790740218.475463:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877727021945472:12345-0@lo:400: 00000100:00100000:3.0:1790740218.475593:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877727021945472:12345-0@lo:400: Request processed in 130us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740218.475611:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790740218.475695:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790740218.475704:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877727021945984:12345-0@lo:400: 00000100:00100000:3.0:1790740218.475733:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877727021945984:12345-0@lo:400: Request processed in 31us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740218.475739:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790740218.475751:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790740218.475756:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877727021945088:12345-0@lo:400: 00000100:00100000:3.0:1790740218.475852:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877727021945088:12345-0@lo:400: Request processed in 94us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740218.475859:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1790740218.475878:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790740218.475908:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfc13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877727021945088:0@lo:400: 00010000:00080000:3.0:1790740218.475921:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcbfc11180 x1877727021945472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740218.475931:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfc11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1877727021945472:0@lo:400: 00010000:00080000:3.0:1790740218.475939:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcbfc12d80 x1877727021945984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740218.476174:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ce1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727021944704:0@lo:400: 00000100:00100000:2.0:1790740218.476210:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740218.476237:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfc13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021945216:0@lo:400: 00000100:00100000:2.0:1790740218.476257:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740218.476271:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfc11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021945728:0@lo:400: 00000100:00100000:2.0:1790740218.476288:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740218.476304:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1790740218.476309:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfc12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727021944832:0@lo:400: 00000100:00100000:2.0:1790740218.476327:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740218.476340:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfc10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877727021945344:0@lo:400: 00000100:00100000:2.0:1790740218.476385:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740218.476401:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfc10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1877727021945856:0@lo:400: 00000100:00100000:2.0:1790740218.476432:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740218.476452:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021944832 00000100:00100000:2.0:1790740218.476456:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021944832 00000100:00100000:2.0:1790740218.476478:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021945344 00000100:00100000:2.0:1790740218.476480:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021945344 00000100:00100000:2.0:1790740218.476495:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021945856 00000100:00100000:2.0:1790740218.476498:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021945856 00000100:00100000:3.0:1790740218.476730:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfc12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1877727021945984:0@lo:400: 00000100:00080000:3.0:1790740218.476754:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790740218.476765:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790740218.476772:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82f9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727021944832:12345-0@lo:400: 00000100:00100000:2.0:1790740218.476856:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790740218.476864:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82f99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877727021945344:12345-0@lo:400: 00000100:00100000:2.0:1790740218.477110:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82f99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877727021945344:12345-0@lo:400: Request processed in 247us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740218.477118:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790740218.477136:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790740218.477142:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82f9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877727021945856:12345-0@lo:400: 00000100:00100000:2.0:1790740218.477168:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82f9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877727021945856:12345-0@lo:400: Request processed in 27us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740218.477174:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790740218.477202:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfc10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877727021945344:0@lo:400: 00000100:00100000:2.0:1790740218.477211:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfc10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1877727021945856:0@lo:400: 00000100:00100000:2.0:1790740218.477231:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021945600 00000100:00100000:2.0:1790740218.477234:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021945600 00000100:00100000:2.0:1790740218.477261:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021946112 00000100:00100000:2.0:1790740218.477264:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021946112 00000100:00100000:2.0:1790740218.477274:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021945728 00000100:00100000:2.0:1790740218.477277:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021945728 00000100:00100000:2.0:1790740218.477299:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790740218.477305:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021945600:12345-0@lo:400: 00000100:00100000:2.0:1790740218.477339:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021945600:12345-0@lo:400: Request processed in 34us (2117us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740218.477345:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790740218.477355:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790740218.477492:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82f9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727021944832:12345-0@lo:400: Request processed in 720us (1163us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740218.477579:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1790740218.477598:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790740218.477601:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790740218.477619:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcbfc11500 x1877727021945600/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740218.477703:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021946112:12345-0@lo:400: 00000100:00100000:2.0:1790740218.477734:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021946112:12345-0@lo:400: Request processed in 374us (2477us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740218.477741:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790740218.477753:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790740218.477759:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82f9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021945728:12345-0@lo:400: 00000100:00100000:2.0:1790740218.477860:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82f9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021945728:12345-0@lo:400: Request processed in 101us (1570us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740218.477867:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790740218.478119:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfc11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021945600:0@lo:400: 00010000:00080000:3.0:1790740218.478138:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcbfc11880 x1877727021946112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740218.478150:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfc11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021946112:0@lo:400: 00000100:00100000:3.0:1790740218.478262:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021944704 00000100:00100000:3.0:1790740218.478268:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021944704 00000100:00100000:3.0:1790740218.478299:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1790740218.478306:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99054c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3638:x1877727021944704:12345-0@lo:400: 00000100:00100000:3.0:1790740218.478342:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99054c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3638:x1877727021944704:12345-0@lo:400: Request processed in 37us (2132us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740218.478348:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1790740218.478659:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfc12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727021944832:0@lo:400: 00000100:00100000:2.0:1790740218.478671:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ce1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727021944704:0@lo:400: 00010000:00080000:2.0:1790740218.478683:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcbfc11f80 x1877727021945728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740218.478692:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfc11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021945728:0@lo:400: 00000100:00100000:1.0:1790740218.481176:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021944576 00000100:00100000:1.0:1790740218.481191:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021944576 00000100:00100000:1.0:1790740218.481276:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790740218.481285:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82f99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021944576:12345-0@lo:13: 00002000:00000024:1.0:1790740218.481314:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790740218.481389:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82f99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021944576:12345-0@lo:13: Request processed in 105us (7057us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740218.481395:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790740218.481433:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021944960 00000100:00100000:1.0:1790740218.481437:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021944960 00000100:00100000:1.0:1790740218.481457:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021945216 00000100:00100000:1.0:1790740218.481459:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021945216 00000100:00100000:1.0:1790740218.481470:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790740218.481475:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021944960:12345-0@lo:400: 00000100:00100000:1.0:1790740218.481509:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021944960:12345-0@lo:400: Request processed in 34us (6767us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740218.481515:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790740218.481524:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790740218.481542:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82f99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021945216:12345-0@lo:400: 00000100:00100000:1.0:1790740218.481570:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82f99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021945216:12345-0@lo:400: Request processed in 29us (5312us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740218.481575:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790740218.481739:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfc13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021944960:0@lo:400: 00010000:00080000:1.0:1790740218.481754:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83d6bb80 x1877727021944576/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740234 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740218.481770:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021944576:0@lo:13: 00000100:00100000:2.0:1790740218.482177:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfc13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021945216:0@lo:400: 00000100:00080000:3.0:1790740218.482266:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790740218.482393:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790740218.482407:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021946240:0@lo:13: 00000100:00100000:0.0:1790740218.482466:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740218.482576:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021946240 00000100:00100000:1.0:1790740218.482581:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021946240 00000100:00100000:1.0:1790740218.482745:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790740218.482754:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd553100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727021946240:12345-0@lo:13: 00002000:00000024:1.0:1790740218.482770:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790740218.482815:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd553100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727021946240:12345-0@lo:13: Request processed in 62us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740218.482821:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1790740218.482876:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83d6bb80 x1877727021946240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740234 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740218.482890:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021946240:0@lo:13: 00000100:00100000:3.0:1790740219.001151:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740219.001400:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000923648 00000100:00100000:2.0:1790740219.001420:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000923648 00000100:00100000:2.0:1790740219.001506:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 14 00000100:00100000:2.0:1790740219.001517:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+7:6278:x1877727000923648:12345-192.168.204.3@tcp:41: 00000004:00000024:2.0:1790740219.001572:0:6536:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1790740219.001634:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+7:6278:x1877727000923648:12345-192.168.204.3@tcp:41: Request processed in 120us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740219.001642:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 14 00000100:00080000:3.0:1790740219.002196:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790740219.005095:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740219.005203:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000923776 00000100:00100000:1.0:1790740219.005216:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000923776 00000100:00100000:1.0:1790740219.005353:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 15 00000100:00100000:1.0:1790740219.005363:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+6:6278:x1877727000923776:12345-192.168.204.3@tcp:41: 00000004:00000024:1.0:1790740219.005415:0:6535:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00080000:3.0:1790740219.005453:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790740219.005490:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+6:6278:x1877727000923776:12345-192.168.204.3@tcp:41: Request processed in 127us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740219.005498:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 15 00000100:00100000:2.0:1790740219.008508:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740219.008627:0:10118:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000923904 00000100:00100000:3.0:1790740219.008637:0:10118:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000923904 00000100:00100000:3.0:1790740219.008796:0:10118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 22 00000100:00100000:3.0:1790740219.008806:0:10118:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82f99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7bed19f2-4c98-4684-89e7-a6871565665d+6:6278:x1877727000923904:12345-192.168.204.3@tcp:13: 00002000:00000024:3.0:1790740219.008836:0:10118:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790740219.008921:0:10118:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82f99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7bed19f2-4c98-4684-89e7-a6871565665d+6:6278:x1877727000923904:12345-192.168.204.3@tcp:13: Request processed in 117us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740219.008930:0:10118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 22 00000100:00080000:0.0:1790740219.012712:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790740219.014991:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740219.016477:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000924032 00000100:00100000:1.0:1790740219.016495:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000924032 00000100:00100000:1.0:1790740219.016609:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 23 00000100:00100000:1.0:1790740219.016621:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7bed19f2-4c98-4684-89e7-a6871565665d+6:6278:x1877727000924032:12345-192.168.204.3@tcp:13: 00002000:00000024:1.0:1790740219.016653:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790740219.016738:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7bed19f2-4c98-4684-89e7-a6871565665d+6:6278:x1877727000924032:12345-192.168.204.3@tcp:13: Request processed in 119us (1762us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740219.016746:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 23 00000100:00080000:0.0:1790740219.016985:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1790740219.370678:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740219.498472:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790740219.498504:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfc11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021946368:0@lo:41: 00000100:00100000:3.0:1790740219.498596:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740219.498684:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021946368 00000100:00100000:3.0:1790740219.498695:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021946368 00000100:00100000:3.0:1790740219.498756:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790740219.498767:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021946368:12345-0@lo:41: 00000004:00000024:3.0:1790740219.498828:0:6541:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1790740219.498883:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021946368:12345-0@lo:41: Request processed in 117us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740219.498892:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790740219.498946:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfc11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021946368:0@lo:41: 00010000:00010000:0.0:1790740220.394474:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790740220.525196:0:6514:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7bed19f2-4c98-4684-89e7-a6871565665d 00000001:00100000:1.0:1790740220.528840:0:7466:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 7bed19f2-4c98-4684-89e7-a6871565665d 00000001:00100000:2.0:1790740220.530685:0:9531:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7bed19f2-4c98-4684-89e7-a6871565665d 00010000:00010000:2.0:1790740221.419285:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790740221.472366:0:10204:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1790740221.549493:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790740221.549531:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfc11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021946496:0@lo:41: 00000100:00100000:3.0:1790740221.549633:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740221.549745:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021946496 00000100:00100000:3.0:1790740221.549755:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021946496 00000100:00100000:3.0:1790740221.549818:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790740221.549827:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021946496:12345-0@lo:41: 00000004:00000024:3.0:1790740221.549875:0:6540:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1790740221.549929:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021946496:12345-0@lo:41: Request processed in 102us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740221.549937:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790740221.550017:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfc11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021946496:0@lo:41: 00000100:00100000:2.0:1790740221.858964:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740221.859199:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740221.859237:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740221.859279:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740221.859311:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740221.859359:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000924416 00000100:00100000:2.0:1790740221.859372:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000924416 00000100:00100000:2.0:1790740221.859455:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000924288 00000100:00100000:2.0:1790740221.859458:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000924288 00000100:00100000:2.0:1790740221.859503:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 58 00000100:00100000:2.0:1790740221.859515:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82f99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+5:2402:x1877727000924416:12345-192.168.204.3@tcp:400: 00000100:00100000:2.0:1790740221.859625:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82f99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+5:2402:x1877727000924416:12345-192.168.204.3@tcp:400: Request processed in 113us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740221.859634:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 58 00000100:00100000:2.0:1790740221.859655:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 59 00000100:00100000:2.0:1790740221.859663:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82f98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+6:2402:x1877727000924288:12345-192.168.204.3@tcp:400: 00000100:00100000:2.0:1790740221.859695:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82f98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+6:2402:x1877727000924288:12345-192.168.204.3@tcp:400: Request processed in 34us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740221.859701:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 59 00000100:00080000:2.0:1790740221.859741:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790740221.859746:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790740221.860345:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000924672 00000100:00100000:1.0:1790740221.860363:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000924672 00000100:00100000:1.0:1790740221.860413:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000924544 00000100:00100000:1.0:1790740221.860428:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000924544 00000100:00100000:1.0:1790740221.860456:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 16 00000100:00100000:1.0:1790740221.860464:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82f98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7bed19f2-4c98-4684-89e7-a6871565665d+5:2402:x1877727000924672:12345-192.168.204.3@tcp:400: 00000100:00100000:3.0:1790740221.860837:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 17 00000100:00100000:3.0:1790740221.860848:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82f98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bed19f2-4c98-4684-89e7-a6871565665d+6:2402:x1877727000924544:12345-192.168.204.3@tcp:400: 00000100:00100000:3.0:1790740221.860903:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82f98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bed19f2-4c98-4684-89e7-a6871565665d+6:2402:x1877727000924544:12345-192.168.204.3@tcp:400: Request processed in 58us (1591us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740221.860911:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 17 00000100:00100000:1.0:1790740221.861164:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82f98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7bed19f2-4c98-4684-89e7-a6871565665d+5:2402:x1877727000924672:12345-192.168.204.3@tcp:400: Request processed in 700us (1925us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740221.861173:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 16 00000100:00080000:2.0:1790740221.862610:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790740221.862619:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790740221.863535:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000924160 00000100:00100000:0.0:1790740221.863550:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000924160 00000100:00100000:0.0:1790740221.863632:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 199 00000100:00100000:0.0:1790740221.863643:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99055450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+10:2402:x1877727000924160:12345-192.168.204.3@tcp:400: 00000100:00100000:0.0:1790740221.863734:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99055450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+10:2402:x1877727000924160:12345-192.168.204.3@tcp:400: Request processed in 93us (4785us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740221.863742:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 199 00000100:00100000:3.0:1790740222.060583:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021946624:0@lo:13: 00000100:00100000:3.0:1790740222.060695:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740222.061184:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021946752:0@lo:13: 00000100:00100000:3.0:1790740222.061225:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740222.061311:0:10118:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021946624 00000100:00100000:1.0:1790740222.061322:0:10118:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021946624 00000100:00100000:1.0:1790740222.061430:0:10118:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021946752 00000100:00100000:1.0:1790740222.061435:0:10118:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021946752 00000100:00100000:1.0:1790740222.061461:0:10118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790740222.061471:0:10118:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021946624:12345-0@lo:13: 00002000:00000024:1.0:1790740222.061511:0:10118:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790740222.061564:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790740222.061574:0:10118:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021946624:12345-0@lo:13: Request processed in 103us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740222.061579:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021946752:12345-0@lo:13: 00002000:00000024:2.0:1790740222.061593:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790740222.061607:0:10118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1790740222.061690:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790740222.061730:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db82f98000 x1877727021946624/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740238 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740222.061753:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021946624:0@lo:13: 00000100:00100000:2.0:1790740222.065270:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021946752:12345-0@lo:13: Request processed in 3678us (4026us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740222.065302:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1790740222.069454:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83d69f80 x1877727021946752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740238 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740222.069495:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021946752:0@lo:13: 00010000:00010000:0.0:1790740222.449210:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790740222.578265:0:8446:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7bed19f2-4c98-4684-89e7-a6871565665d 00010000:00010000:2.0:1790740223.469976:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740223.595431:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877727021947264:0@lo:400: 00000100:00100000:3.0:1790740223.595504:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740223.595571:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021947776:0@lo:400: 00000100:00100000:3.0:1790740223.595597:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740223.595622:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021948288:0@lo:400: 00000100:00100000:3.0:1790740223.595644:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740223.595667:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1790740223.595690:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727021946880:0@lo:400: 00000100:00100000:3.0:1790740223.595720:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740223.595743:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021947392:0@lo:400: 00000100:00100000:3.0:1790740223.595766:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740223.595783:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021947904:0@lo:400: 00000100:00100000:3.0:1790740223.595820:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740223.595857:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021948416:0@lo:400: 00000100:00100000:3.0:1790740223.595880:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740223.595906:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021947136:0@lo:400: 00000100:00100000:3.0:1790740223.595928:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740223.595947:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1877727021947648:0@lo:400: 00000100:00100000:3.0:1790740223.595970:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740223.595983:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1877727021948160:0@lo:400: 00000100:00100000:3.0:1790740223.596015:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740223.596072:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1790740223.596078:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877727021947008:0@lo:400: 00000100:00100000:3.0:1790740223.596107:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740223.596124:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1877727021947520:0@lo:400: 00000100:00100000:3.0:1790740223.596143:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740223.596152:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1877727021948032:0@lo:400: 00000100:00100000:3.0:1790740223.596170:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740223.596180:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfc13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021948544:0@lo:13: 00000100:00100000:3.0:1790740223.596200:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740223.596229:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021947776 00000100:00100000:3.0:1790740223.596238:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021947776 00000100:00100000:3.0:1790740223.596279:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021948288 00000100:00100000:3.0:1790740223.596283:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021948288 00000100:00100000:3.0:1790740223.596304:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021947904 00000100:00100000:3.0:1790740223.596307:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021947904 00000100:00100000:3.0:1790740223.596329:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021948416 00000100:00100000:3.0:1790740223.596332:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021948416 00000100:00100000:3.0:1790740223.596348:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790740223.596355:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021947776:12345-0@lo:400: 00000100:00100000:3.0:1790740223.596410:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021947776:12345-0@lo:400: Request processed in 55us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740223.596417:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790740223.596432:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790740223.596438:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021948288:12345-0@lo:400: 00000100:00100000:3.0:1790740223.596464:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021948288:12345-0@lo:400: Request processed in 27us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740223.596470:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790740223.596480:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790740223.596486:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021947904:12345-0@lo:400: 00000100:00100000:3.0:1790740223.596511:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021947904:12345-0@lo:400: Request processed in 26us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740223.596516:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790740223.596526:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790740223.596532:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021948416:12345-0@lo:400: 00000100:00100000:3.0:1790740223.596557:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021948416:12345-0@lo:400: Request processed in 25us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740223.596563:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790740223.596585:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021946880 00000100:00100000:3.0:1790740223.596588:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021946880 00000100:00100000:3.0:1790740223.596621:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1790740223.596626:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99056850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3638:x1877727021946880:12345-0@lo:400: 00000100:00100000:3.0:1790740223.596657:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99056850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3638:x1877727021946880:12345-0@lo:400: Request processed in 31us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740223.596662:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1790740223.596685:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021947392 00000100:00100000:3.0:1790740223.596688:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021947392 00000100:00100000:3.0:1790740223.596708:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021947136 00000100:00100000:3.0:1790740223.596711:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021947136 00000100:00100000:3.0:1790740223.596722:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790740223.596727:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021947392:12345-0@lo:400: 00000100:00100000:3.0:1790740223.596759:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021947392:12345-0@lo:400: Request processed in 31us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740223.596764:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790740223.596776:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790740223.596781:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021947136:12345-0@lo:400: 00000100:00100000:3.0:1790740223.596811:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021947136:12345-0@lo:400: Request processed in 30us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740223.596816:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790740223.596844:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021947264 00000100:00100000:3.0:1790740223.596848:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021947264 00000100:00100000:3.0:1790740223.596863:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021947648 00000100:00100000:3.0:1790740223.596865:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021947648 00000100:00100000:3.0:1790740223.596877:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021948160 00000100:00100000:3.0:1790740223.596880:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021948160 00000100:00100000:3.0:1790740223.596890:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021947008 00000100:00100000:3.0:1790740223.596893:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021947008 00000100:00100000:3.0:1790740223.596901:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021947520 00000100:00100000:3.0:1790740223.596903:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021947520 00000100:00100000:3.0:1790740223.596923:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021948032 00000100:00100000:3.0:1790740223.596926:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021948032 00000100:00100000:3.0:1790740223.596940:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790740223.596946:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877727021947264:12345-0@lo:400: 00000100:00100000:3.0:1790740223.596977:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877727021947264:12345-0@lo:400: Request processed in 31us (1473us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740223.596982:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790740223.596992:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790740223.596997:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1877727021947648:12345-0@lo:400: 00000100:00100000:3.0:1790740223.597066:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1877727021947648:12345-0@lo:400: Request processed in 69us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740223.597072:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790740223.597083:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790740223.597089:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1877727021948160:12345-0@lo:400: 00000100:00100000:3.0:1790740223.597114:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1877727021948160:12345-0@lo:400: Request processed in 26us (1098us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740223.597119:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790740223.597128:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790740223.597134:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877727021947008:12345-0@lo:400: 00000100:00100000:3.0:1790740223.597159:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877727021947008:12345-0@lo:400: Request processed in 26us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740223.597164:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790740223.597175:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790740223.597180:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1877727021947520:12345-0@lo:400: 00000100:00100000:3.0:1790740223.597205:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1877727021947520:12345-0@lo:400: Request processed in 25us (1061us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740223.597219:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790740223.597231:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790740223.597237:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1877727021948032:12345-0@lo:400: 00000100:00100000:3.0:1790740223.597264:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1877727021948032:12345-0@lo:400: Request processed in 28us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740223.597270:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790740223.597293:0:10118:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021948544 00000100:00100000:3.0:1790740223.597296:0:10118:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021948544 00000100:00100000:3.0:1790740223.597333:0:10118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790740223.597340:0:10118:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021948544:12345-0@lo:13: 00002000:00000024:3.0:1790740223.597364:0:10118:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790740223.597395:0:10118:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021948544:12345-0@lo:13: Request processed in 56us (1194us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740223.597401:0:10118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1790740223.597417:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790740223.597421:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790740223.597423:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790740223.597460:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877727021947008:0@lo:400: 00000100:00100000:3.0:1790740223.597471:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1877727021947520:0@lo:400: 00000100:00100000:3.0:1790740223.597481:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1877727021948032:0@lo:400: 00010000:00080000:3.0:1790740223.597491:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcbfc13100 x1877727021948544/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740239 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740223.597507:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfc13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021948544:0@lo:13: 00000100:00100000:3.0:1790740223.597517:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021947136:0@lo:400: 00010000:00080000:3.0:1790740223.597537:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83d6b480 x1877727021947648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740223.597546:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1877727021947648:0@lo:400: 00010000:00080000:3.0:1790740223.597555:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83d69f80 x1877727021948160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740223.597563:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1877727021948160:0@lo:400: 00000100:00100000:3.0:1790740223.597604:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727021946880:0@lo:400: 00000100:00100000:3.0:1790740223.597614:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021947392:0@lo:400: 00010000:00080000:3.0:1790740223.597624:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83d6aa00 x1877727021947904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740223.597632:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021947904:0@lo:400: 00010000:00080000:3.0:1790740223.597643:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcb5f6e680 x1877727021948416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740223.597650:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021948416:0@lo:400: 00000100:00100000:3.0:1790740223.597660:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877727021947264:0@lo:400: 00010000:00080000:3.0:1790740223.597671:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83d69c00 x1877727021947776/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740223.597678:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021947776:0@lo:400: 00010000:00080000:3.0:1790740223.597686:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83d6bb80 x1877727021948288/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740223.597693:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021948288:0@lo:400: 00000100:00100000:1.0:1790740223.607688:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790740223.611716:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021948672:0@lo:13: 00000100:00100000:1.0:1790740223.612218:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740223.612335:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021948672 00000100:00100000:2.0:1790740223.612344:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021948672 00000100:00100000:2.0:1790740223.612403:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790740223.612413:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5f6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021948672:12345-0@lo:13: 00002000:00000024:2.0:1790740223.612436:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790740223.612508:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5f6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021948672:12345-0@lo:13: Request processed in 97us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740223.612516:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1790740223.613088:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83dc6300 x1877727021948672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740239 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740223.613110:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021948672:0@lo:13: 00010000:00010000:0.0:1790740224.493436:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740224.627421:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790740224.627444:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021948800:0@lo:41: 00000100:00100000:2.0:1790740224.627509:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740224.627610:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021948800 00000100:00100000:1.0:1790740224.627617:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021948800 00000100:00100000:1.0:1790740224.627663:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790740224.627671:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82f98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727021948800:12345-0@lo:41: 00000004:00000024:1.0:1790740224.627702:0:7846:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790740224.627756:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82f98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727021948800:12345-0@lo:41: Request processed in 85us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740224.627762:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790740224.627803:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021948800:0@lo:41: 00000020:00000080:1.0:1790740225.459596:0:10351:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc87c5c140 20000000:00000080:1.0:1790740225.459614:0:10351:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98dcb6d1a400 uarg=0000000000000000 20000000:01000000:1.0:1790740225.459807:0:10351:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1790740225.459810:0:10351:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1790740225.459813:0:10351:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1790740225.459818:0:10351:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1790740225.459823:0:10351:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1790740225.459888:0:10351:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1790740225.459892:0:10351:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1790740225.460574:0:10352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:1.0:1790740225.460860:0:10351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:1.0:1790740225.460889:0:10351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:1.0:1790740225.460916:0:10351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:1.0:1790740225.461000:0:10351:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1790740225.461003:0:10351:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1790740225.461606:0:10353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:1.0:1790740225.461837:0:10351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:1.0:1790740225.461858:0:10351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:1.0:1790740225.461873:0:10351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:1.0:1790740225.461882:0:10351:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1790740225.461884:0:10351:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1790740225.462613:0:10354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:1.0:1790740225.463190:0:10351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:1.0:1790740225.463308:0:10351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:1.0:1790740225.463325:0:10351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:1.0:1790740225.463337:0:10351:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1790740225.463339:0:10351:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1790740225.463703:0:10355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:1.0:1790740225.464003:0:10351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:1.0:1790740225.464176:0:10351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:1.0:1790740225.464288:0:10351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:1.0:1790740225.464301:0:10351:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1790740225.464303:0:10351:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1790740225.464586:0:10356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:1.0:1790740225.465190:0:10351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:1.0:1790740225.465305:0:10351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:1.0:1790740225.465321:0:10351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 10000000:01000000:1.0:1790740225.465334:0:10351:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1790740225.465354:0:10351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98dc80030e00/0xb25dda4f4e92db3b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740225.465374:0:10351:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dc81488400/0xb25dda4f4e92d9d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d9cf expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740225.465382:0:10351:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dcaeee3c00/0xb25dda4f4e92da00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d9f9 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740225.465388:0:10351:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dc81489200/0xb25dda4f4e92da3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92da38 expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740225.465405:0:10351:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dcaeee3200/0xb25dda4f4e92da4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92da46 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740225.465412:0:10351:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dca1968a00/0xb25dda4f4e92da5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92da54 expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740225.465418:0:10351:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dcaeee3800/0xb25dda4f4e92da77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92da70 expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740225.465426:0:10351:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dc81488200/0xb25dda4f4e92daa1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92da9a expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740225.465432:0:10351:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dca1969c00/0xb25dda4f4e92dabd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92dab6 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740225.465439:0:10351:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dcaeee2000/0xb25dda4f4e92dae7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92dae0 expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740225.465449:0:10351:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dcaeee3e00/0xb25dda4f4e92daf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23aee expref: 9 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740225.465456:0:10351:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dcaeee2600/0xb25dda4f4e92dafc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23af5 expref: 9 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740225.465465:0:10351:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98dc80030e00/0xb25dda4f4e92db3b lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740225.465507:0:10351:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dcaeee2600/0xb25dda4f4e92dafc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23af5 expref: 9 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740225.465535:0:10351:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98dcaeee2600/0xb25dda4f4e92dafc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23af5 expref: 9 pid: 6529 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740225.465552:0:10351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1877727021948928:192.168.204.3@tcp:104: 00010000:00010000:1.0:1790740225.465841:0:10351:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dcaeee3e00/0xb25dda4f4e92daf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23aee expref: 9 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740225.465850:0:10351:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98dcaeee3e00/0xb25dda4f4e92daf5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23aee expref: 9 pid: 6528 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740225.465860:0:10351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1877727021949056:192.168.204.3@tcp:104: 00010000:00010000:1.0:1790740225.465893:0:10351:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dcaeee2000/0xb25dda4f4e92dae7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92dae0 expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740225.465901:0:10351:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98dcaeee2000/0xb25dda4f4e92dae7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92dae0 expref: 23 pid: 6528 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740225.465909:0:10351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1877727021949184:0@lo:104: 00000100:00100000:1.0:1790740225.465962:0:10351:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790740225.466010:0:10351:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dca1969c00/0xb25dda4f4e92dabd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92dab6 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740225.466018:0:10351:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98dca1969c00/0xb25dda4f4e92dabd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92dab6 expref: 23 pid: 6529 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740225.466026:0:10351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5df3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1877727021949312:0@lo:104: 00000100:00100000:1.0:1790740225.466265:0:10351:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790740225.466361:0:10351:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dc81488200/0xb25dda4f4e92daa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92da9a expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740225.466369:0:10351:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98dc81488200/0xb25dda4f4e92daa1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92da9a expref: 23 pid: 6529 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740225.466377:0:10351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1877727021949440:0@lo:104: 00000100:00100000:1.0:1790740225.466397:0:10351:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790740225.466588:0:10351:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dcaeee3800/0xb25dda4f4e92da77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92da70 expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740225.466597:0:10351:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98dcaeee3800/0xb25dda4f4e92da77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92da70 expref: 23 pid: 6528 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740225.466606:0:10351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1877727021949568:0@lo:104: 00000100:00100000:1.0:1790740225.466630:0:10351:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740225.468823:0:6519:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021949184 00000100:00100000:0.0:1790740225.468837:0:6519:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021949184 00000100:00100000:0.0:1790740225.468890:0:6519:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021949312 00000100:00100000:0.0:1790740225.468893:0:6519:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021949312 00000100:00100000:0.0:1790740225.468904:0:6519:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021949440 00000100:00100000:0.0:1790740225.468907:0:6519:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021949440 00000100:00100000:0.0:1790740225.468921:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790740225.468940:0:6519:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5f6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+5:10351:x1877727021949184:12345-0@lo:104: 00010000:00010000:0.0:1790740225.468972:0:6519:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3600/0xb25dda4f4e92dae0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92dae7 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740225.469083:0:6519:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790740225.469090:0:6519:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5f6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+5:10351:x1877727021949184:12345-0@lo:104: Request processed in 162us (3129us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740225.469098:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790740225.469115:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790740225.469121:0:6519:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+4:10351:x1877727021949312:12345-0@lo:104: 00010000:00010000:0.0:1790740225.469129:0:6519:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff98dca1969800/0xb25dda4f4e92dab6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92dabd expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740225.469161:0:6519:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790740225.469165:0:6519:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+4:10351:x1877727021949312:12345-0@lo:104: Request processed in 46us (2975us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740225.469171:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790740225.469182:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790740225.469188:0:6519:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+3:10351:x1877727021949440:12345-0@lo:104: 00010000:00010000:0.0:1790740225.469195:0:6519:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff98dc81489000/0xb25dda4f4e92da9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92daa1 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740225.469232:0:6519:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1790740225.469238:0:6519:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+3:10351:x1877727021949440:12345-0@lo:104: Request processed in 51us (2840us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740225.469243:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1790740225.469265:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790740225.469270:0:6524:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3600/0xb25dda4f4e92dae0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92dae7 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740225.469300:0:6524:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee3600 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:0.0:1790740225.469304:0:6524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3600/0xb25dda4f4e92dae0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92dae7 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740225.469312:0:6524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3600/0xb25dda4f4e92dae0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92dae7 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790740225.469319:0:6524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3600/0xb25dda4f4e92dae0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92dae7 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740225.469325:0:6524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790740225.469358:0:6524:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3600/0xb25dda4f4e92dae0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92dae7 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740225.469364:0:6524:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790740225.469384:0:6524:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3600/0xb25dda4f4e92dae0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92dae7 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740225.469390:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3600/0xb25dda4f4e92dae0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92dae7 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740225.469403:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790740225.469405:0:6524:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dca1969800/0xb25dda4f4e92dab6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92dabd expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740225.469410:0:6524:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dca1969800 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:0.0:1790740225.469413:0:6524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dca1969800/0xb25dda4f4e92dab6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92dabd expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740225.469428:0:6524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dca1969800/0xb25dda4f4e92dab6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92dabd expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790740225.469434:0:6524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dca1969800/0xb25dda4f4e92dab6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92dabd expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740225.469439:0:6524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790740225.469452:0:6524:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dca1969800/0xb25dda4f4e92dab6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92dabd expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740225.469458:0:6524:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790740225.469473:0:6524:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dca1969800/0xb25dda4f4e92dab6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92dabd expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740225.469480:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dca1969800/0xb25dda4f4e92dab6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92dabd expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740225.469491:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790740225.469494:0:6524:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dc81489000/0xb25dda4f4e92da9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92daa1 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740225.469499:0:6524:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dc81489000 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:0.0:1790740225.469502:0:6524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dc81489000/0xb25dda4f4e92da9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92daa1 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740225.469507:0:6524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dc81489000/0xb25dda4f4e92da9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92daa1 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790740225.469513:0:6524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dc81489000/0xb25dda4f4e92da9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92daa1 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740225.469523:0:6524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790740225.469535:0:6524:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dc81489000/0xb25dda4f4e92da9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92daa1 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740225.469541:0:6524:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790740225.469546:0:6524:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dc81489000/0xb25dda4f4e92da9a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92daa1 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740225.469553:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dc81489000/0xb25dda4f4e92da9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92daa1 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740225.469562:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740225.469564:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740225.469565:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740225.469587:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd553800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3639:1877727021949696:0@lo:103: 00000100:00100000:0.0:1790740225.469624:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740225.469657:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727021949824:0@lo:103: 00000100:00100000:0.0:1790740225.469681:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740225.469698:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790740225.469719:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727021949952:0@lo:103: 00000100:00100000:0.0:1790740225.469740:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740225.469773:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021949696 00000100:00100000:0.0:1790740225.469778:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021949696 00010000:00010000:0.0:1790740225.469798:0:6522:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dcaeee2000/0xb25dda4f4e92dae7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92dae0 expref: 24 pid: 6528 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740225.469818:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021949824 00000100:00100000:0.0:1790740225.469821:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021949824 00010000:00010000:0.0:1790740225.469840:0:6522:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dca1969c00/0xb25dda4f4e92dabd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92dab6 expref: 25 pid: 6529 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740225.469850:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021949952 00000100:00100000:0.0:1790740225.469853:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021949952 00010000:00010000:0.0:1790740225.469862:0:6522:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dc81488200/0xb25dda4f4e92daa1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92da9a expref: 26 pid: 6529 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740225.469874:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790740225.469881:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc86ac1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+26:3639:x1877727021949696:12345-0@lo:103: 00010000:00010000:0.0:1790740225.469891:0:6522:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740225.469896:0:6522:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dcaeee2000/0xb25dda4f4e92dae7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92dae0 expref: 26 pid: 6528 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740225.469904:0:6522:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dcaeee2000/0xb25dda4f4e92dae7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92dae0 expref: 26 pid: 6528 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740225.469918:0:6522:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740225.469946:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc86ac1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+26:3639:x1877727021949696:12345-0@lo:103: Request processed in 67us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740225.469952:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790740225.469986:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790740225.469992:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd551180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+25:3640:x1877727021949824:12345-0@lo:103: 00010000:00010000:0.0:1790740225.469998:0:6522:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740225.470002:0:6522:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dca1969c00/0xb25dda4f4e92dabd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92dab6 expref: 25 pid: 6529 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740225.470009:0:6522:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dca1969c00/0xb25dda4f4e92dabd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92dab6 expref: 25 pid: 6529 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740225.470050:0:6522:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740225.470077:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd551180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+25:3640:x1877727021949824:12345-0@lo:103: Request processed in 84us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740225.470083:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790740225.470094:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790740225.470100:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd551500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3640:x1877727021949952:12345-0@lo:103: 00010000:00010000:0.0:1790740225.470107:0:6522:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740225.470112:0:6522:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dc81488200/0xb25dda4f4e92daa1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92da9a expref: 24 pid: 6529 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740225.470120:0:6522:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dc81488200/0xb25dda4f4e92daa1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92da9a expref: 24 pid: 6529 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740225.470129:0:6522:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740225.470150:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd551500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3640:x1877727021949952:12345-0@lo:103: Request processed in 51us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740225.470156:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790740225.470192:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd553800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3639:1877727021949696:0@lo:103: 00000100:00100000:0.0:1790740225.470221:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727021949952:0@lo:103: 00000100:00100000:0.0:1790740225.470228:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727021949824:0@lo:103: 00010000:00010000:1.0:1790740225.470683:0:10351:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dca1968a00/0xb25dda4f4e92da5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92da54 expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740225.470695:0:10351:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98dca1968a00/0xb25dda4f4e92da5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92da54 expref: 23 pid: 6528 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740225.470716:0:10351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1877727021950080:0@lo:104: 00010000:00010000:1.0:1790740225.470762:0:10351:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dcaeee3200/0xb25dda4f4e92da4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92da46 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740225.470770:0:10351:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98dcaeee3200/0xb25dda4f4e92da4d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92da46 expref: 23 pid: 6529 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740225.470778:0:10351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1877727021950208:0@lo:104: 00010000:00010000:1.0:1790740225.470807:0:10351:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dc81489200/0xb25dda4f4e92da3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92da38 expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740225.470815:0:10351:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98dc81489200/0xb25dda4f4e92da3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92da38 expref: 23 pid: 6528 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740225.470823:0:10351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1877727021950336:0@lo:104: 00010000:00010000:1.0:1790740225.470844:0:10351:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dcaeee3c00/0xb25dda4f4e92da00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92d9f9 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740225.470851:0:10351:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98dcaeee3c00/0xb25dda4f4e92da00 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92d9f9 expref: 23 pid: 6529 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740225.470857:0:10351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1877727021950464:0@lo:104: 00010000:00010000:1.0:1790740225.470889:0:10351:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dc81488400/0xb25dda4f4e92d9d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92d9cf expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740225.470896:0:10351:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98dc81488400/0xb25dda4f4e92d9d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92d9cf expref: 23 pid: 6530 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740225.470904:0:10351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83eeaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1877727021950592:0@lo:104: 00000100:00100000:1.0:1790740225.470923:0:10351:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc86ae3cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1790740225.471061:0:10351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcaeee2000/0xb25dda4f4e92dae7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92dae0 expref: 23 pid: 6528 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740225.471074:0:10351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1877727021949184:0@lo:104: 00010000:00010000:1.0:1790740225.471085:0:10351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dca1969c00/0xb25dda4f4e92dabd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92dab6 expref: 22 pid: 6529 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740225.471094:0:10351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5df3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1877727021949312:0@lo:104: 00010000:00010000:1.0:1790740225.471113:0:10351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dc81488200/0xb25dda4f4e92daa1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92da9a expref: 21 pid: 6529 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740225.471122:0:10351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1877727021949440:0@lo:104: 00000100:00100000:0.0:1790740225.471320:0:6519:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1790740225.471341:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740225.471353:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740225.471362:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740225.471370:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740225.471378:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740225.471395:0:6519:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021949568 00000100:00100000:0.0:1790740225.471401:0:6519:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021949568 00000100:00100000:0.0:1790740225.471426:0:6519:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021950080 00000100:00100000:0.0:1790740225.471428:0:6519:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021950080 00000100:00100000:0.0:1790740225.471436:0:6519:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021950208 00000100:00100000:0.0:1790740225.471437:0:6519:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021950208 00000100:00100000:0.0:1790740225.471444:0:6519:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021950336 00000100:00100000:0.0:1790740225.471446:0:6519:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021950336 00000100:00100000:0.0:1790740225.471452:0:6519:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021950464 00000100:00100000:0.0:1790740225.471454:0:6519:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021950464 00000100:00100000:0.0:1790740225.471461:0:6519:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021950592 00000100:00100000:0.0:1790740225.471463:0:6519:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021950592 00000100:00100000:0.0:1790740225.471474:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790740225.471481:0:6519:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd50ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+8:10351:x1877727021949568:12345-0@lo:104: 00010000:00010000:0.0:1790740225.471491:0:6519:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2c00/0xb25dda4f4e92da70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92da77 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740225.471583:0:6519:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790740225.471589:0:6519:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd50ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+8:10351:x1877727021949568:12345-0@lo:104: Request processed in 110us (4959us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740225.471595:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790740225.471630:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790740225.471636:0:6519:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd553b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+7:10351:x1877727021950080:12345-0@lo:104: 00010000:00010000:0.0:1790740225.471643:0:6519:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9200/0xb25dda4f4e92da54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92da5b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740225.471723:0:10351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1877727021949568:0@lo:104: 00000100:00100000:1.0:1790740225.471730:0:10351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1877727021950080:0@lo:104: 00010000:00010000:3.0:1790740225.474815:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790740225.474832:0:6524:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2c00/0xb25dda4f4e92da70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92da77 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740225.474843:0:6524:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee2c00 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:3.0:1790740225.474848:0:6524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2c00/0xb25dda4f4e92da70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92da77 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740225.474858:0:6524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2c00/0xb25dda4f4e92da70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92da77 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790740225.474865:0:6524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2c00/0xb25dda4f4e92da70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92da77 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740225.474870:0:6524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790740225.474925:0:6524:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2c00/0xb25dda4f4e92da70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92da77 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740225.474942:0:6524:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790740225.474963:0:6524:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2c00/0xb25dda4f4e92da70 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92da77 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740225.474971:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2c00/0xb25dda4f4e92da70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92da77 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740225.474986:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740225.474989:0:6524:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9200/0xb25dda4f4e92da54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92da5b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740225.475011:0:6524:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc9200 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:3.0:1790740225.475014:0:6524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9200/0xb25dda4f4e92da54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92da5b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740225.475020:0:6524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9200/0xb25dda4f4e92da54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92da5b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790740225.475026:0:6524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9200/0xb25dda4f4e92da54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92da5b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740225.475053:0:6524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790740225.475067:0:6524:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9200/0xb25dda4f4e92da54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92da5b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740225.475073:0:6524:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790740225.475077:0:6524:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9200/0xb25dda4f4e92da54 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92da5b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740225.475084:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9200/0xb25dda4f4e92da54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92da5b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740225.475094:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740225.475095:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740225.475097:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740225.475122:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727021950720:0@lo:103: 00000100:00100000:3.0:1790740225.475194:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740225.475255:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790740225.475262:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727021950848:0@lo:103: 00000100:00100000:3.0:1790740225.475304:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740225.475334:0:6520:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021950720 00000100:00100000:3.0:1790740225.475341:0:6520:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021950720 00010000:00010000:3.0:1790740225.475372:0:6520:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dcaeee3800/0xb25dda4f4e92da77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92da70 expref: 21 pid: 6528 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740225.475397:0:6520:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021950848 00000100:00100000:3.0:1790740225.475401:0:6520:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021950848 00010000:00010000:3.0:1790740225.475412:0:6520:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dca1968a00/0xb25dda4f4e92da5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92da54 expref: 22 pid: 6528 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740225.475430:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790740225.475438:0:6520:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+22:3638:x1877727021950720:12345-0@lo:103: 00010000:00010000:3.0:1790740225.475451:0:6520:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740225.475456:0:6520:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dcaeee3800/0xb25dda4f4e92da77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92da70 expref: 22 pid: 6528 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740225.475466:0:6520:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dcaeee3800/0xb25dda4f4e92da77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92da70 expref: 22 pid: 6528 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740225.475482:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcaeee3800/0xb25dda4f4e92da77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92da70 expref: 22 pid: 6528 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740225.475494:0:6520:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740225.475532:0:6520:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:3638:x1877727021950720:12345-0@lo:103: Request processed in 94us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740225.475539:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790740225.475556:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790740225.475562:0:6520:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+20:3638:x1877727021950848:12345-0@lo:103: 00010000:00010000:3.0:1790740225.475570:0:6520:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740225.475580:0:6520:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dca1968a00/0xb25dda4f4e92da5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92da54 expref: 20 pid: 6528 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740225.475589:0:6520:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dca1968a00/0xb25dda4f4e92da5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92da54 expref: 20 pid: 6528 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740225.475598:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dca1968a00/0xb25dda4f4e92da5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92da54 expref: 20 pid: 6528 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740225.475607:0:6520:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740225.475629:0:6520:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+19:3638:x1877727021950848:12345-0@lo:103: Request processed in 69us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740225.475635:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790740225.475683:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727021950848:0@lo:103: 00000100:00100000:3.0:1790740225.475693:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727021950720:0@lo:103: 00000100:00100000:1.0:1790740225.476428:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740225.476506:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740225.477247:0:9550:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000924800 00000100:00100000:3.0:1790740225.477256:0:9550:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000924800 00010000:00010000:3.0:1790740225.477297:0:9550:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dcaeee2600/0xb25dda4f4e92dafc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23af5 expref: 10 pid: 6529 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740225.477322:0:9550:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000924928 00000100:00100000:3.0:1790740225.477325:0:9550:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000924928 00010000:00010000:3.0:1790740225.477337:0:9550:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dcaeee3e00/0xb25dda4f4e92daf5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23aee expref: 11 pid: 6528 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740225.477355:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 29 00000100:00100000:3.0:1790740225.477362:0:9550:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:160ca934-a0b3-4cb3-b255-c8d008823f6f+11:2403:x1877727000924800:12345-192.168.204.3@tcp:103: 00010000:00010000:3.0:1790740225.477390:0:9550:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740225.477396:0:9550:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dcaeee2600/0xb25dda4f4e92dafc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23af5 expref: 11 pid: 6529 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740225.477412:0:9550:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dcaeee2600/0xb25dda4f4e92dafc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23af5 expref: 11 pid: 6529 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740225.477427:0:9550:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740225.477476:0:9550:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:160ca934-a0b3-4cb3-b255-c8d008823f6f+11:2403:x1877727000924800:12345-192.168.204.3@tcp:103: Request processed in 114us (1051us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740225.477484:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 29 00000100:00100000:3.0:1790740225.477500:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 30 00000100:00100000:3.0:1790740225.477506:0:9550:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:160ca934-a0b3-4cb3-b255-c8d008823f6f+10:2403:x1877727000924928:12345-192.168.204.3@tcp:103: 00010000:00010000:3.0:1790740225.477513:0:9550:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740225.477518:0:9550:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dcaeee3e00/0xb25dda4f4e92daf5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23aee expref: 10 pid: 6528 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740225.477528:0:9550:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dcaeee3e00/0xb25dda4f4e92daf5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23aee expref: 10 pid: 6528 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740225.477537:0:9550:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740225.477554:0:9550:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:160ca934-a0b3-4cb3-b255-c8d008823f6f+10:2403:x1877727000924928:12345-192.168.204.3@tcp:103: Request processed in 48us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740225.477560:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 30 00010000:00010000:3.0:1790740225.477608:0:10351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcaeee2600/0xb25dda4f4e92dafc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23af5 expref: 9 pid: 6529 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740225.477622:0:10351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1877727021948928:192.168.204.3@tcp:104: 00010000:00010000:3.0:1790740225.477632:0:10351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcaeee3e00/0xb25dda4f4e92daf5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23aee expref: 8 pid: 6528 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740225.477652:0:10351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1877727021949056:192.168.204.3@tcp:104: 00010000:00010000:0.0:1790740225.477942:0:6519:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1790740225.477952:0:6519:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd553b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+7:10351:x1877727021950080:12345-0@lo:104: Request processed in 6314us (6608us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740225.477961:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790740225.477990:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790740225.477998:0:6519:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd550380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+6:10351:x1877727021950208:12345-0@lo:104: 00010000:00010000:0.0:1790740225.478009:0:6519:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2e00/0xb25dda4f4e92da46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92da4d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740225.478093:0:6519:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790740225.478099:0:6519:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd550380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+6:10351:x1877727021950208:12345-0@lo:104: Request processed in 103us (6744us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740225.478104:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790740225.478117:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790740225.478123:0:6519:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd553800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+5:10351:x1877727021950336:12345-0@lo:104: 00010000:00010000:0.0:1790740225.478131:0:6519:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2800/0xb25dda4f4e92da38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92da3f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740225.478157:0:6519:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790740225.478162:0:6519:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd553800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+5:10351:x1877727021950336:12345-0@lo:104: Request processed in 39us (6798us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740225.478167:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790740225.478180:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790740225.478186:0:6519:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd551f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+4:10351:x1877727021950464:12345-0@lo:104: 00010000:00010000:0.0:1790740225.478202:0:6519:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8200/0xb25dda4f4e92d9f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92da00 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740225.478230:0:6519:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1790740225.478235:0:6519:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd551f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+4:10351:x1877727021950464:12345-0@lo:104: Request processed in 50us (6864us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740225.478239:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790740225.478258:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790740225.478263:0:6519:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd550e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+3:10351:x1877727021950592:12345-0@lo:104: 00010000:00010000:0.0:1790740225.478270:0:6519:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2200/0xb25dda4f4e92d9cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d9d6 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740225.478310:0:6519:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1790740225.478315:0:6519:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd550e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+3:10351:x1877727021950592:12345-0@lo:104: Request processed in 52us (6936us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740225.478319:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790740225.478503:0:10351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1877727021950208:0@lo:104: 00000100:00100000:1.0:1790740225.478511:0:10351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1877727021950336:0@lo:104: 00000100:00100000:1.0:1790740225.478517:0:10351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1877727021950464:0@lo:104: 00000100:00100000:1.0:1790740225.478523:0:10351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83eeaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1877727021950592:0@lo:104: 00010000:00010000:1.0:1790740225.478561:0:10351:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98dc80030e00/0xb25dda4f4e92db3b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740225.478628:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1790740225.478634:0:6524:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2e00/0xb25dda4f4e92da46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92da4d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740225.478641:0:6524:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee2e00 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:3.0:1790740225.478645:0:6524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2e00/0xb25dda4f4e92da46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92da4d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740225.478653:0:6524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2e00/0xb25dda4f4e92da46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92da4d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790740225.478660:0:6524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2e00/0xb25dda4f4e92da46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92da4d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740225.478666:0:6524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790740225.478779:0:6524:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2e00/0xb25dda4f4e92da46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92da4d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740225.478983:0:6524:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1790740225.479047:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727021950976:0@lo:103: 00000100:00100000:1.0:1790740225.479089:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790740225.479156:0:6524:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2e00/0xb25dda4f4e92da46 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92da4d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740225.479164:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2e00/0xb25dda4f4e92da46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92da4d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740225.479176:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1790740225.479179:0:6524:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2800/0xb25dda4f4e92da38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92da3f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740225.479208:0:6524:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee2800 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:3.0:1790740225.479212:0:6524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2800/0xb25dda4f4e92da38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92da3f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740225.479219:0:6524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2800/0xb25dda4f4e92da38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92da3f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790740225.479225:0:6524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2800/0xb25dda4f4e92da38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92da3f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740225.479231:0:6524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790740225.479244:0:6524:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2800/0xb25dda4f4e92da38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92da3f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740225.479250:0:6524:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790740225.479412:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1790740225.479522:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790740225.479528:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727021951104:0@lo:103: 00000100:00100000:1.0:1790740225.479552:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740225.479614:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021950976 00000100:00100000:0.0:1790740225.479621:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021950976 00010000:00010000:0.0:1790740225.479646:0:6521:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dcaeee3200/0xb25dda4f4e92da4d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92da46 expref: 19 pid: 6529 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740225.479675:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021951104 00000100:00100000:0.0:1790740225.479679:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021951104 00010000:00010000:0.0:1790740225.479689:0:6521:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dc81489200/0xb25dda4f4e92da3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92da38 expref: 20 pid: 6528 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740225.479717:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790740225.479723:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc86ac2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+20:3640:x1877727021950976:12345-0@lo:103: 00010000:00010000:0.0:1790740225.479732:0:6521:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740225.479735:0:6521:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dcaeee3200/0xb25dda4f4e92da4d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92da46 expref: 20 pid: 6529 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740225.479744:0:6521:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dcaeee3200/0xb25dda4f4e92da4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92da46 expref: 20 pid: 6529 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740225.479756:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcaeee3200/0xb25dda4f4e92da4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92da46 expref: 20 pid: 6529 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740225.479776:0:6521:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740225.479824:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc86ac2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+19:3640:x1877727021950976:12345-0@lo:103: Request processed in 100us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740225.479830:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790740225.479868:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790740225.479874:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+18:3640:x1877727021951104:12345-0@lo:103: 00010000:00010000:0.0:1790740225.479880:0:6521:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740225.479884:0:6521:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dc81489200/0xb25dda4f4e92da3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92da38 expref: 18 pid: 6528 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740225.479893:0:6521:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dc81489200/0xb25dda4f4e92da3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92da38 expref: 18 pid: 6528 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740225.479901:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dc81489200/0xb25dda4f4e92da3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92da38 expref: 18 pid: 6528 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740225.479909:0:6521:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740225.479943:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:3640:x1877727021951104:12345-0@lo:103: Request processed in 69us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740225.479949:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790740225.479972:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727021951104:0@lo:103: 00000100:00100000:0.0:1790740225.479979:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727021950976:0@lo:103: 00010000:00010000:3.0:1790740225.480786:0:6524:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2800/0xb25dda4f4e92da38 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92da3f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740225.480797:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2800/0xb25dda4f4e92da38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92da3f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740225.480809:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740225.480812:0:6524:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2200/0xb25dda4f4e92d9cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d9d6 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740225.480819:0:6524:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee2200 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:3.0:1790740225.480822:0:6524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2200/0xb25dda4f4e92d9cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92d9d6 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740225.480844:0:6524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2200/0xb25dda4f4e92d9cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92d9d6 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790740225.480851:0:6524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2200/0xb25dda4f4e92d9cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92d9d6 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740225.480857:0:6524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790740225.480924:0:6524:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2200/0xb25dda4f4e92d9cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d9d6 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740225.480941:0:6524:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790740225.480965:0:6524:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2200/0xb25dda4f4e92d9cf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d9d6 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740225.480972:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2200/0xb25dda4f4e92d9cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d9d6 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740225.480981:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740225.480983:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740225.480985:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740225.481065:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727021951232:0@lo:103: 00000100:00100000:1.0:1790740225.481105:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740225.481149:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021951232 00000100:00100000:1.0:1790740225.481155:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021951232 00010000:00010000:1.0:1790740225.481178:0:6521:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dc81488400/0xb25dda4f4e92d9d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d9cf expref: 17 pid: 6530 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740225.481222:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790740225.481229:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eeb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:3638:x1877727021951232:12345-0@lo:103: 00010000:00010000:1.0:1790740225.481239:0:6521:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740225.481243:0:6521:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dc81488400/0xb25dda4f4e92d9d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d9cf expref: 17 pid: 6530 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740225.481251:0:6521:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dc81488400/0xb25dda4f4e92d9d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92d9cf expref: 17 pid: 6530 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740225.481262:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dc81488400/0xb25dda4f4e92d9d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92d9cf expref: 17 pid: 6530 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740225.481273:0:6521:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740225.481313:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eeb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:3638:x1877727021951232:12345-0@lo:103: Request processed in 85us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740225.481319:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790740225.481345:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727021951232:0@lo:103: 00010000:00010000:2.0:1790740225.482902:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740225.482906:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740225.482908:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740225.482948:0:6523:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8200/0xb25dda4f4e92d9f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92da00 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740225.482959:0:6523:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc8200 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:1.0:1790740225.482963:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8200/0xb25dda4f4e92d9f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92da00 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740225.482972:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8200/0xb25dda4f4e92d9f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92da00 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790740225.482980:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8200/0xb25dda4f4e92d9f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92da00 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740225.482996:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790740225.483558:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8200/0xb25dda4f4e92d9f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92da00 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740225.483567:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790740225.483589:0:6523:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8200/0xb25dda4f4e92d9f9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92da00 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740225.483596:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8200/0xb25dda4f4e92d9f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92da00 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740225.483615:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740225.483617:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740225.483618:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740225.483625:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790740225.483640:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83eeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727021951360:0@lo:103: 00000100:00100000:1.0:1790740225.483698:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740225.483870:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021951360 00000100:00100000:2.0:1790740225.483877:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021951360 00010000:00010000:2.0:1790740225.483910:0:6522:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dcaeee3c00/0xb25dda4f4e92da00 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d9f9 expref: 16 pid: 6529 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740225.483950:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790740225.483959:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:3638:x1877727021951360:12345-0@lo:103: 00010000:00010000:2.0:1790740225.483970:0:6522:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740225.483976:0:6522:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dcaeee3c00/0xb25dda4f4e92da00 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d9f9 expref: 16 pid: 6529 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740225.483987:0:6522:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dcaeee3c00/0xb25dda4f4e92da00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92d9f9 expref: 16 pid: 6529 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740225.484000:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcaeee3c00/0xb25dda4f4e92da00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92d9f9 expref: 16 pid: 6529 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740225.484012:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98dc80030e00/0xb25dda4f4e92db3b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740225.484020:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dc80030e00/0xb25dda4f4e92db3b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740225.484068:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98dc80030e00/0xb25dda4f4e92db3b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740225.484076:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98dc80030e00/0xb25dda4f4e92db3b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740225.484082:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98dc80030e00/0xb25dda4f4e92db3b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740225.484088:0:6522:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98dc80030e00/0xb25dda4f4e92db3b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740225.484103:0:6522:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dc80030e00 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:2.0:1790740225.484106:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98dc80030e00/0xb25dda4f4e92db3b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740225.484114:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98dc80030e00/0xb25dda4f4e92db3b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740225.484125:0:6522:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98dc80030e00/0xb25dda4f4e92db3b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740225.484135:0:6522:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740225.484170:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:3638:x1877727021951360:12345-0@lo:103: Request processed in 212us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740225.484177:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790740225.484381:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83eeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727021951360:0@lo:103: 00010000:00010000:1.0:1790740225.484405:0:10351:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98dc80030e00/0xb25dda4f4e92db3b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740225.484413:0:10351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98dc80030e00/0xb25dda4f4e92db3b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740225.484419:0:10351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dc80030e00/0xb25dda4f4e92db3b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740225.515578:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740226.538327:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740226.671803:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790740226.671831:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021951488:0@lo:41: 00000100:00100000:1.0:1790740226.671924:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740226.673349:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021951488 00000100:00100000:3.0:1790740226.673362:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021951488 00000100:00100000:3.0:1790740226.673444:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790740226.673457:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021951488:12345-0@lo:41: 00000004:00000024:3.0:1790740226.673499:0:6541:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1790740226.673585:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021951488:12345-0@lo:41: Request processed in 131us (1661us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740226.673592:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790740226.677594:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021951488:0@lo:41: 10000000:01000000:0.0:1790740226.795073:0:6532:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1790740226.795081:0:6532:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98dcb5f0a000 from 48 10000000:01000000:0.0:1790740226.795088:0:6532:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790740226.795170:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaf061e00/0xb25dda4f4e92db42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740226.795184:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dcaf061e00/0xb25dda4f4e92db42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740226.795196:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dcaf061e00/0xb25dda4f4e92db42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740226.795220:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd551180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021951616:0@lo:101: 00000100:00100000:0.0:1790740226.795302:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740226.795608:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb6db2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790740226.795879:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021951616 00000100:00100000:2.0:1790740226.795887:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021951616 00000100:00100000:2.0:1790740226.821066:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1790740226.821091:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99054450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+15:6532:x1877727021951616:12345-0@lo:101: 00010000:00010000:2.0:1790740226.821123:0:6529:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740226.821147:0:6529:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dc81489e00/0xb25dda4f4e92db49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92db42 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740226.821175:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dc81489e00/0xb25dda4f4e92db49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92db42 expref: 16 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740226.821186:0:6529:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dc81489e00/0xb25dda4f4e92db49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92db42 expref: 16 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740226.821212:0:6529:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dc81489e00, rc 0) 00000100:00100000:2.0:1790740226.821296:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99054450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:6532:x1877727021951616:12345-0@lo:101: Request processed in 217us (25992us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740226.821303:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1790740226.823225:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd551180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021951616:0@lo:101: 00010000:00010000:0.0:1790740226.823250:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dcaf061e00/0xb25dda4f4e92db42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92db49 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740226.823272:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dcaf061e00/0xb25dda4f4e92db42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92db49 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740226.823360:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd551180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021951744:0@lo:501: 00000100:00100000:0.0:1790740226.823414:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740226.823463:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb6db2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790740226.823535:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021951744 00000100:00100000:3.0:1790740226.823542:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021951744 00000100:00100000:3.0:1790740226.823592:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1790740226.823600:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99057450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:6532:x1877727021951744:12345-0@lo:501: 00000100:00100000:3.0:1790740226.823729:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99057450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:6532:x1877727021951744:12345-0@lo:501: Request processed in 129us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740226.823736:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1790740226.824146:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd551180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021951744:0@lo:501: 00000100:00100000:0.0:1790740226.824176:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd551180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021951872:0@lo:503: 00000100:00100000:0.0:1790740226.824221:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740226.824301:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb6db2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790740226.830559:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021951872 00000100:00100000:3.0:1790740226.830575:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021951872 00000100:00100000:3.0:1790740226.830651:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1790740226.830660:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99056c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:6532:x1877727021951872:12345-0@lo:503: 00000100:00100000:3.0:1790740226.831166:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99056c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:6532:x1877727021951872:12345-0@lo:503: Request processed in 506us (6943us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740226.831175:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1790740226.831294:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd551180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021951872:0@lo:503: 00000100:00100000:0.0:1790740226.832293:0:10369:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd551180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:10369:1877727021952000:0@lo:502: 00000100:00100000:0.0:1790740226.832363:0:10369:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740226.832407:0:10369:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb6db2900 going to sleep for 11 seconds 00000100:00100000:2.0:1790740226.832468:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021952000 00000100:00100000:2.0:1790740226.832474:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021952000 00000100:00100000:2.0:1790740226.832515:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1790740226.832523:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99057050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:10369:x1877727021952000:12345-0@lo:502: 00000100:00100000:2.0:1790740226.832647:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99057050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:10369:x1877727021952000:12345-0@lo:502: Request processed in 125us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740226.832654:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1790740226.832790:0:10369:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd551180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:10369:1877727021952000:0@lo:502: 00000100:00100000:1.0:1790740226.832923:0:10369:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ee8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:10369:1877727021952128:0@lo:502: 00000100:00100000:1.0:1790740226.832969:0:10369:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740226.832994:0:10369:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc86ae3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790740226.834640:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021952128 00000100:00100000:3.0:1790740226.834653:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021952128 00000100:00100000:3.0:1790740226.834711:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1790740226.834720:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99055050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:10369:x1877727021952128:12345-0@lo:502: 00000100:00100000:3.0:1790740226.834992:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99055050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:10369:x1877727021952128:12345-0@lo:502: Request processed in 273us (2022us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740226.835000:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1790740226.835223:0:10369:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ee8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:10369:1877727021952128:0@lo:502: 00000040:00080000:1.0:1790740226.835267:0:10369:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1790740226.835620:0:6532:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1790740226.835643:0:6532:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790740226.835654:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaf061e00/0xb25dda4f4e92db42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92db49 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740226.835665:0:6532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dcaf061e00/0xb25dda4f4e92db42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92db49 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740226.835688:0:6532:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1790740226.835691:0:6532:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1790740226.835694:0:6532:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1790740226.835722:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9200/0xb25dda4f4e92db50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740226.835730:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9200/0xb25dda4f4e92db50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740226.835740:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9200/0xb25dda4f4e92db50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740226.835757:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021952256:0@lo:101: 00000100:00100000:3.0:1790740226.835794:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740226.835948:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5fedf00 going to sleep for 11 seconds 00000100:00100000:0.0:1790740226.836012:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021952256 00000100:00100000:0.0:1790740226.836017:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021952256 00000100:00100000:0.0:1790740226.836094:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1790740226.836109:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99056450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+16:6532:x1877727021952256:12345-0@lo:101: 00010000:00010000:0.0:1790740226.836121:0:6528:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740226.836135:0:6528:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcaf060400/0xb25dda4f4e92db57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92db50 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740226.836156:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcaf060400/0xb25dda4f4e92db57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92db50 expref: 17 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740226.836165:0:6528:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcaf060400/0xb25dda4f4e92db57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92db50 expref: 17 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740226.836173:0:6528:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaf060400, rc 0) 00000100:00100000:0.0:1790740226.836215:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99056450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:6532:x1877727021952256:12345-0@lo:101: Request processed in 114us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740226.836221:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1790740226.836467:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021952256:0@lo:101: 00010000:00010000:3.0:1790740226.836480:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9200/0xb25dda4f4e92db50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92db57 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740226.836489:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9200/0xb25dda4f4e92db50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92db57 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740226.836540:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021952384:0@lo:501: 00000100:00100000:3.0:1790740226.836565:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740226.836589:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5fedf00 going to sleep for 11 seconds 00000100:00100000:1.0:1790740226.836665:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021952384 00000100:00100000:1.0:1790740226.836670:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021952384 00000100:00100000:1.0:1790740226.836700:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1790740226.836707:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99056050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:6532:x1877727021952384:12345-0@lo:501: 00000100:00100000:1.0:1790740226.837060:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99056050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:6532:x1877727021952384:12345-0@lo:501: Request processed in 353us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740226.837077:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1790740226.847544:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021952384:0@lo:501: 00000100:00100000:2.0:1790740226.847745:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f9b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021952512:0@lo:503: 00000100:00100000:2.0:1790740226.847842:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740226.847884:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82c75480 going to sleep for 11 seconds 00000100:00100000:0.0:1790740226.847946:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021952512 00000100:00100000:0.0:1790740226.847953:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021952512 00000100:00100000:0.0:1790740226.848006:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1790740226.848014:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99054050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:6532:x1877727021952512:12345-0@lo:503: 00000100:00100000:0.0:1790740226.848168:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99054050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:6532:x1877727021952512:12345-0@lo:503: Request processed in 154us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740226.848176:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1790740226.848377:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f9b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021952512:0@lo:503: 00000100:00100000:2.0:1790740226.848783:0:10370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f9b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:10370:1877727021952640:0@lo:502: 00000100:00100000:2.0:1790740226.848831:0:10370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740226.848862:0:10370:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82c75600 going to sleep for 11 seconds 00000100:00100000:0.0:1790740226.848909:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021952640 00000100:00100000:0.0:1790740226.848919:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021952640 00000100:00100000:0.0:1790740226.848952:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1790740226.848960:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99055850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:10370:x1877727021952640:12345-0@lo:502: 00000100:00100000:0.0:1790740226.849090:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99055850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:10370:x1877727021952640:12345-0@lo:502: Request processed in 130us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740226.849098:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1790740226.849437:0:10370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f9b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:10370:1877727021952640:0@lo:502: 00000020:01000000:3.0:1790740226.849464:0:10370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790740226.849473:0:10370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790740226.849475:0:10370:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1790740226.849481:0:10370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1790740226.849501:0:10370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:10370:1877727021952768:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790740226.849534:0:10370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740226.849563:0:10370:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5fedf00 going to sleep for 11 seconds 00000100:00100000:1.0:1790740226.849608:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021952768 00000100:00100000:1.0:1790740226.849613:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021952768 00000100:00100000:1.0:1790740226.849635:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1790740226.849641:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99054850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:10370:x1877727021952768:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790740226.849720:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99054850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:10370:x1877727021952768:12345-0@lo:502:llog_process_th.0 Request processed in 79us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740226.849727:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1790740226.849929:0:10370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:10370:1877727021952768:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790740226.849947:0:10370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790740226.849953:0:10370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790740226.849954:0:10370:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1790740226.849958:0:10370:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:0.0:1790740226.850545:0:6532:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1790740226.850568:0:6532:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1790740226.850579:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9200/0xb25dda4f4e92db50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92db57 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740226.850591:0:6532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9200/0xb25dda4f4e92db50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92db57 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740226.850600:0:6532:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1790740226.850603:0:6532:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98dcaedda800 from 48 10000000:01000000:0.0:1790740226.850606:0:6532:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790740226.850634:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaf060000/0xb25dda4f4e92db5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740226.850642:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dcaf060000/0xb25dda4f4e92db5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740226.850652:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dcaf060000/0xb25dda4f4e92db5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740226.850667:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd551500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021952896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790740226.850705:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740226.850743:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb6db2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790740226.850797:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021952896 00000100:00100000:2.0:1790740226.850816:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021952896 00000100:00100000:2.0:1790740226.850858:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1790740226.850866:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+17:6532:x1877727021952896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790740226.850877:0:6529:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740226.850888:0:6529:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dc81488400/0xb25dda4f4e92db65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92db5e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740226.850923:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dc81488400/0xb25dda4f4e92db65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92db5e expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740226.850933:0:6529:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dc81488400/0xb25dda4f4e92db65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92db5e expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740226.850942:0:6529:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dc81488400, rc 0) 00000100:00100000:2.0:1790740226.850982:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+18:6532:x1877727021952896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740226.850988:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1790740226.851066:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd551500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021952896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790740226.851084:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dcaf060000/0xb25dda4f4e92db5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92db65 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740226.851093:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dcaf060000/0xb25dda4f4e92db5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92db65 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740226.851142:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd551500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021953024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790740226.851165:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740226.851194:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb6db2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790740226.851244:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021953024 00000100:00100000:2.0:1790740226.851248:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021953024 00000100:00100000:2.0:1790740226.851291:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1790740226.851298:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+18:6532:x1877727021953024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790740226.851403:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+18:6532:x1877727021953024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 105us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740226.851409:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1790740226.851536:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd551500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021953024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790740226.851563:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd551500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021953152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790740226.851598:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740226.851620:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb6db2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790740226.851733:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021953152 00000100:00100000:3.0:1790740226.851738:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021953152 00000100:00100000:3.0:1790740226.851760:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1790740226.851766:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+18:6532:x1877727021953152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790740226.851850:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+18:6532:x1877727021953152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740226.851858:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1790740226.855508:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd551500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021953152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790740226.859872:0:10371:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:10371:1877727021953280:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790740226.859961:0:10371:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740226.860008:0:10371:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5fed540 going to sleep for 11 seconds 00000100:00100000:0.0:1790740226.860073:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021953280 00000100:00100000:0.0:1790740226.860081:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021953280 00000100:00100000:0.0:1790740226.860121:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1790740226.860130:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+18:10371:x1877727021953280:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790740226.860284:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+18:10371:x1877727021953280:12345-0@lo:502:llog_process_th.0 Request processed in 154us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740226.860292:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1790740226.860398:0:10371:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:10371:1877727021953280:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790740226.860449:0:10371:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f9b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:10371:1877727021953408:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790740226.860482:0:10371:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740226.860512:0:10371:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82c75600 going to sleep for 11 seconds 00000100:00100000:0.0:1790740226.860928:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021953408 00000100:00100000:0.0:1790740226.860934:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021953408 00000100:00100000:0.0:1790740226.860969:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1790740226.860977:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+18:10371:x1877727021953408:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790740226.861089:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+18:10371:x1877727021953408:12345-0@lo:502:llog_process_th.0 Request processed in 112us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740226.861096:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1790740226.861180:0:10371:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f9b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:10371:1877727021953408:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1790740226.861200:0:10371:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1790740226.861709:0:6532:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1790740226.861730:0:6532:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790740226.861741:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaf060000/0xb25dda4f4e92db5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92db65 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740226.861752:0:6532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dcaf060000/0xb25dda4f4e92db5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92db65 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740226.861762:0:6532:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1790740226.861765:0:6532:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1790740226.861768:0:6532:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1790740226.861796:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaf060600/0xb25dda4f4e92db6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740226.861821:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dcaf060600/0xb25dda4f4e92db6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740226.861830:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dcaf060600/0xb25dda4f4e92db6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740226.861846:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd551500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021953536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790740226.861879:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740226.861903:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb6db2540 going to sleep for 11 seconds 00000100:00100000:2.0:1790740226.862018:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021953536 00000100:00100000:2.0:1790740226.862024:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021953536 00000100:00100000:2.0:1790740226.862107:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1790740226.862114:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+18:6532:x1877727021953536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790740226.862124:0:6528:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740226.862137:0:6528:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dc81488800/0xb25dda4f4e92db73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92db6c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740226.862157:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dc81488800/0xb25dda4f4e92db73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92db6c expref: 19 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740226.862166:0:6528:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dc81488800/0xb25dda4f4e92db73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92db6c expref: 19 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740226.862175:0:6528:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dc81488800, rc 0) 00000100:00100000:2.0:1790740226.862212:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+19:6532:x1877727021953536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740226.862218:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1790740226.862302:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd551500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021953536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790740226.862315:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dcaf060600/0xb25dda4f4e92db6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92db73 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740226.862322:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dcaf060600/0xb25dda4f4e92db6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92db73 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740226.862379:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021953664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790740226.862404:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740226.862430:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5fed540 going to sleep for 11 seconds 00000100:00100000:0.0:1790740226.863172:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021953664 00000100:00100000:0.0:1790740226.863180:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021953664 00000100:00100000:0.0:1790740226.863210:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1790740226.863227:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+19:6532:x1877727021953664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790740226.863366:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+19:6532:x1877727021953664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 141us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740226.863373:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1790740226.863492:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021953664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790740226.863529:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021953792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790740226.863566:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740226.863586:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5fed540 going to sleep for 11 seconds 00000100:00100000:2.0:1790740226.863648:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021953792 00000100:00100000:2.0:1790740226.863652:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021953792 00000100:00100000:2.0:1790740226.863672:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1790740226.863678:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+19:6532:x1877727021953792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790740226.863762:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+19:6532:x1877727021953792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740226.863769:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1790740226.864277:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021953792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790740226.864784:0:10372:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:10372:1877727021953920:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790740226.864849:0:10372:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740226.864882:0:10372:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5fed000 going to sleep for 11 seconds 00000100:00100000:2.0:1790740226.864924:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021953920 00000100:00100000:2.0:1790740226.864930:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021953920 00000100:00100000:2.0:1790740226.864972:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1790740226.864980:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+19:10372:x1877727021953920:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790740226.865162:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+19:10372:x1877727021953920:12345-0@lo:502:llog_process_th.0 Request processed in 183us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740226.865175:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1790740226.873249:0:10372:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:10372:1877727021953920:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790740226.873316:0:10372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790740226.873330:0:10372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740226.873332:0:10372:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1790740226.873339:0:10372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1790740226.873383:0:10372:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd552d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:10372:1877727021954048:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790740226.873460:0:10372:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740226.873518:0:10372:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5fed000 going to sleep for 11 seconds 00000100:00100000:2.0:1790740226.873592:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021954048 00000100:00100000:2.0:1790740226.873599:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021954048 00000100:00100000:2.0:1790740226.873655:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1790740226.873664:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+19:10372:x1877727021954048:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790740226.873786:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+19:10372:x1877727021954048:12345-0@lo:502:llog_process_th.0 Request processed in 123us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740226.873794:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1790740226.873891:0:10372:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd552d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:10372:1877727021954048:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790740226.873911:0:10372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790740226.873918:0:10372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740226.873920:0:10372:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790740226.873930:0:10372:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:2.0:1790740226.874172:0:6532:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1790740226.874195:0:6532:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1790740226.874204:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaf060600/0xb25dda4f4e92db6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92db73 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740226.874215:0:6532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dcaf060600/0xb25dda4f4e92db6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92db73 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740226.874224:0:6532:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1790740226.874227:0:6532:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98dca0cb4800 from 48 10000000:01000000:2.0:1790740226.874229:0:6532:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790740226.874266:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dc81488e00/0xb25dda4f4e92db7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740226.874273:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dc81488e00/0xb25dda4f4e92db7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740226.874283:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dc81488e00/0xb25dda4f4e92db7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740226.874297:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f9b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021954176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790740226.874333:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740226.874366:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82c750c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790740226.874407:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021954176 00000100:00100000:1.0:1790740226.874412:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021954176 00000100:00100000:1.0:1790740226.874445:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1790740226.874451:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+19:6532:x1877727021954176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790740226.874461:0:6529:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740226.874472:0:6529:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dc80030e00/0xb25dda4f4e92db81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92db7a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740226.874492:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dc80030e00/0xb25dda4f4e92db81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92db7a expref: 20 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740226.874502:0:6529:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dc80030e00/0xb25dda4f4e92db81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92db7a expref: 20 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740226.874511:0:6529:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dc80030e00, rc 0) 00000100:00100000:1.0:1790740226.874539:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+20:6532:x1877727021954176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740226.874545:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1790740226.874606:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f9b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021954176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790740226.874617:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dc81488e00/0xb25dda4f4e92db7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92db81 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740226.874625:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dc81488e00/0xb25dda4f4e92db7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92db81 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740226.874671:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f9b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021954304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790740226.874695:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740226.874714:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82c750c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790740226.874751:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021954304 00000100:00100000:1.0:1790740226.874755:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021954304 00000100:00100000:1.0:1790740226.874782:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1790740226.874788:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+20:6532:x1877727021954304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790740226.874892:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+20:6532:x1877727021954304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 103us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740226.874899:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1790740226.875220:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f9b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021954304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790740226.875248:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f9b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021954432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790740226.875298:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740226.875313:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82c750c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790740226.875380:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021954432 00000100:00100000:1.0:1790740226.875384:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021954432 00000100:00100000:1.0:1790740226.875409:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1790740226.875422:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+20:6532:x1877727021954432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790740226.875496:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+20:6532:x1877727021954432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740226.875503:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1790740226.875580:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f9b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021954432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790740226.876601:0:10373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:10373:1877727021954560:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790740226.876654:0:10373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740226.876691:0:10373:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5fbfd80 going to sleep for 11 seconds 00000100:00100000:1.0:1790740226.876732:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021954560 00000100:00100000:1.0:1790740226.876738:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021954560 00000100:00100000:1.0:1790740226.876775:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1790740226.876782:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+20:10373:x1877727021954560:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790740226.876892:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+20:10373:x1877727021954560:12345-0@lo:502:llog_process_th.0 Request processed in 110us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740226.876900:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1790740226.877312:0:10373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:10373:1877727021954560:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790740226.877358:0:10373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:10373:1877727021954688:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790740226.877405:0:10373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740226.877465:0:10373:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc85f9c000 going to sleep for 11 seconds 00000100:00100000:0.0:1790740226.888950:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021954688 00000100:00100000:0.0:1790740226.888965:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021954688 00000100:00100000:0.0:1790740226.889057:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1790740226.889068:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+20:10373:x1877727021954688:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790740226.889474:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+20:10373:x1877727021954688:12345-0@lo:502:llog_process_th.0 Request processed in 407us (12079us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740226.889484:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1790740226.889589:0:10373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:10373:1877727021954688:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1790740226.889625:0:10373:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1790740226.889790:0:6532:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1790740226.889811:0:6532:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790740226.889820:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dc81488e00/0xb25dda4f4e92db7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92db81 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740226.889831:0:6532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dc81488e00/0xb25dda4f4e92db7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92db81 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740226.889840:0:6532:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1790740226.889852:0:6532:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:2.0:1790740226.889854:0:6532:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1790740226.889885:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dc81489200/0xb25dda4f4e92db88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740226.889893:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dc81489200/0xb25dda4f4e92db88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740226.889901:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dc81489200/0xb25dda4f4e92db88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740226.889921:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f9b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021954816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790740226.889961:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740226.890002:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82c750c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790740226.890082:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021954816 00000100:00100000:1.0:1790740226.890089:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021954816 00000100:00100000:1.0:1790740226.890133:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1790740226.890141:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+20:6532:x1877727021954816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790740226.890151:0:6530:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740226.890166:0:6530:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dc80031400/0xb25dda4f4e92db8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92db88 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740226.890187:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dc80031400/0xb25dda4f4e92db8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92db88 expref: 21 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740226.890196:0:6530:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dc80031400/0xb25dda4f4e92db8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92db88 expref: 21 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740226.890204:0:6530:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dc80031400, rc 0) 00000100:00100000:1.0:1790740226.890240:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:6532:x1877727021954816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740226.890266:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1790740226.890433:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f9b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021954816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790740226.890454:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dc81489200/0xb25dda4f4e92db88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92db8f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740226.890463:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dc81489200/0xb25dda4f4e92db88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92db8f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740226.890518:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021954944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790740226.890545:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740226.890565:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc85f9c000 going to sleep for 11 seconds 00000100:00100000:2.0:1790740226.890623:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021954944 00000100:00100000:2.0:1790740226.890627:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021954944 00000100:00100000:2.0:1790740226.890663:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1790740226.890671:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:6532:x1877727021954944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790740226.890792:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:6532:x1877727021954944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740226.890799:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1790740226.890857:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021954944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790740226.890883:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021955072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790740226.890918:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740226.890939:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc85f9c000 going to sleep for 11 seconds 00000100:00100000:0.0:1790740226.890997:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021955072 00000100:00100000:0.0:1790740226.891001:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021955072 00000100:00100000:0.0:1790740226.891018:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1790740226.891024:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:6532:x1877727021955072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790740226.891149:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:6532:x1877727021955072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 124us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740226.891155:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1790740226.891410:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021955072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790740226.894527:0:10374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd551880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:10374:1877727021955200:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790740226.894604:0:10374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740226.896479:0:10374:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc8569bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1790740226.896661:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021955200 00000100:00100000:2.0:1790740226.896670:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021955200 00000100:00100000:2.0:1790740226.896724:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1790740226.896734:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:10374:x1877727021955200:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790740226.896885:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:10374:x1877727021955200:12345-0@lo:502:llog_process_th.0 Request processed in 152us (2279us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740226.896893:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1790740226.898643:0:10374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd551880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:10374:1877727021955200:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790740226.898690:0:10374:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790740226.898701:0:10374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740226.898703:0:10374:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1790740226.898709:0:10374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1790740226.898746:0:10374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd551880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:10374:1877727021955328:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790740226.898810:0:10374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740226.898852:0:10374:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc8569bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1790740226.898949:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021955328 00000100:00100000:1.0:1790740226.898956:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021955328 00000100:00100000:1.0:1790740226.899005:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1790740226.899014:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:10374:x1877727021955328:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790740226.899163:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:10374:x1877727021955328:12345-0@lo:502:llog_process_th.0 Request processed in 150us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740226.899171:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1790740226.906706:0:10374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd551880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:10374:1877727021955328:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790740226.906754:0:10374:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790740226.906765:0:10374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740226.906768:0:10374:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1790740226.906772:0:10374:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:3.0:1790740226.907828:0:6532:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:3.0:1790740226.907854:0:6532:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1790740226.907865:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dc81489200/0xb25dda4f4e92db88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92db8f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740226.907877:0:6532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dc81489200/0xb25dda4f4e92db88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92db8f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740226.907886:0:6532:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1790740226.907889:0:6532:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98dc82d23800 from 48 10000000:01000000:3.0:1790740226.907891:0:6532:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790740226.907923:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8e00/0xb25dda4f4e92db96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740226.907944:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8e00/0xb25dda4f4e92db96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740226.907954:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8e00/0xb25dda4f4e92db96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740226.907973:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021955456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790740226.908063:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740226.908095:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc85f9c000 going to sleep for 11 seconds 00000100:00100000:1.0:1790740226.908298:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021955456 00000100:00100000:1.0:1790740226.908305:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021955456 00000100:00100000:1.0:1790740226.908350:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1790740226.908358:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:6532:x1877727021955456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790740226.908370:0:6529:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740226.908382:0:6529:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dc80030800/0xb25dda4f4e92db9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92db96 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740226.908413:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dc80030800/0xb25dda4f4e92db9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92db96 expref: 22 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740226.908423:0:6529:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dc80030800/0xb25dda4f4e92db9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92db96 expref: 22 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740226.908431:0:6529:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dc80030800, rc 0) 00000100:00100000:1.0:1790740226.908471:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+22:6532:x1877727021955456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740226.908478:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1790740226.908641:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021955456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790740226.908653:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8e00/0xb25dda4f4e92db96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92db9d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740226.908662:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8e00/0xb25dda4f4e92db96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92db9d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740226.908709:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021955584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790740226.908734:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740226.908759:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc85f9c000 going to sleep for 11 seconds 00000100:00100000:0.0:1790740226.908797:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021955584 00000100:00100000:0.0:1790740226.908801:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021955584 00000100:00100000:0.0:1790740226.908832:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1790740226.908839:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+22:6532:x1877727021955584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790740226.908960:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+22:6532:x1877727021955584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740226.908966:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1790740226.909300:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021955584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790740226.909331:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021955712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790740226.909370:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740226.909402:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc85f9c000 going to sleep for 11 seconds 00000100:00100000:2.0:1790740226.909489:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021955712 00000100:00100000:2.0:1790740226.909494:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021955712 00000100:00100000:2.0:1790740226.909529:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1790740226.909537:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+22:6532:x1877727021955712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790740226.909624:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+22:6532:x1877727021955712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740226.909631:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1790740226.909940:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021955712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790740226.910324:0:10375:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:10375:1877727021955840:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790740226.910366:0:10375:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740226.910479:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021955840 00000100:00100000:2.0:1790740226.910484:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021955840 00000100:00100000:2.0:1790740226.910517:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1790740226.910524:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+22:10375:x1877727021955840:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790740226.910602:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+22:10375:x1877727021955840:12345-0@lo:502:llog_process_th.0 Request processed in 79us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740226.910609:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1790740226.910687:0:10375:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc85f9c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790740226.910705:0:10375:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:10375:1877727021955840:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790740226.910738:0:10375:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:10375:1877727021955968:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790740226.910768:0:10375:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740226.910789:0:10375:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5fbfb40 going to sleep for 11 seconds 00000100:00100000:1.0:1790740226.910878:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021955968 00000100:00100000:1.0:1790740226.910887:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021955968 00000100:00100000:1.0:1790740226.910907:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1790740226.910912:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+22:10375:x1877727021955968:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790740226.910984:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+22:10375:x1877727021955968:12345-0@lo:502:llog_process_th.0 Request processed in 71us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740226.910991:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1790740226.911288:0:10375:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:10375:1877727021955968:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1790740226.911308:0:10375:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1790740226.911502:0:6532:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1790740226.911521:0:6532:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790740226.911530:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8e00/0xb25dda4f4e92db96 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92db9d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740226.911551:0:6532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8e00/0xb25dda4f4e92db96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92db9d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740226.911561:0:6532:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1790740226.911564:0:6532:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:0.0:1790740226.911566:0:6532:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1790740226.911591:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaf061000/0xb25dda4f4e92dba4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740226.911599:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dcaf061000/0xb25dda4f4e92dba4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740226.911608:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dcaf061000/0xb25dda4f4e92dba4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740226.911622:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd551880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021956096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790740226.911656:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740226.911689:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc8569b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740226.911737:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021956096 00000100:00100000:2.0:1790740226.911743:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021956096 00000100:00100000:2.0:1790740226.911769:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1790740226.911775:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+22:6532:x1877727021956096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790740226.911784:0:6528:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740226.911796:0:6528:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dc81488200/0xb25dda4f4e92dbab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92dba4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740226.911816:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dc81488200/0xb25dda4f4e92dbab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92dba4 expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740226.911825:0:6528:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dc81488200/0xb25dda4f4e92dbab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92dba4 expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740226.911844:0:6528:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dc81488200, rc 0) 00000100:00100000:2.0:1790740226.911882:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:6532:x1877727021956096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740226.911888:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1790740226.911952:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd551880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021956096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790740226.911964:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dcaf061000/0xb25dda4f4e92dba4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92dbab expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740226.911972:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dcaf061000/0xb25dda4f4e92dba4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92dbab expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740226.912015:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd551880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021956224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790740226.912076:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740226.912098:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc8569b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740226.912196:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021956224 00000100:00100000:2.0:1790740226.912200:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021956224 00000100:00100000:2.0:1790740226.912228:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1790740226.912235:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:6532:x1877727021956224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790740226.912345:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:6532:x1877727021956224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740226.912352:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1790740226.913636:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd551880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021956224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790740226.913682:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021956352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790740226.913736:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740226.913872:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5fbfb40 going to sleep for 11 seconds 00000100:00100000:2.0:1790740226.914212:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021956352 00000100:00100000:2.0:1790740226.914219:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021956352 00000100:00100000:2.0:1790740226.914265:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1790740226.914275:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:6532:x1877727021956352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790740226.914374:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:6532:x1877727021956352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740226.914382:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1790740226.914754:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021956352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790740226.918755:0:10376:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f9b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:10376:1877727021956480:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790740226.918849:0:10376:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740226.918895:0:10376:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82c750c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790740226.918951:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021956480 00000100:00100000:0.0:1790740226.918959:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021956480 00000100:00100000:0.0:1790740226.919008:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1790740226.919017:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:10376:x1877727021956480:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790740226.919183:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:10376:x1877727021956480:12345-0@lo:502:llog_process_th.0 Request processed in 166us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740226.919191:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1790740226.919828:0:10376:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f9b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:10376:1877727021956480:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790740226.919859:0:10376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790740226.919869:0:10376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740226.919877:0:10376:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1790740226.919884:0:10376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1790740226.919911:0:10376:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f9b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:10376:1877727021956608:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790740226.919952:0:10376:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740226.919992:0:10376:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82c750c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790740226.920066:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021956608 00000100:00100000:1.0:1790740226.920072:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021956608 00000100:00100000:1.0:1790740226.920117:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1790740226.920125:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:10376:x1877727021956608:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790740226.920226:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:10376:x1877727021956608:12345-0@lo:502:llog_process_th.0 Request processed in 102us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740226.920233:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1790740226.920359:0:10376:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f9b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:10376:1877727021956608:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790740226.920376:0:10376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790740226.920381:0:10376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740226.920383:0:10376:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790740226.920387:0:10376:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1790740226.920768:0:6532:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:1.0:1790740226.920801:0:6532:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1790740226.920811:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaf061000/0xb25dda4f4e92dba4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92dbab expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740226.920820:0:6532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dcaf061000/0xb25dda4f4e92dba4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92dbab expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740226.920830:0:6532:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1790740226.920832:0:6532:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98dc992499c0 from 1 10000000:01000000:1.0:1790740226.920835:0:6532:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1790740226.920859:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dc80031e00/0xb25dda4f4e92dbb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740226.920868:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dc80031e00/0xb25dda4f4e92dbb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740226.920883:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dc80031e00/0xb25dda4f4e92dbb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740226.920899:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ee8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021956736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790740226.920930:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740226.920959:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5e71cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740226.921306:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021956736 00000100:00100000:2.0:1790740226.921312:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021956736 00000100:00100000:2.0:1790740226.921337:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1790740226.921344:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:6532:x1877727021956736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790740226.921354:0:6529:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740226.921366:0:6529:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dc81489000/0xb25dda4f4e92dbb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92dbb2 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740226.921385:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dc81489000/0xb25dda4f4e92dbb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92dbb2 expref: 24 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740226.921412:0:6529:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dc81489000/0xb25dda4f4e92dbb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92dbb2 expref: 24 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740226.921421:0:6529:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dc81489000, rc 0) 00000100:00100000:2.0:1790740226.921453:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:6532:x1877727021956736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740226.921460:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1790740226.922021:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ee8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021956736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790740226.922060:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dc80031e00/0xb25dda4f4e92dbb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92dbb9 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740226.922078:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dc80031e00/0xb25dda4f4e92dbb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92dbb9 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740226.922144:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ee8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021956864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790740226.922174:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740226.922193:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5e71cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790740226.922289:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021956864 00000100:00100000:0.0:1790740226.922294:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021956864 00000100:00100000:0.0:1790740226.922322:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1790740226.922330:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:6532:x1877727021956864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790740226.922423:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:6532:x1877727021956864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 93us (248us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790740226.922430:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1790740226.922745:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ee8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021956864:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1790740226.922771:0:6532:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1790740226.922778:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dc80031e00/0xb25dda4f4e92dbb2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92dbb9 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740226.922798:0:6532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dc80031e00/0xb25dda4f4e92dbb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92dbb9 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740226.970833:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740226.970895:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740226.970923:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740226.970968:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740226.971019:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000925568 00000100:00100000:3.0:1790740226.971073:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000925568 00000100:00100000:3.0:1790740226.971149:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 22 00000100:00100000:3.0:1790740226.971160:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bed19f2-4c98-4684-89e7-a6871565665d+5:2405:x1877727000925568:12345-192.168.204.3@tcp:400: 00000100:00100000:3.0:1790740226.971276:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bed19f2-4c98-4684-89e7-a6871565665d+5:2405:x1877727000925568:12345-192.168.204.3@tcp:400: Request processed in 117us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740226.971284:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 22 00000100:00080000:3.0:1790740226.971309:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790740226.971432:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000925056 00000100:00100000:2.0:1790740226.971462:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000925056 00000100:00100000:2.0:1790740226.971538:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 243 00000100:00100000:2.0:1790740226.971548:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca1332050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+8:2405:x1877727000925056:12345-192.168.204.3@tcp:400: 00000100:00100000:2.0:1790740226.971628:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca1332050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+8:2405:x1877727000925056:12345-192.168.204.3@tcp:400: Request processed in 81us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740226.971636:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 243 00000100:00100000:0.0:1790740226.971792:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000925184 00000100:00100000:0.0:1790740226.971797:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000925184 00000100:00100000:0.0:1790740226.971863:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000925312 00000100:00100000:0.0:1790740226.971867:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000925312 00000100:00100000:0.0:1790740226.971902:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 66 00000100:00100000:0.0:1790740226.971911:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+6:2404:x1877727000925184:12345-192.168.204.3@tcp:400: 00000100:00100000:1.0:1790740226.971920:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 67 00000100:00100000:1.0:1790740226.971937:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+5:2405:x1877727000925312:12345-192.168.204.3@tcp:400: 00000100:00100000:0.0:1790740226.971963:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+6:2404:x1877727000925184:12345-192.168.204.3@tcp:400: Request processed in 49us (1141us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740226.971971:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 66 00000100:00100000:1.0:1790740226.972010:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+5:2405:x1877727000925312:12345-192.168.204.3@tcp:400: Request processed in 77us (1083us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740226.972021:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 67 00000100:00080000:2.0:1790740226.972346:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790740226.972352:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790740226.974961:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740226.977839:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000925440 00000100:00100000:1.0:1790740226.977861:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000925440 00000100:00100000:1.0:1790740226.979008:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 23 00000100:00100000:1.0:1790740226.979055:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7bed19f2-4c98-4684-89e7-a6871565665d+5:2404:x1877727000925440:12345-192.168.204.3@tcp:400: 00000100:00100000:1.0:1790740226.979179:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7bed19f2-4c98-4684-89e7-a6871565665d+5:2404:x1877727000925440:12345-192.168.204.3@tcp:400: Request processed in 158us (4232us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740226.979187:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 23 00000100:00080000:2.0:1790740226.979567:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790740227.096546:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740227.097083:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000925696 00000100:00100000:2.0:1790740227.097097:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000925696 00000100:00100000:2.0:1790740227.097182:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 244 00000100:00100000:2.0:1790740227.097194:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca1333c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+8:6199:x1877727000925696:12345-192.168.204.3@tcp:101: 00010000:00010000:2.0:1790740227.097229:0:6529:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740227.097262:0:6529:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dc81489a00/0xb25dda4f4e92dbc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23b65 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740227.097301:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dc81489a00/0xb25dda4f4e92dbc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23b65 expref: 9 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740227.097314:0:6529:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dc81489a00/0xb25dda4f4e92dbc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23b65 expref: 9 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740227.097325:0:6529:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dc81489a00, rc 0) 00000100:00100000:2.0:1790740227.097462:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca1333c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+9:6199:x1877727000925696:12345-192.168.204.3@tcp:101: Request processed in 270us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740227.097471:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 244 00000100:00100000:1.0:1790740227.127834:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740227.128857:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000925824 00000100:00100000:3.0:1790740227.128873:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000925824 00000100:00100000:3.0:1790740227.128950:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 245 00000100:00100000:3.0:1790740227.128965:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca1332850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+9:6199:x1877727000925824:12345-192.168.204.3@tcp:501: 00000100:00100000:0.0:1790740227.129477:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca1332850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+9:6199:x1877727000925824:12345-192.168.204.3@tcp:501: Request processed in 510us (1647us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740227.129536:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 245 00000100:00100000:2.0:1790740227.144793:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740227.145095:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000925952 00000100:00100000:0.0:1790740227.145110:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000925952 00000100:00100000:0.0:1790740227.145186:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 246 00000100:00100000:0.0:1790740227.145197:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+9:6199:x1877727000925952:12345-192.168.204.3@tcp:503: 00000100:00100000:0.0:1790740227.145399:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+9:6199:x1877727000925952:12345-192.168.204.3@tcp:503: Request processed in 203us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740227.145406:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 246 00000100:00100000:1.0:1790740227.157775:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740227.158789:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000926080 00000100:00100000:2.0:1790740227.158804:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000926080 00000100:00100000:2.0:1790740227.158878:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 247 00000100:00100000:2.0:1790740227.158889:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+9:6678:x1877727000926080:12345-192.168.204.3@tcp:502: 00000100:00100000:2.0:1790740227.159125:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+9:6678:x1877727000926080:12345-192.168.204.3@tcp:502: Request processed in 237us (1365us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740227.159142:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 247 00000100:00100000:2.0:1790740227.162585:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740227.163020:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000926208 00000100:00100000:1.0:1790740227.163242:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000926208 00000100:00100000:1.0:1790740227.163333:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 248 00000100:00100000:1.0:1790740227.163345:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+9:6678:x1877727000926208:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790740227.163536:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+9:6678:x1877727000926208:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 193us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740227.163546:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 248 00000100:00100000:1.0:1790740227.166332:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740227.166623:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000926336 00000100:00100000:0.0:1790740227.166637:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000926336 00000100:00100000:0.0:1790740227.166708:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 249 00000100:00100000:0.0:1790740227.166720:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+9:6199:x1877727000926336:12345-192.168.204.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790740227.166742:0:6528:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740227.166767:0:6528:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcaf060c00/0xb25dda4f4e92dbc7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23b6c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740227.166824:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcaf060c00/0xb25dda4f4e92dbc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23b6c expref: 10 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740227.166838:0:6528:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcaf060c00/0xb25dda4f4e92dbc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23b6c expref: 10 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740227.166849:0:6528:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaf060c00, rc 0) 00000100:00100000:0.0:1790740227.167116:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+10:6199:x1877727000926336:12345-192.168.204.3@tcp:101:ll_cfg_requeue.0 Request processed in 398us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740227.167125:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 249 00000100:00100000:3.0:1790740227.169568:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740227.169804:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000926464 00000100:00100000:2.0:1790740227.170122:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000926464 00000100:00100000:2.0:1790740227.170200:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 250 00000100:00100000:2.0:1790740227.170217:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+10:6199:x1877727000926464:12345-192.168.204.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790740227.170559:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+10:6199:x1877727000926464:12345-192.168.204.3@tcp:501:ll_cfg_requeue.0 Request processed in 348us (1002us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790740227.170568:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 250 00000100:00100000:1.0:1790740227.179152:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ee8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021956992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790740227.179183:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021957120:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790740227.179512:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740227.179576:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021956992 00000100:00100000:2.0:1790740227.179587:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021956992 00000100:00100000:2.0:1790740227.179663:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1790740227.179753:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790740227.179785:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ee9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021956992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790740227.179830:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790740227.179901:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ee9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021956992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 228us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740227.179910:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1790740227.179995:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83ee8380 x1877727021956992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740243 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740227.180016:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ee8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021956992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790740227.180808:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740227.180906:0:10118:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021957120 00000100:00100000:3.0:1790740227.180913:0:10118:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021957120 00000100:00100000:3.0:1790740227.180987:0:10118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790740227.180996:0:10118:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd550a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021957120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790740227.181012:0:10118:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1790740227.181055:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790740227.181087:0:10118:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd550a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021957120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740227.181093:0:10118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1790740227.181183:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db82f9b480 x1877727021957120/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740243 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740227.181198:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021957120:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1790740227.566428:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740228.586483:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790740228.591718:0:10414:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe05697b00 20000000:00000080:0.0:1790740228.591746:0:10414:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98db83c87c00 uarg=0000000000000000 20000000:01000000:0.0:1790740228.591829:0:10414:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1790740228.591836:0:10414:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1790740228.591841:0:10414:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1790740228.593567:0:10415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1790740228.593758:0:10414:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1790740228.598320:0:10414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1790740228.598361:0:10414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1790740228.598377:0:10414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1790740228.598401:0:10414:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1790740228.598428:0:10414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98dc80030400/0xb25dda4f4e92dbce lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740228.598450:0:10414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dca1969400/0xb25dda4f4e92d86a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d863 expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740228.598459:0:10414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dc81489c00/0xb25dda4f4e92d878 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d871 expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740228.598466:0:10414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dc81488000/0xb25dda4f4e92d8cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d8c5 expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740228.598473:0:10414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dcb5dc8000/0xb25dda4f4e92d9f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92d9eb expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740228.598484:0:10414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dc81488600/0xb25dda4f4e92db0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23b2d expref: 9 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740228.598492:0:10414:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98dc80030400/0xb25dda4f4e92dbce lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740228.598544:0:10414:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dc81488600/0xb25dda4f4e92db0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23b2d expref: 9 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740228.598563:0:10414:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98dc81488600/0xb25dda4f4e92db0a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23b2d expref: 9 pid: 6528 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740228.598593:0:10414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ee9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10414:1877727021957248:192.168.204.3@tcp:104: 00010000:00010000:1.0:1790740228.598939:0:10414:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dcb5dc8000/0xb25dda4f4e92d9f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92d9eb expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740228.598950:0:10414:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98dcb5dc8000/0xb25dda4f4e92d9f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92d9eb expref: 23 pid: 6528 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740228.598960:0:10414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ee9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10414:1877727021957376:0@lo:104: 00000100:00100000:1.0:1790740228.599730:0:10414:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790740228.599915:0:10414:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dc81488000/0xb25dda4f4e92d8cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92d8c5 expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740228.599929:0:10414:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98dc81488000/0xb25dda4f4e92d8cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92d8c5 expref: 23 pid: 6528 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740228.599942:0:10414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83eead80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10414:1877727021957504:0@lo:104: 00000100:00100000:1.0:1790740228.599987:0:10414:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790740228.600056:0:10414:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dc81489c00/0xb25dda4f4e92d878 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92d871 expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740228.600064:0:10414:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98dc81489c00/0xb25dda4f4e92d878 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92d871 expref: 23 pid: 6530 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740228.600073:0:10414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ee9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10414:1877727021957632:0@lo:104: 00010000:00010000:1.0:1790740228.600100:0:10414:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dca1969400/0xb25dda4f4e92d86a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92d863 expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740228.600108:0:10414:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98dca1969400/0xb25dda4f4e92d86a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92d863 expref: 23 pid: 6530 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740228.600134:0:10414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ee8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10414:1877727021957760:0@lo:104: 00000100:00100000:1.0:1790740228.600160:0:10414:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5e71240 going to sleep for 11 seconds 00000100:00100000:0.0:1790740228.600397:0:6519:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1790740228.600417:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740228.600430:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740228.600441:0:6519:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021957376 00000100:00100000:0.0:1790740228.600452:0:6519:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021957376 00000100:00100000:0.0:1790740228.600507:0:6519:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021957504 00000100:00100000:0.0:1790740228.600510:0:6519:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021957504 00000100:00100000:0.0:1790740228.600519:0:6519:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021957632 00000100:00100000:0.0:1790740228.600522:0:6519:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021957632 00000100:00100000:0.0:1790740228.600531:0:6519:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021957760 00000100:00100000:0.0:1790740228.600533:0:6519:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021957760 00000100:00100000:0.0:1790740228.600548:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790740228.600558:0:6519:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+6:10414:x1877727021957376:12345-0@lo:104: 00010000:00010000:0.0:1790740228.600575:0:6519:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8400/0xb25dda4f4e92d9eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d9f2 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740228.600708:0:10414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ee9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10414:1877727021957376:0@lo:104: 00010000:00010000:0.0:1790740228.600845:0:6519:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790740228.600853:0:6519:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+6:10414:x1877727021957376:12345-0@lo:104: Request processed in 297us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740228.600874:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790740228.600898:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790740228.600904:0:6519:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb6d1d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+5:10414:x1877727021957504:12345-0@lo:104: 00010000:00010000:0.0:1790740228.600913:0:6519:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9c00/0xb25dda4f4e92d8c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d8cc expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740228.600964:0:6519:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790740228.600969:0:6519:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb6d1d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+5:10414:x1877727021957504:12345-0@lo:104: Request processed in 66us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740228.600975:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790740228.601065:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790740228.601073:0:6519:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd550700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+4:10414:x1877727021957632:12345-0@lo:104: 00010000:00010000:0.0:1790740228.601081:0:6519:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff98dca1968200/0xb25dda4f4e92d871 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d878 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740228.601122:0:6519:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1790740228.601127:0:6519:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd550700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+4:10414:x1877727021957632:12345-0@lo:104: Request processed in 56us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740228.601133:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790740228.601147:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790740228.601154:0:6519:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd550000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+3:10414:x1877727021957760:12345-0@lo:104: 00010000:00010000:0.0:1790740228.601162:0:6519:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3a00/0xb25dda4f4e92d863 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d86a expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740228.601190:0:6519:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1790740228.601202:0:6519:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd550000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+3:10414:x1877727021957760:12345-0@lo:104: Request processed in 50us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740228.601216:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:0.0:1790740228.601360:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1790740228.601369:0:6523:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8400/0xb25dda4f4e92d9eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d9f2 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740228.601377:0:6523:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc8400 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:0.0:1790740228.601382:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8400/0xb25dda4f4e92d9eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92d9f2 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740228.601394:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8400/0xb25dda4f4e92d9eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92d9f2 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790740228.601402:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8400/0xb25dda4f4e92d9eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92d9f2 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740228.601409:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790740228.601447:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8400/0xb25dda4f4e92d9eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d9f2 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740228.601454:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1790740228.601537:0:10414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83eead80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10414:1877727021957504:0@lo:104: 00000100:00100000:1.0:1790740228.601547:0:10414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ee9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10414:1877727021957632:0@lo:104: 00000100:00100000:1.0:1790740228.601554:0:10414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ee8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10414:1877727021957760:0@lo:104: 00010000:00010000:2.0:1790740228.601673:0:10357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790740228.601681:0:10357:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9c00/0xb25dda4f4e92d8c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d8cc expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740228.601701:0:10357:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc9c00 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:2.0:1790740228.601704:0:10357:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9c00/0xb25dda4f4e92d8c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92d8cc expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740228.601712:0:10357:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9c00/0xb25dda4f4e92d8c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92d8cc expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790740228.601718:0:10357:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9c00/0xb25dda4f4e92d8c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92d8cc expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740228.601724:0:10357:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790740228.601880:0:10357:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9c00/0xb25dda4f4e92d8c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d8cc expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740228.601888:0:10357:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790740228.601923:0:10357:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9c00/0xb25dda4f4e92d8c5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d8cc expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740228.601931:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9c00/0xb25dda4f4e92d8c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d8cc expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740228.601951:0:10357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790740228.601955:0:10357:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dca1968200/0xb25dda4f4e92d871 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d878 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740228.601962:0:10357:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dca1968200 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:2.0:1790740228.601965:0:10357:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dca1968200/0xb25dda4f4e92d871 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92d878 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740228.601987:0:10357:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dca1968200/0xb25dda4f4e92d871 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92d878 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790740228.601994:0:10357:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dca1968200/0xb25dda4f4e92d871 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92d878 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740228.602000:0:10357:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790740228.602019:0:10357:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dca1968200/0xb25dda4f4e92d871 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d878 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740228.602026:0:10357:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790740228.602054:0:10357:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dca1968200/0xb25dda4f4e92d871 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d878 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740228.602061:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dca1968200/0xb25dda4f4e92d871 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d878 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740228.602072:0:10357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790740228.602076:0:10357:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3a00/0xb25dda4f4e92d863 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92d86a expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740228.602082:0:10357:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee3a00 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:2.0:1790740228.602085:0:10357:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3a00/0xb25dda4f4e92d863 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92d86a expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740228.602091:0:10357:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3a00/0xb25dda4f4e92d863 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92d86a expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790740228.602097:0:10357:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3a00/0xb25dda4f4e92d863 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92d86a expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740228.602109:0:10357:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790740228.602141:0:10357:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3a00/0xb25dda4f4e92d863 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d86a expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740228.602148:0:10357:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1790740228.602209:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727021958016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790740228.602282:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790740228.602307:0:6523:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8400/0xb25dda4f4e92d9eb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d9f2 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740228.602315:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8400/0xb25dda4f4e92d9eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d9f2 expref: -99 pid: 9529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740228.602325:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1790740228.602327:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740228.602329:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740228.602331:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ce1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727021958144:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790740228.602331:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740228.602338:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740228.602353:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740228.602381:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021958144 00000100:00100000:0.0:1790740228.602381:0:9550:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021958016 00000100:00100000:1.0:1790740228.602388:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021958144 00000100:00100000:0.0:1790740228.602388:0:9550:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021958016 00010000:00010000:1.0:1790740228.602420:0:6521:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dc81489c00/0xb25dda4f4e92d878 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d871 expref: 25 pid: 6530 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740228.602421:0:9550:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dc81488000/0xb25dda4f4e92d8cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d8c5 expref: 25 pid: 6528 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740228.602456:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790740228.602461:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790740228.602464:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ee8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+25:3640:x1877727021958144:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790740228.602466:0:9550:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ee8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+25:3640:x1877727021958016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790740228.602479:0:6521:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740228.602479:0:9550:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740228.602485:0:6521:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dc81489c00/0xb25dda4f4e92d878 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d871 expref: 25 pid: 6530 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740228.602485:0:9550:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dc81488000/0xb25dda4f4e92d8cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d8c5 expref: 25 pid: 6528 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740228.602496:0:9550:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dc81488000/0xb25dda4f4e92d8cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92d8c5 expref: 25 pid: 6528 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740228.602514:0:10357:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3a00/0xb25dda4f4e92d863 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d86a expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740228.602522:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3a00/0xb25dda4f4e92d863 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92d86a expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740228.602536:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740228.602537:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740228.602539:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740228.602557:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3639:1877727021957888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790740228.602582:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740228.602596:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790740228.602600:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3639:1877727021958272:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790740228.602620:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740228.602639:0:6522:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1790740228.602648:0:6522:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:2.0:1790740228.602893:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021957888 00000100:00100000:2.0:1790740228.602897:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021957888 00010000:00010000:2.0:1790740228.602916:0:6522:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dcb5dc8000/0xb25dda4f4e92d9f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d9eb expref: 26 pid: 6528 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740228.602931:0:6522:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1790740228.602936:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021958272 00000100:00100000:2.0:1790740228.602938:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021958272 00010000:00010000:2.0:1790740228.602956:0:6522:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dca1969400/0xb25dda4f4e92d86a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d863 expref: 27 pid: 6530 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740228.602967:0:6522:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1790740228.602973:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790740228.602979:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+27:3639:x1877727021957888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790740228.602988:0:6522:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740228.602993:0:6522:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dcb5dc8000/0xb25dda4f4e92d9f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d9eb expref: 27 pid: 6528 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740228.603028:0:6521:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dc81489c00/0xb25dda4f4e92d878 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92d871 expref: 27 pid: 6530 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740228.603142:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dc81488000/0xb25dda4f4e92d8cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92d8c5 expref: 27 pid: 6528 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740228.603160:0:9550:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790740228.603180:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dc81489c00/0xb25dda4f4e92d878 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92d871 expref: 26 pid: 6530 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740228.603198:0:6521:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740228.603209:0:9550:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ee8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+25:3640:x1877727021958016:12345-0@lo:103:ldlm_bl.0 Request processed in 743us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740228.603217:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790740228.603231:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ee8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+25:3640:x1877727021958144:12345-0@lo:103:ldlm_bl.0 Request processed in 768us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740228.603237:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790740228.603251:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790740228.603257:0:9550:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc86ac0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:3639:x1877727021958272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790740228.603266:0:9550:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740228.603270:0:9550:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dca1969400/0xb25dda4f4e92d86a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92d863 expref: 23 pid: 6530 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740228.603279:0:9550:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dca1969400/0xb25dda4f4e92d86a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92d863 expref: 23 pid: 6530 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740228.603297:0:6522:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dcb5dc8000/0xb25dda4f4e92d9f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92d9eb expref: 23 pid: 6528 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740228.603312:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dca1969400/0xb25dda4f4e92d86a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92d863 expref: 23 pid: 6530 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740228.603313:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcb5dc8000/0xb25dda4f4e92d9f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92d9eb expref: 23 pid: 6528 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740228.603323:0:6522:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790740228.603323:0:9550:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740228.603352:0:9550:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc86ac0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:3639:x1877727021958272:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740228.603359:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790740228.603403:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+20:3639:x1877727021957888:12345-0@lo:103:ldlm_bl.0 Request processed in 424us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740228.603405:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3639:1877727021958272:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790740228.603410:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790740228.603415:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3639:1877727021957888:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790740228.603445:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ce1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727021958144:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790740228.603454:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727021958016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790740228.609237:0:10414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ee9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10414:1877727021957248:192.168.204.3@tcp:104: 00000100:00100000:3.0:1790740228.609247:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00010000:00010000:1.0:1790740228.609299:0:10414:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98dc80030400/0xb25dda4f4e92dbce lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740228.609419:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000926592 00000100:00100000:0.0:1790740228.609429:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000926592 00010000:00010000:0.0:1790740228.609478:0:6521:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dc81488600/0xb25dda4f4e92db0a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23b2d expref: 10 pid: 6528 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740228.609580:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 39 00000100:00100000:0.0:1790740228.609593:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:160ca934-a0b3-4cb3-b255-c8d008823f6f+10:2403:x1877727000926592:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790740228.609612:0:6521:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740228.609619:0:6521:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dc81488600/0xb25dda4f4e92db0a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23b2d expref: 10 pid: 6528 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740228.609633:0:6521:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dc81488600/0xb25dda4f4e92db0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23b2d expref: 10 pid: 6528 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740228.609680:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dc81488600/0xb25dda4f4e92db0a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23b2d expref: 10 pid: 6528 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740228.609701:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98dc80030400/0xb25dda4f4e92dbce lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740228.609712:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dc80030400/0xb25dda4f4e92dbce lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740228.609733:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98dc80030400/0xb25dda4f4e92dbce lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740228.609755:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98dc80030400/0xb25dda4f4e92dbce lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740228.609764:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98dc80030400/0xb25dda4f4e92dbce lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740228.609772:0:6521:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98dc80030400/0xb25dda4f4e92dbce lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740228.609779:0:6521:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dc80030400 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:0.0:1790740228.609793:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98dc80030400/0xb25dda4f4e92dbce lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740228.609803:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98dc80030400/0xb25dda4f4e92dbce lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740228.609823:0:6521:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98dc80030400/0xb25dda4f4e92dbce lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740228.609847:0:6521:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740228.609919:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:160ca934-a0b3-4cb3-b255-c8d008823f6f+9:2403:x1877727000926592:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 327us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740228.609928:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 39 00010000:00010000:1.0:1790740228.610202:0:10414:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98dc80030400/0xb25dda4f4e92dbce lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740228.610212:0:10414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98dc80030400/0xb25dda4f4e92dbce lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740228.610235:0:10414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dc80030400/0xb25dda4f4e92dbce lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740228.644567:0:6532:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790740228.644636:0:6532:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98dcb5f0a000 from 4 10000000:01000000:2.0:1790740228.644642:0:6532:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790740228.644706:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dc81488600/0xb25dda4f4e92dbd5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740228.644721:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dc81488600/0xb25dda4f4e92dbd5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740228.644736:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dc81488600/0xb25dda4f4e92dbd5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740228.644785:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021958400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790740228.644892:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740228.644953:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db8224ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1790740228.645104:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021958400 00000100:00100000:0.0:1790740228.645348:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021958400 00000100:00100000:0.0:1790740228.645426:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1790740228.645440:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+20:6532:x1877727021958400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790740228.645459:0:6530:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740228.645479:0:6530:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcaf061a00/0xb25dda4f4e92dbdc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92dbd5 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740228.645509:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcaf061a00/0xb25dda4f4e92dbdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92dbd5 expref: 21 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740228.645523:0:6530:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcaf061a00/0xb25dda4f4e92dbdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92dbd5 expref: 21 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740228.645533:0:6530:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaf061a00, rc 0) 00000100:00100000:0.0:1790740228.645591:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:6532:x1877727021958400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740228.645599:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1790740228.645658:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021958400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790740228.645676:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dc81488600/0xb25dda4f4e92dbd5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92dbdc expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740228.645687:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dc81488600/0xb25dda4f4e92dbd5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92dbdc expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740228.645782:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd553b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021958528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790740228.645813:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740228.645840:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc88738b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790740228.645962:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021958528 00000100:00100000:0.0:1790740228.645969:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021958528 00000100:00100000:0.0:1790740228.646003:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1790740228.646011:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:6532:x1877727021958528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790740228.646296:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:6532:x1877727021958528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 285us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740228.646306:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1790740228.646488:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd553b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021958528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790740228.646530:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d90a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021958656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790740228.646593:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740228.646617:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db8224ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1790740228.649883:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021958656 00000100:00100000:0.0:1790740228.649904:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021958656 00000100:00100000:0.0:1790740228.649978:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1790740228.649990:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:6532:x1877727021958656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790740228.650380:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:6532:x1877727021958656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 390us (3796us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740228.650390:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1790740228.650463:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d90a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021958656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790740228.650961:0:10420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd550380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:10420:1877727021958784:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790740228.651020:0:10420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740228.651263:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021958784 00000100:00100000:2.0:1790740228.651271:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021958784 00000100:00100000:2.0:1790740228.651341:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1790740228.651352:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:10420:x1877727021958784:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790740228.651461:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:10420:x1877727021958784:12345-0@lo:502:llog_process_th.0 Request processed in 111us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740228.651469:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1790740228.651534:0:10420:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc88738b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790740228.651553:0:10420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd550380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:10420:1877727021958784:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790740228.651581:0:10420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790740228.651593:0:10420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740228.651596:0:10420:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790740228.651604:0:10420:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98dcb5f0a000 00000020:00000080:1.0:1790740228.651607:0:10420:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790740228.651703:0:10420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ee9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:10420:1877727021958912:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790740228.651745:0:10420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740228.651930:0:10420:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5e71240 going to sleep for 11 seconds 00000100:00100000:0.0:1790740228.651973:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021958912 00000100:00100000:0.0:1790740228.651978:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021958912 00000100:00100000:0.0:1790740228.652009:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1790740228.652016:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:10420:x1877727021958912:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790740228.652303:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:10420:x1877727021958912:12345-0@lo:502:llog_process_th.0 Request processed in 285us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740228.652319:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1790740228.655778:0:10420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ee9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:10420:1877727021958912:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790740228.655843:0:10420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790740228.655853:0:10420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740228.655856:0:10420:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1790740228.655863:0:10420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1790740228.656176:0:6532:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1790740228.656209:0:6532:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790740228.656237:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dc81488600/0xb25dda4f4e92dbd5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92dbdc expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740228.656250:0:6532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dc81488600/0xb25dda4f4e92dbd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92dbdc expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740228.656263:0:6532:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790740228.656267:0:6532:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98dcaedda800 from 4 10000000:01000000:0.0:1790740228.656270:0:6532:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790740228.656314:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaf060e00/0xb25dda4f4e92dbe3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740228.656324:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dcaf060e00/0xb25dda4f4e92dbe3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740228.656335:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dcaf060e00/0xb25dda4f4e92dbe3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740228.656362:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd553800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021959040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790740228.656446:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740228.656505:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82e52cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790740228.656563:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021959040 00000100:00100000:1.0:1790740228.656572:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021959040 00000100:00100000:1.0:1790740228.656662:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1790740228.656675:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:6532:x1877727021959040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790740228.656692:0:6530:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740228.656711:0:6530:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dc80030400/0xb25dda4f4e92dbea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92dbe3 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740228.656742:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dc80030400/0xb25dda4f4e92dbea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92dbe3 expref: 22 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740228.656755:0:6530:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dc80030400/0xb25dda4f4e92dbea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92dbe3 expref: 22 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740228.656778:0:6530:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dc80030400, rc 0) 00000100:00100000:1.0:1790740228.656831:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+22:6532:x1877727021959040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740228.656840:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1790740228.660149:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd553800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021959040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790740228.660190:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dcaf060e00/0xb25dda4f4e92dbe3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92dbea expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740228.660206:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dcaf060e00/0xb25dda4f4e92dbe3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92dbea expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740228.660344:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ee9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021959168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790740228.660420:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740228.660468:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5e716c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790740228.660494:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021959168 00000100:00100000:1.0:1790740228.660501:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021959168 00000100:00100000:1.0:1790740228.660555:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1790740228.660565:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+22:6532:x1877727021959168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790740228.660731:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+22:6532:x1877727021959168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 168us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740228.660741:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1790740228.660975:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ee9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021959168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790740228.661012:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ee9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021959296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790740228.661156:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740228.661235:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5e716c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790740228.664124:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021959296 00000100:00100000:0.0:1790740228.664140:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021959296 00000100:00100000:0.0:1790740228.664274:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1790740228.664289:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+22:6532:x1877727021959296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790740228.664498:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+22:6532:x1877727021959296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 212us (3341us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740228.664515:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1790740228.664590:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ee9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021959296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790740228.668556:0:10425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd551f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:10425:1877727021959424:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790740228.668796:0:10425:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740228.668858:0:10425:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82e52180 going to sleep for 11 seconds 00000100:00100000:2.0:1790740228.668987:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021959424 00000100:00100000:2.0:1790740228.668996:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021959424 00000100:00100000:2.0:1790740228.669117:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1790740228.669128:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99055c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+22:10425:x1877727021959424:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790740228.669316:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99055c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+22:10425:x1877727021959424:12345-0@lo:502:llog_process_th.0 Request processed in 187us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740228.669325:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1790740228.669458:0:10425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd551f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:10425:1877727021959424:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790740228.669495:0:10425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790740228.669519:0:10425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740228.669523:0:10425:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1790740228.669531:0:10425:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98dcaedda800 00000020:00000080:0.0:1790740228.669534:0:10425:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1790740228.669759:0:10425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd551f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:10425:1877727021959552:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790740228.669808:0:10425:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740228.669836:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021959552 00000100:00100000:0.0:1790740228.669842:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021959552 00000100:00100000:0.0:1790740228.669870:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1790740228.669877:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99057c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+22:10425:x1877727021959552:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790740228.669948:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99057c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+22:10425:x1877727021959552:12345-0@lo:502:llog_process_th.0 Request processed in 71us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740228.669954:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1790740228.669992:0:10425:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82e52180 going to sleep for 11 seconds 00000100:00100000:0.0:1790740228.670004:0:10425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd551f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:10425:1877727021959552:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790740228.670020:0:10425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790740228.670024:0:10425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740228.670026:0:10425:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1790740228.670056:0:10425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1790740228.670999:0:6532:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1790740228.671062:0:6532:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790740228.671078:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaf060e00/0xb25dda4f4e92dbe3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92dbea expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740228.671092:0:6532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dcaf060e00/0xb25dda4f4e92dbe3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92dbea expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740228.671104:0:6532:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790740228.671107:0:6532:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98dca0cb4800 from 4 10000000:01000000:2.0:1790740228.671110:0:6532:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790740228.671147:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dc81489c00/0xb25dda4f4e92dbf1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740228.671155:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dc81489c00/0xb25dda4f4e92dbf1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740228.671166:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dc81489c00/0xb25dda4f4e92dbf1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740228.671190:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d90a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021959680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790740228.671256:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740228.671301:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83e8ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1790740228.671319:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021959680 00000100:00100000:0.0:1790740228.671327:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021959680 00000100:00100000:0.0:1790740228.671413:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1790740228.671426:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99057850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+22:6532:x1877727021959680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790740228.671441:0:6528:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740228.671456:0:6528:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcaf060800/0xb25dda4f4e92dbf8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92dbf1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740228.671484:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcaf060800/0xb25dda4f4e92dbf8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92dbf1 expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740228.671496:0:6528:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcaf060800/0xb25dda4f4e92dbf8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92dbf1 expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740228.671519:0:6528:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaf060800, rc 0) 00000100:00100000:0.0:1790740228.671565:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99057850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:6532:x1877727021959680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740228.671572:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1790740228.671707:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d90a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021959680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790740228.671725:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dc81489c00/0xb25dda4f4e92dbf1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92dbf8 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740228.671734:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dc81489c00/0xb25dda4f4e92dbf1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92dbf8 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740228.671804:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd551f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021959808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790740228.671837:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740228.671870:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82e52300 going to sleep for 11 seconds 00000100:00100000:1.0:1790740228.671920:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021959808 00000100:00100000:1.0:1790740228.671924:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021959808 00000100:00100000:1.0:1790740228.671965:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1790740228.671974:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99054c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:6532:x1877727021959808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790740228.672124:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99054c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:6532:x1877727021959808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 152us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740228.672132:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1790740228.672167:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd551f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021959808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790740228.672201:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ee8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021959936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790740228.672262:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740228.672289:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5e710c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790740228.672301:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021959936 00000100:00100000:1.0:1790740228.672304:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021959936 00000100:00100000:1.0:1790740228.672327:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1790740228.672334:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99055450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:6532:x1877727021959936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790740228.672413:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99055450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:6532:x1877727021959936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740228.672420:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1790740228.672461:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ee8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021959936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790740228.672661:0:10427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ee8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:10427:1877727021960064:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790740228.672699:0:10427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740228.672723:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021960064 00000100:00100000:1.0:1790740228.672727:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021960064 00000100:00100000:1.0:1790740228.672753:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1790740228.672759:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99056850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:10427:x1877727021960064:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790740228.672835:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99056850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:10427:x1877727021960064:12345-0@lo:502:llog_process_th.0 Request processed in 76us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740228.672843:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1790740228.672874:0:10427:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5e71540 going to sleep for 11 seconds 00000100:00100000:1.0:1790740228.672887:0:10427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ee8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:10427:1877727021960064:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790740228.672910:0:10427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790740228.672921:0:10427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740228.672924:0:10427:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790740228.672933:0:10427:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98dca0cb4800 00000020:00000080:1.0:1790740228.672942:0:10427:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790740228.673178:0:10427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ee8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:10427:1877727021960192:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790740228.673233:0:10427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740228.673258:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021960192 00000100:00100000:1.0:1790740228.673264:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021960192 00000100:00100000:1.0:1790740228.673290:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1790740228.673298:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99054450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:10427:x1877727021960192:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790740228.673359:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99054450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:10427:x1877727021960192:12345-0@lo:502:llog_process_th.0 Request processed in 62us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740228.673366:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1790740228.673403:0:10427:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5e71540 going to sleep for 11 seconds 00000100:00100000:1.0:1790740228.673420:0:10427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ee8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:10427:1877727021960192:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790740228.673439:0:10427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790740228.673444:0:10427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740228.673447:0:10427:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1790740228.673451:0:10427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1790740228.673512:0:6532:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1790740228.673542:0:6532:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790740228.673555:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dc81489c00/0xb25dda4f4e92dbf1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92dbf8 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740228.673566:0:6532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dc81489c00/0xb25dda4f4e92dbf1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92dbf8 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740228.673580:0:6532:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790740228.673583:0:6532:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98dc82d23800 from 4 10000000:01000000:1.0:1790740228.673586:0:6532:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790740228.673611:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dc80031800/0xb25dda4f4e92dbff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740228.673630:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dc80031800/0xb25dda4f4e92dbff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740228.673640:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dc80031800/0xb25dda4f4e92dbff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740228.673655:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ee8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021960320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790740228.673686:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740228.673700:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5e71540 going to sleep for 11 seconds 00000100:00100000:1.0:1790740228.673713:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021960320 00000100:00100000:1.0:1790740228.673716:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021960320 00000100:00100000:1.0:1790740228.673738:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1790740228.673743:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99057450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:6532:x1877727021960320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790740228.673752:0:6528:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740228.673765:0:6528:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dc80031c00/0xb25dda4f4e92dc06 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92dbff expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740228.673787:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dc80031c00/0xb25dda4f4e92dc06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92dbff expref: 24 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740228.673797:0:6528:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dc80031c00/0xb25dda4f4e92dc06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92dbff expref: 24 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740228.673806:0:6528:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dc80031c00, rc 0) 00000100:00100000:1.0:1790740228.673838:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99057450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:6532:x1877727021960320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740228.673844:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1790740228.673883:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ee8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021960320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790740228.673895:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dc80031800/0xb25dda4f4e92dbff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92dc06 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740228.673904:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dc80031800/0xb25dda4f4e92dbff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92dc06 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740228.673948:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ee8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021960448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790740228.673975:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740228.673987:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5e71540 going to sleep for 11 seconds 00000100:00100000:1.0:1790740228.673997:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021960448 00000100:00100000:1.0:1790740228.674000:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021960448 00000100:00100000:1.0:1790740228.674019:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1790740228.674025:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99056c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:6532:x1877727021960448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790740228.674145:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99056c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:6532:x1877727021960448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740228.674152:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1790740228.674182:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ee8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021960448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790740228.674212:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ee8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021960576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790740228.674268:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740228.674288:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5fed240 going to sleep for 11 seconds 00000100:00100000:1.0:1790740228.674300:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021960576 00000100:00100000:1.0:1790740228.674304:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021960576 00000100:00100000:1.0:1790740228.674324:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1790740228.674330:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99057050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:6532:x1877727021960576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790740228.674403:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99057050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:6532:x1877727021960576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740228.674415:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1790740228.674453:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ee8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021960576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790740228.675360:0:10429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d90700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:10429:1877727021960704:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790740228.675422:0:10429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740228.675462:0:10429:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc99069b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790740228.675534:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021960704 00000100:00100000:1.0:1790740228.675541:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021960704 00000100:00100000:1.0:1790740228.675580:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1790740228.675588:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99055050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:10429:x1877727021960704:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790740228.675884:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99055050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:10429:x1877727021960704:12345-0@lo:502:llog_process_th.0 Request processed in 297us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740228.675892:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1790740228.675956:0:10429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d90700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:10429:1877727021960704:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790740228.675980:0:10429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790740228.675992:0:10429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740228.675994:0:10429:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1790740228.676005:0:10429:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98dc82d23800 00000020:00000080:2.0:1790740228.676008:0:10429:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1790740228.676124:0:10429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d90700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:10429:1877727021960832:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790740228.676161:0:10429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740228.676188:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021960832 00000100:00100000:2.0:1790740228.676191:0:10429:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc83216cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790740228.676193:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021960832 00000100:00100000:0.0:1790740228.676240:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1790740228.676248:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99056450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:10429:x1877727021960832:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790740228.676331:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99056450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:10429:x1877727021960832:12345-0@lo:502:llog_process_th.0 Request processed in 84us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740228.676337:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1790740228.676592:0:10429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d90700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:10429:1877727021960832:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790740228.676683:0:10429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790740228.676688:0:10429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740228.676691:0:10429:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1790740228.676695:0:10429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1790740228.676932:0:6532:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1790740228.676960:0:6532:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790740228.676974:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dc80031800/0xb25dda4f4e92dbff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92dc06 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740228.676986:0:6532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dc80031800/0xb25dda4f4e92dbff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92dc06 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740228.714913:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877727021960960:0@lo:400:kworker.0 00000100:00100000:1.0:1790740228.715010:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740228.715081:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83eeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1877727021961472:0@lo:400:kworker.0 00000100:00100000:1.0:1790740228.715104:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740228.715120:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83eeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1877727021961984:0@lo:400:kworker.0 00000100:00100000:1.0:1790740228.715140:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740228.715168:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1790740228.715174:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ee9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021961344:0@lo:400:kworker.0 00000100:00100000:1.0:1790740228.715227:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740228.715249:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83eeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021961856:0@lo:400:kworker.0 00000100:00100000:1.0:1790740228.715275:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740228.715293:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021962368:0@lo:400:kworker.0 00000100:00100000:1.0:1790740228.715360:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740228.715396:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ee9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021961088:0@lo:400:kworker.0 00000100:00100000:1.0:1790740228.715422:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740228.715442:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ee9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1877727021961600:0@lo:400:kworker.0 00000100:00100000:1.0:1790740228.715462:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740228.715478:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1877727021962112:0@lo:400:kworker.0 00000100:00100000:1.0:1790740228.715498:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740228.715511:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1790740228.715516:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83eead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877727021961216:0@lo:400:kworker.0 00000100:00100000:1.0:1790740228.715538:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740228.715549:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021961728:0@lo:400:kworker.0 00000100:00100000:1.0:1790740228.715570:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740228.715587:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021962240:0@lo:400:kworker.0 00000100:00100000:0.0:1790740228.716105:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021961856 00000100:00100000:0.0:1790740228.716116:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021961856 00000100:00100000:0.0:1790740228.716176:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021962368 00000100:00100000:0.0:1790740228.716180:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021962368 00000100:00100000:0.0:1790740228.716206:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021961728 00000100:00100000:0.0:1790740228.716209:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021961728 00000100:00100000:0.0:1790740228.716238:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790740228.716247:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727021961856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740228.716317:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727021961856:12345-0@lo:400:kworker.0 Request processed in 71us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740228.716325:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790740228.716344:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790740228.716350:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83f11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727021962368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740228.716379:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83f11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727021962368:12345-0@lo:400:kworker.0 Request processed in 29us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740228.716385:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790740228.716395:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790740228.716400:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83f11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021961728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740228.716429:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83f11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021961728:12345-0@lo:400:kworker.0 Request processed in 29us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740228.716447:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790740228.716469:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021961344 00000100:00100000:0.0:1790740228.716474:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021961344 00000100:00100000:0.0:1790740228.716500:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021961088 00000100:00100000:0.0:1790740228.716503:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021961088 00000100:00100000:0.0:1790740228.716515:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790740228.716521:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727021961344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740228.716559:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727021961344:12345-0@lo:400:kworker.0 Request processed in 38us (1342us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740228.716566:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790740228.716578:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790740228.716584:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83f10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021961088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740228.716641:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83f10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021961088:12345-0@lo:400:kworker.0 Request processed in 57us (1217us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740228.716648:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790740228.716669:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021960960 00000100:00100000:0.0:1790740228.716674:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021960960 00000100:00100000:0.0:1790740228.716693:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021961472 00000100:00100000:0.0:1790740228.716696:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021961472 00000100:00100000:0.0:1790740228.716708:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021961984 00000100:00100000:0.0:1790740228.716711:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021961984 00000100:00100000:0.0:1790740228.716723:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021961600 00000100:00100000:0.0:1790740228.716725:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021961600 00000100:00100000:0.0:1790740228.716737:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021962112 00000100:00100000:0.0:1790740228.716739:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021962112 00000100:00100000:0.0:1790740228.716750:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021961216 00000100:00100000:0.0:1790740228.716753:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021961216 00000100:00100000:0.0:1790740228.716765:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790740228.716771:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877727021960960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740228.716812:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877727021960960:12345-0@lo:400:kworker.0 Request processed in 40us (1803us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740228.716818:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790740228.716830:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1790740228.716836:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ee8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1877727021961472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740228.716866:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ee8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1877727021961472:12345-0@lo:400:kworker.0 Request processed in 30us (1760us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740228.716872:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1790740228.716883:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790740228.716890:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1877727021961984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740228.716918:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1877727021961984:12345-0@lo:400:kworker.0 Request processed in 29us (1777us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740228.716924:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790740228.716934:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790740228.716940:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83f10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877727021961600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740228.716970:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83f10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877727021961600:12345-0@lo:400:kworker.0 Request processed in 30us (1506us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740228.716976:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790740228.716987:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790740228.716994:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83f10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877727021962112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740228.717021:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83f10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877727021962112:12345-0@lo:400:kworker.0 Request processed in 28us (1522us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740228.717025:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790740228.717062:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790740228.717068:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83f13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877727021961216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740228.717107:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83f13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877727021961216:12345-0@lo:400:kworker.0 Request processed in 40us (1568us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740228.717113:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790740228.717321:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740228.717386:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ee9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021961088:0@lo:400:kworker.0 00010000:00080000:1.0:1790740228.717403:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83ee9c00 x1877727021961600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740228.717414:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ee9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1877727021961600:0@lo:400:kworker.0 00010000:00080000:1.0:1790740228.717424:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83eebb80 x1877727021962112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740228.717440:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1877727021962112:0@lo:400:kworker.0 00000100:00100000:1.0:1790740228.717471:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83eead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877727021961216:0@lo:400:kworker.0 00010000:00080000:1.0:1790740228.717483:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83ee9500 x1877727021961728/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740228.717491:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021961728:0@lo:400:kworker.0 00000100:00100000:1.0:1790740228.717515:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021962240 00000100:00100000:1.0:1790740228.717519:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021962240 00000100:00100000:1.0:1790740228.717555:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790740228.717562:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83f12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021962240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740228.717600:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83f12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021962240:12345-0@lo:400:kworker.0 Request processed in 39us (1992us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740228.718839:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790740228.719093:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790740228.719117:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021962496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790740228.719190:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740228.719281:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ee9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021961344:0@lo:400:kworker.0 00010000:00080000:0.0:1790740228.719300:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83eeaa00 x1877727021961856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740228.719311:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83eeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021961856:0@lo:400:kworker.0 00010000:00080000:0.0:1790740228.719324:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83ee8000 x1877727021962368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740228.719332:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021962368:0@lo:400:kworker.0 00000100:00100000:0.0:1790740228.719345:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877727021960960:0@lo:400:kworker.0 00000100:00100000:0.0:1790740228.719357:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83eeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1877727021961472:0@lo:400:kworker.0 00000100:00100000:0.0:1790740228.719369:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83eeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1877727021961984:0@lo:400:kworker.0 00000100:00100000:2.0:1790740228.720783:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021962496 00000100:00100000:2.0:1790740228.720802:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021962496 00000100:00100000:2.0:1790740228.720875:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790740228.720887:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021962496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790740228.720928:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790740228.721022:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021962496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (1832us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740228.721057:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1790740228.721088:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790740228.721095:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790740228.721098:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1790740228.721135:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcbd550e00 x1877727021962496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740244 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740228.721157:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021962496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790740228.721252:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790740228.721265:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021962624:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790740228.721306:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740228.721543:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021962624 00000100:00100000:1.0:1790740228.721549:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021962624 00000100:00100000:1.0:1790740228.721592:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790740228.721599:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021962624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790740228.721692:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790740228.721779:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021962624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 180us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740228.721786:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1790740228.721827:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83ee8700 x1877727021962240/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740228.721840:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021962240:0@lo:400:kworker.0 00010000:00080000:0.0:1790740228.729776:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83d90700 x1877727021962624/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740244 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740228.729814:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021962624:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1790740229.610307:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740229.739217:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83f12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021962752:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790740229.739299:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740229.739527:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021962752 00000100:00100000:1.0:1790740229.739536:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021962752 00000100:00100000:1.0:1790740229.744433:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790740229.744459:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021962752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790740229.744512:0:6540:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790740229.744603:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021962752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 155us (5302us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740229.744611:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790740229.745084:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83f12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021962752:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790740230.617367:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740230.619633:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000926720 00000100:00100000:1.0:1790740230.619650:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000926720 00000100:00100000:1.0:1790740230.619728:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 271 00000100:00100000:1.0:1790740230.619740:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99056050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+9:6199:x1877727000926720:12345-192.168.204.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790740230.619763:0:6528:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740230.619789:0:6528:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dc80030000/0xb25dda4f4e92dc0d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23b73 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740230.619828:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dc80030000/0xb25dda4f4e92dc0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23b73 expref: 10 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740230.619841:0:6528:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dc80030000/0xb25dda4f4e92dc0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23b73 expref: 10 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740230.619853:0:6528:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dc80030000, rc 0) 00000100:00100000:1.0:1790740230.619953:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99056050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+10:6199:x1877727000926720:12345-192.168.204.3@tcp:101:ll_cfg_requeue.0 Request processed in 215us (2600us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740230.619961:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 271 00000100:00100000:2.0:1790740230.624699:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740230.625132:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000926848 00000100:00100000:1.0:1790740230.625163:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000926848 00000100:00100000:1.0:1790740230.625248:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 272 00000100:00100000:1.0:1790740230.625260:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99054050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+10:6199:x1877727000926848:12345-192.168.204.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790740230.625479:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99054050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+10:6199:x1877727000926848:12345-192.168.204.3@tcp:501:ll_cfg_requeue.0 Request processed in 221us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740230.625488:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 272 00000100:00100000:1.0:1790740230.633752:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740230.634441:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000926976 00000100:00100000:3.0:1790740230.634457:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000926976 00000100:00100000:3.0:1790740230.634545:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 273 00000100:00100000:3.0:1790740230.634559:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99055850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+10:6199:x1877727000926976:12345-192.168.204.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790740230.634781:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99055850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+10:6199:x1877727000926976:12345-192.168.204.3@tcp:503:ll_cfg_requeue.0 Request processed in 224us (1044us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740230.634791:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 273 00010000:00010000:1.0:1790740230.638724:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740230.643555:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740230.643737:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000927104 00000100:00100000:2.0:1790740230.643750:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000927104 00000100:00100000:2.0:1790740230.643812:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 274 00000100:00100000:2.0:1790740230.643824:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99054850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+10:6741:x1877727000927104:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790740230.644059:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99054850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+10:6741:x1877727000927104:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 236us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740230.644068:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 274 00000100:00100000:3.0:1790740230.651602:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740230.651704:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000927232 00000100:00100000:0.0:1790740230.651718:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000927232 00000100:00100000:0.0:1790740230.651800:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 275 00000100:00100000:0.0:1790740230.651812:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+10:6741:x1877727000927232:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790740230.652016:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+10:6741:x1877727000927232:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 205us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740230.652025:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 275 00010000:00010000:2.0:1790740231.658833:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740231.786720:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021962880:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790740231.786832:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740231.786904:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021962880 00000100:00100000:1.0:1790740231.786914:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021962880 00000100:00100000:1.0:1790740231.786999:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790740231.787010:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021962880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790740231.787076:0:7846:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1790740231.787149:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021962880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 141us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740231.787168:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790740231.787248:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021962880:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790740232.088422:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740232.088517:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740232.088556:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740232.088583:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740232.088607:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740232.088646:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000927872 00000100:00100000:3.0:1790740232.088657:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000927872 00000100:00100000:3.0:1790740232.088726:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000927744 00000100:00100000:3.0:1790740232.088730:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000927744 00000100:00100000:3.0:1790740232.088756:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 28 00000100:00100000:3.0:1790740232.088766:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bed19f2-4c98-4684-89e7-a6871565665d+5:2404:x1877727000927872:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740232.088857:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bed19f2-4c98-4684-89e7-a6871565665d+5:2404:x1877727000927872:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 92us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740232.088865:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 28 00000100:00100000:3.0:1790740232.088884:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 29 00000100:00100000:3.0:1790740232.088890:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bed19f2-4c98-4684-89e7-a6871565665d+5:2404:x1877727000927744:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740232.088915:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bed19f2-4c98-4684-89e7-a6871565665d+5:2404:x1877727000927744:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 25us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740232.088922:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 29 00000100:00100000:3.0:1790740232.088943:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000927616 00000100:00100000:3.0:1790740232.088946:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000927616 00000100:00100000:3.0:1790740232.088976:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000927488 00000100:00100000:3.0:1790740232.088980:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000927488 00000100:00100000:3.0:1790740232.089002:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 74 00000100:00100000:3.0:1790740232.089009:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+5:2404:x1877727000927616:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740232.089074:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+5:2404:x1877727000927616:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 65us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740232.089081:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 74 00000100:00100000:3.0:1790740232.089093:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 75 00000100:00100000:3.0:1790740232.089100:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+6:2404:x1877727000927488:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740232.089123:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+6:2404:x1877727000927488:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 24us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740232.089130:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 75 00000100:00080000:3.0:1790740232.089151:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790740232.089167:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790740232.089170:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790740232.089172:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790740232.089576:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000927360 00000100:00100000:1.0:1790740232.089582:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000927360 00000100:00100000:1.0:1790740232.089629:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 276 00000100:00100000:1.0:1790740232.089638:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+10:2404:x1877727000927360:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1790740232.089677:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+10:2404:x1877727000927360:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 40us (1270us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740232.089683:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 276 00000100:00100000:0.0:1790740232.298468:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfc13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021963008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790740232.298579:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740232.298720:0:10118:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021963008 00000100:00100000:3.0:1790740232.298731:0:10118:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021963008 00000100:00100000:3.0:1790740232.298817:0:10118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790740232.298828:0:10118:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727021963008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790740232.298867:0:10118:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790740232.298923:0:10118:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727021963008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740232.298930:0:10118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1790740232.298984:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790740232.299021:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcbfc13100 x1877727021963008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740248 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740232.299082:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfc13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021963008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790740232.300305:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790740232.300995:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfc13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021963136:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790740232.301331:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740232.305308:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021963136 00000100:00100000:2.0:1790740232.305334:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021963136 00000100:00100000:1.0:1790740232.305532:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790740232.305547:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021963136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790740232.305586:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790740232.305724:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021963136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 181us (4392us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740232.305733:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1790740232.305793:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790740232.306276:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcbfc13100 x1877727021963136/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740248 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740232.306302:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfc13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021963136:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1790740232.684781:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740233.706754:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740233.834298:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83f13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877727021963648:0@lo:400:kworker.0 00000100:00100000:3.0:1790740233.834350:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83f12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3641:1877727021963264:0@lo:400:kworker.0 00000100:00100000:1.0:1790740233.834369:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740233.834388:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740233.838964:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83f13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727021963520:0@lo:400:kworker.0 00000100:00100000:1.0:1790740233.841740:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83f11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021964160:0@lo:400:kworker.0 00000100:00100000:1.0:1790740233.841825:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740233.841865:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021964672:0@lo:400:kworker.0 00000100:00100000:1.0:1790740233.841889:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740233.841923:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021964160 00000100:00100000:1.0:1790740233.841930:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021964160 00000100:00100000:1.0:1790740233.841974:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021964672 00000100:00100000:1.0:1790740233.841977:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021964672 00000100:00100000:1.0:1790740233.842004:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790740233.842013:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021964160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740233.842077:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021964160:12345-0@lo:400:kworker.0 Request processed in 65us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740233.842084:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790740233.842100:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790740233.842105:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ee8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021964672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740233.842145:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ee8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021964672:12345-0@lo:400:kworker.0 Request processed in 39us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740233.842162:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790740233.842184:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021963648 00000100:00100000:1.0:1790740233.842187:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021963648 00000100:00100000:1.0:1790740233.842215:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790740233.842221:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877727021963648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740233.842255:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877727021963648:12345-0@lo:400:kworker.0 Request processed in 34us (7885us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740233.842261:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1790740233.842280:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1790740233.842314:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83ee8700 x1877727021964672/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740233.842328:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021964672:0@lo:400:kworker.0 00000100:00100000:1.0:1790740233.842354:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83f13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877727021963648:0@lo:400:kworker.0 00010000:00080000:1.0:1790740233.842364:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83f11f80 x1877727021964160/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740233.842373:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83f11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021964160:0@lo:400:kworker.0 00000100:00100000:1.0:1790740233.842411:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83f13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727021963392:0@lo:400:kworker.0 00000100:00100000:1.0:1790740233.842438:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740233.842459:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83f11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877727021963904:0@lo:400:kworker.0 00000100:00100000:1.0:1790740233.842478:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740233.842514:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83f12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1877727021964416:0@lo:400:kworker.0 00000100:00100000:1.0:1790740233.842535:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740233.842549:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021964928:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790740233.842583:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740233.842615:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021963392 00000100:00100000:1.0:1790740233.842619:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021963392 00000100:00100000:1.0:1790740233.842640:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021963904 00000100:00100000:1.0:1790740233.842643:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021963904 00000100:00100000:1.0:1790740233.842660:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021964416 00000100:00100000:1.0:1790740233.842663:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021964416 00000100:00100000:1.0:1790740233.842677:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790740233.842683:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ee8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727021963392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740233.842734:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ee8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727021963392:12345-0@lo:400:kworker.0 Request processed in 50us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740233.842740:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790740233.842751:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1790740233.842757:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877727021963904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740233.842785:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877727021963904:12345-0@lo:400:kworker.0 Request processed in 29us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740233.842791:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1790740233.842803:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1790740233.842810:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877727021964416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740233.842837:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877727021964416:12345-0@lo:400:kworker.0 Request processed in 28us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740233.842843:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1790740233.842862:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021964928 00000100:00100000:1.0:1790740233.842865:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021964928 00000100:00100000:1.0:1790740233.842889:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790740233.842896:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ee9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021964928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790740233.842918:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790740233.842957:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ee9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021964928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740233.842963:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1790740233.842979:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790740233.842994:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83f13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727021963392:0@lo:400:kworker.0 00000100:00100000:1.0:1790740233.843003:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83f11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877727021963904:0@lo:400:kworker.0 00000100:00100000:1.0:1790740233.843010:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83f12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1877727021964416:0@lo:400:kworker.0 00010000:00080000:1.0:1790740233.843018:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83d91c00 x1877727021964928/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740249 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740233.843053:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021964928:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790740233.843108:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021963264 00000100:00100000:1.0:1790740233.843113:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021963264 00000100:00100000:1.0:1790740233.843152:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1790740233.843159:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3641:x1877727021963264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740233.843193:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3641:x1877727021963264:12345-0@lo:400:kworker.0 Request processed in 35us (8804us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740233.843198:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1790740233.843677:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83f12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3641:1877727021963264:0@lo:400:kworker.0 00000100:00100000:3.0:1790740233.843687:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83f10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021963776:0@lo:400:kworker.0 00000100:00100000:3.0:1790740233.843728:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740233.843756:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83f10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021964288:0@lo:400:kworker.0 00000100:00100000:3.0:1790740233.843779:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740233.843802:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021964288 00000100:00100000:3.0:1790740233.843806:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021964288 00000100:00100000:3.0:1790740233.843836:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790740233.843842:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021964288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740233.843872:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021964288:12345-0@lo:400:kworker.0 Request processed in 30us (92us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740233.843878:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1790740233.843905:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83f10e00 x1877727021964288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740233.843916:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83f10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021964288:0@lo:400:kworker.0 00000100:00100000:3.0:1790740233.843922:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83eeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021964800:0@lo:400:kworker.0 00000100:00100000:3.0:1790740233.843944:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740233.843964:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021964800 00000100:00100000:3.0:1790740233.843968:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021964800 00000100:00100000:3.0:1790740233.843997:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790740233.844002:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021964800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740233.844047:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021964800:12345-0@lo:400:kworker.0 Request processed in 44us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740233.844052:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1790740233.844066:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1790740233.844086:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83eeb100 x1877727021964800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740233.844095:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83eeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021964800:0@lo:400:kworker.0 00000100:00100000:1.0:1790740233.848160:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021963776 00000100:00100000:1.0:1790740233.848176:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021963776 00000100:00100000:1.0:1790740233.849481:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790740233.849500:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021963776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740233.849609:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021963776:12345-0@lo:400:kworker.0 Request processed in 118us (5881us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740233.849617:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790740233.852378:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83f10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021963776:0@lo:400:kworker.0 00000100:00100000:0.0:1790740233.852961:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740233.853012:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83f11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1877727021964032:0@lo:400:kworker.0 00000100:00100000:0.0:1790740233.853067:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740233.853098:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021964032 00000100:00100000:0.0:1790740233.853112:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021964032 00000100:00100000:0.0:1790740233.853181:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1790740233.853190:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877727021964032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740233.853241:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877727021964032:12345-0@lo:400:kworker.0 Request processed in 53us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740233.853248:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:0.0:1790740233.853270:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1790740233.853293:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83f11500 x1877727021964032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740233.853306:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83f11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1877727021964032:0@lo:400:kworker.0 00000100:00100000:0.0:1790740233.853314:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83f12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1877727021964544:0@lo:400:kworker.0 00000100:00100000:0.0:1790740233.853342:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740233.853350:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021963520 00000100:00100000:3.0:1790740233.853354:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021963520 00000100:00100000:0.0:1790740233.853361:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021964544 00000100:00100000:0.0:1790740233.853364:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021964544 00000100:00100000:3.0:1790740233.853382:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790740233.853387:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1790740233.853388:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727021963520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740233.853392:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1877727021964544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740233.853420:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727021963520:12345-0@lo:400:kworker.0 Request processed in 33us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740233.853420:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1877727021964544:12345-0@lo:400:kworker.0 Request processed in 27us (78us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740233.853426:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790740233.853426:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:0.0:1790740233.853439:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1790740233.853454:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83f12300 x1877727021964544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740233.853464:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83f12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1877727021964544:0@lo:400:kworker.0 00000100:00100000:0.0:1790740233.853471:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021965056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790740233.853496:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740233.853555:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83f13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727021963520:0@lo:400:kworker.0 00000100:00100000:3.0:1790740233.853811:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021965056 00000100:00100000:3.0:1790740233.853817:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021965056 00000100:00100000:3.0:1790740233.853854:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790740233.853862:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd553b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727021965056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790740233.853880:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790740233.853917:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd553b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727021965056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740233.853922:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1790740233.855757:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcbd550e00 x1877727021965056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740249 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740233.856317:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021965056:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790740234.731351:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740234.862092:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021965184:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790740234.862180:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740234.862289:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021965184 00000100:00100000:3.0:1790740234.862298:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021965184 00000100:00100000:3.0:1790740234.862356:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790740234.862365:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021965184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790740234.862400:0:7846:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1790740234.863023:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021965184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 657us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740234.863055:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1790740234.863180:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021965184:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1790740235.276939:0:10715:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg403-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1790740235.754499:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740236.778266:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740236.908156:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790740236.908184:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021965312:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790740236.908258:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740236.908341:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021965312 00000100:00100000:2.0:1790740236.908349:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021965312 00000100:00100000:2.0:1790740236.908392:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790740236.908400:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021965312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790740236.908453:0:6540:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1790740236.908516:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021965312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 116us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740236.908524:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790740236.908575:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021965312:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790740237.211105:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740237.211153:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740237.211172:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000928000 00000100:00100000:2.0:1790740237.211181:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000928000 00000100:00100000:1.0:1790740237.211181:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740237.211203:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740237.211224:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740237.211230:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 278 00000100:00100000:2.0:1790740237.211241:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+10:2402:x1877727000928000:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1790740237.211246:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000928512 00000100:00100000:1.0:1790740237.211250:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000928512 00000100:00100000:1.0:1790740237.211283:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000928384 00000100:00100000:1.0:1790740237.211286:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000928384 00000100:00100000:1.0:1790740237.211304:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 34 00000100:00100000:2.0:1790740237.211310:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+10:2402:x1877727000928000:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 71us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740237.211311:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb6f3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bed19f2-4c98-4684-89e7-a6871565665d+5:2402:x1877727000928512:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1790740237.211317:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 278 00000100:00100000:1.0:1790740237.211338:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb6f3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bed19f2-4c98-4684-89e7-a6871565665d+5:2402:x1877727000928512:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 28us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740237.211344:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 34 00000100:00100000:1.0:1790740237.211498:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 35 00000100:00100000:1.0:1790740237.211506:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bed19f2-4c98-4684-89e7-a6871565665d+5:2402:x1877727000928384:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1790740237.211535:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bed19f2-4c98-4684-89e7-a6871565665d+5:2402:x1877727000928384:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 31us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740237.211541:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 35 00000100:00100000:0.0:1790740237.211884:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000928256 00000100:00100000:0.0:1790740237.211890:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000928256 00000100:00100000:0.0:1790740237.211930:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000928128 00000100:00100000:0.0:1790740237.211933:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000928128 00000100:00100000:0.0:1790740237.211959:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 82 00000100:00100000:0.0:1790740237.211966:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+5:2402:x1877727000928256:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1790740237.212002:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+5:2402:x1877727000928256:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 37us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740237.212009:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 82 00000100:00100000:0.0:1790740237.212022:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 83 00000100:00100000:0.0:1790740237.212048:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+6:2402:x1877727000928128:12345-192.168.204.3@tcp:400:kworker.0 00000100:00080000:1.0:1790740237.212109:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790740237.212114:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790740237.212117:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790740237.212119:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790740237.212327:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+6:2402:x1877727000928128:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 297us (1121us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740237.212334:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 83 00000100:00100000:0.0:1790740237.419756:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790740237.419783:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727021965440:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790740237.419857:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740237.420815:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021965568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790740237.420853:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740237.421273:0:10118:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021965440 00000100:00100000:1.0:1790740237.421281:0:10118:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021965440 00000100:00100000:1.0:1790740237.421333:0:10118:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021965568 00000100:00100000:1.0:1790740237.421336:0:10118:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021965568 00000100:00100000:1.0:1790740237.421352:0:10118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790740237.421373:0:10118:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd551880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727021965440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790740237.421401:0:10118:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790740237.421454:0:10118:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd551880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727021965440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (1597us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740237.421461:0:10118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790740237.421480:0:10118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790740237.421487:0:10118:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727021965568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790740237.421497:0:10118:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790740237.421521:0:10118:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727021965568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 35us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740237.421527:0:10118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1790740237.421558:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83d68700 x1877727021965568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740253 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740237.421575:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021965568:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1790740237.421588:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83d6aa00 x1877727021965440/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740253 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740237.421599:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727021965440:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1790740237.421727:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790740237.802232:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740238.826162:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740238.957608:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3641:1877727021965824:0@lo:400:kworker.0 00000100:00100000:1.0:1790740238.957713:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740238.957769:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021966336:0@lo:400:kworker.0 00000100:00100000:1.0:1790740238.957797:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740238.957825:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021966848:0@lo:400:kworker.0 00000100:00100000:1.0:1790740238.957849:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740238.957882:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021967360:0@lo:400:kworker.0 00000100:00100000:1.0:1790740238.957903:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740238.957929:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1790740238.957935:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021965696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790740238.957956:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740238.957987:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877727021966208:0@lo:400:kworker.0 00000100:00100000:1.0:1790740238.958012:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740238.958057:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021966720:0@lo:400:kworker.0 00000100:00100000:1.0:1790740238.958078:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740238.958095:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021967232:0@lo:400:kworker.0 00000100:00100000:1.0:1790740238.958115:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740238.958142:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ee9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727021965952:0@lo:400:kworker.0 00000100:00100000:1.0:1790740238.958166:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740238.958184:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877727021966464:0@lo:400:kworker.0 00000100:00100000:1.0:1790740238.958205:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740238.958219:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1877727021966976:0@lo:400:kworker.0 00000100:00100000:3.0:1790740238.958271:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021966336 00000100:00100000:3.0:1790740238.958281:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021966336 00000100:00100000:3.0:1790740238.958338:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790740238.958347:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021966336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740238.958410:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021966336:12345-0@lo:400:kworker.0 Request processed in 64us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740238.958417:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790740238.958465:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021966336:0@lo:400:kworker.0 00000100:00100000:1.0:1790740238.958592:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740238.958623:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1790740238.958629:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83eeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021966080:0@lo:400:kworker.0 00000100:00100000:1.0:1790740238.958650:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740238.958724:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1877727021966592:0@lo:400:kworker.0 00000100:00100000:1.0:1790740238.958750:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740238.958761:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1877727021967104:0@lo:400:kworker.0 00000100:00100000:1.0:1790740238.958778:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740238.958813:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021965824 00000100:00100000:1.0:1790740238.958817:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021965824 00000100:00100000:1.0:1790740238.958845:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1790740238.958851:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3641:x1877727021965824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740238.958884:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3641:x1877727021965824:12345-0@lo:400:kworker.0 Request processed in 33us (1171us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740238.958890:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1790740238.958916:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021966848 00000100:00100000:1.0:1790740238.958920:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021966848 00000100:00100000:1.0:1790740238.958936:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021967360 00000100:00100000:1.0:1790740238.958938:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021967360 00000100:00100000:1.0:1790740238.958959:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021966720 00000100:00100000:1.0:1790740238.958961:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021966720 00000100:00100000:3.0:1790740238.960639:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021966208 00000100:00100000:3.0:1790740238.960656:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021966208 00000100:00100000:3.0:1790740238.960693:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021965952 00000100:00100000:3.0:1790740238.960696:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021965952 00000100:00100000:3.0:1790740238.960709:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021966464 00000100:00100000:3.0:1790740238.960712:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021966464 00000100:00100000:3.0:1790740238.960728:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021966976 00000100:00100000:3.0:1790740238.960731:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021966976 00000100:00100000:3.0:1790740238.960742:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021966592 00000100:00100000:3.0:1790740238.960744:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021966592 00000100:00100000:3.0:1790740238.960755:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021967104 00000100:00100000:3.0:1790740238.960758:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021967104 00000100:00100000:3.0:1790740238.960775:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1790740238.960782:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021967232 00000100:00100000:3.0:1790740238.960783:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877727021966208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740238.960786:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021967232 00000100:00100000:1.0:1790740238.960805:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790740238.960812:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021966848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740238.962464:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021966080 00000100:00100000:2.0:1790740238.962473:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021966080 00000100:00100000:2.0:1790740238.962518:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790740238.962527:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021966080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740238.969257:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877727021966208:12345-0@lo:400:kworker.0 Request processed in 8459us (11229us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740238.969278:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1790740238.969318:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1790740238.969331:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727021965952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740238.969415:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727021965952:12345-0@lo:400:kworker.0 Request processed in 90us (11248us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740238.969421:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1790740238.969445:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1790740238.969452:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877727021966464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740238.969484:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877727021966464:12345-0@lo:400:kworker.0 Request processed in 34us (11278us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740238.969490:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1790740238.969501:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1790740238.969508:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877727021966976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740238.969548:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877727021966976:12345-0@lo:400:kworker.0 Request processed in 40us (10956us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740238.969554:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1790740238.969567:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1790740238.969575:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877727021966592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740238.969606:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877727021966592:12345-0@lo:400:kworker.0 Request processed in 33us (10855us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740238.969611:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1790740238.969621:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1790740238.969628:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877727021967104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740238.969655:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877727021967104:12345-0@lo:400:kworker.0 Request processed in 28us (10876us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740238.969661:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1790740238.969725:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877727021966208:0@lo:400:kworker.0 00000100:00100000:3.0:1790740238.969740:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3641:1877727021965824:0@lo:400:kworker.0 00010000:00080000:3.0:1790740238.969759:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83e1f800 x1877727021966848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740238.969783:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021966848:0@lo:400:kworker.0 00000100:00100000:3.0:1790740238.969881:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021967488:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790740238.969924:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1790740238.969963:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83e1dc00 x1877727021966592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740238.969973:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1877727021966592:0@lo:400:kworker.0 00010000:00080000:3.0:1790740238.969984:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83e1ce00 x1877727021967104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740238.969993:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1877727021967104:0@lo:400:kworker.0 00000100:00100000:3.0:1790740238.970003:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ee9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727021965952:0@lo:400:kworker.0 00000100:00100000:3.0:1790740238.970013:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877727021966464:0@lo:400:kworker.0 00000100:00100000:3.0:1790740238.970056:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1877727021966976:0@lo:400:kworker.0 00000100:00100000:0.0:1790740238.970845:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021965696 00000100:00100000:0.0:1790740238.970857:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021965696 00000100:00100000:0.0:1790740238.970905:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021967488 00000100:00100000:0.0:1790740238.970910:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021967488 00000100:00100000:0.0:1790740238.970927:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790740238.970936:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1877727021965696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790740238.970980:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790740238.971075:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1877727021965696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 141us (13117us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740238.971082:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790740238.971100:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790740238.971107:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3638:x1877727021967488:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790740238.971118:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790740238.971149:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3638:x1877727021967488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (1224us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740238.971154:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1790740238.971228:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83d92680 x1877727021967488/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740254 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740238.971247:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021967488:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1790740238.971275:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83ee8a80 x1877727021965696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740254 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740238.971288:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021965696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790740238.971343:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021966848:12345-0@lo:400:kworker.0 Request processed in 10529us (13490us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740238.971353:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790740238.971372:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790740238.971378:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021967360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740238.971423:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021967360:12345-0@lo:400:kworker.0 Request processed in 46us (13519us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740238.971430:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790740238.971441:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790740238.971448:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021966720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740238.971480:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021966720:12345-0@lo:400:kworker.0 Request processed in 33us (13401us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740238.971497:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790740238.971508:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790740238.971514:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021967232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740238.971557:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021967232:12345-0@lo:400:kworker.0 Request processed in 43us (13440us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740238.971562:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1790740238.971616:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790740238.971622:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790740238.971625:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790740238.974093:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021966080:12345-0@lo:400:kworker.0 Request processed in 11553us (15427us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740238.974110:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:3.0:1790740238.975471:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83e1ea00 x1877727021966720/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740238.975513:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021966720:0@lo:400:kworker.0 00010000:00080000:3.0:1790740238.975534:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83e1d880 x1877727021967232/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740238.975545:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021967232:0@lo:400:kworker.0 00010000:00080000:3.0:1790740238.975558:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83e1ca80 x1877727021967360/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740238.975566:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021967360:0@lo:400:kworker.0 00000100:00100000:0.0:1790740238.979301:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83eeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021966080:0@lo:400:kworker.0 00010000:00010000:1.0:1790740239.850474:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740239.978761:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790740239.978784:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021967616:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790740239.978867:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740239.979023:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021967616 00000100:00100000:3.0:1790740239.979043:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021967616 00000100:00100000:3.0:1790740239.979098:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790740239.979107:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021967616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790740239.979139:0:6540:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1790740239.979183:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021967616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740239.979190:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790740239.979271:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021967616:0@lo:41:osp-pre-1-0.0 00000001:02000400:3.0:1790740240.542182:0:10958:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg403-server.virtnet: executing yml_node 00010000:00010000:2.0:1790740240.876826:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740241.900210:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740242.026269:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021967744:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790740242.026356:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740242.026498:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021967744 00000100:00100000:2.0:1790740242.026509:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021967744 00000100:00100000:2.0:1790740242.026571:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790740242.026585:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021967744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790740242.026628:0:6541:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1790740242.026699:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021967744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740242.026706:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790740242.026787:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021967744:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790740242.335609:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740242.335659:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740242.335697:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740242.335805:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000928640 00000100:00100000:2.0:1790740242.335816:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000928640 00000100:00100000:2.0:1790740242.335873:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 280 00000100:00100000:2.0:1790740242.335884:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+10:2403:x1877727000928640:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1790740242.335953:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+10:2403:x1877727000928640:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 71us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740242.335973:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 280 00000100:00100000:0.0:1790740242.336198:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000928896 00000100:00100000:0.0:1790740242.336202:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000928896 00000100:00100000:0.0:1790740242.336252:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000928768 00000100:00100000:0.0:1790740242.336256:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000928768 00000100:00100000:0.0:1790740242.336278:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 90 00000100:00100000:0.0:1790740242.336285:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+5:2403:x1877727000928896:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1790740242.336341:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+5:2403:x1877727000928896:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 57us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740242.336348:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 90 00000100:00100000:0.0:1790740242.336363:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 91 00000100:00100000:0.0:1790740242.336369:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83f11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+6:2403:x1877727000928768:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1790740242.336400:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83f11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+6:2403:x1877727000928768:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 32us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740242.336406:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 91 00000100:00080000:2.0:1790740242.336514:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790740242.336519:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790740242.346854:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740242.346906:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740242.347016:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000929024 00000100:00100000:2.0:1790740242.347028:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000929024 00000100:00100000:2.0:1790740242.347128:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000929152 00000100:00100000:2.0:1790740242.347133:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000929152 00000100:00100000:2.0:1790740242.347157:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 18 00000100:00100000:2.0:1790740242.347167:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83f11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bed19f2-4c98-4684-89e7-a6871565665d+5:2401:x1877727000929024:12345-192.168.204.3@tcp:9:kworker.0 00000020:00000080:2.0:1790740242.347217:0:8453:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92db1f 00000100:00080000:2.0:1790740242.347226:0:8453:0:(import.c:65:import_set_state_nolock()) ffff98db83e07800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790740242.347271:0:8453:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1790740242.347458:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83f11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bed19f2-4c98-4684-89e7-a6871565665d+2:2401:x1877727000929024:12345-192.168.204.3@tcp:9:kworker.0 Request processed in 292us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740242.347483:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 18 00000100:00100000:2.0:1790740242.347501:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 19 00000100:00100000:2.0:1790740242.347507:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83f12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bed19f2-4c98-4684-89e7-a6871565665d+5:2401:x1877727000929152:12345-192.168.204.3@tcp:9:kworker.0 00000020:00000080:2.0:1790740242.347520:0:8453:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92db26 00000100:00080000:2.0:1790740242.347527:0:8453:0:(import.c:65:import_set_state_nolock()) ffff98db83e03000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790740242.347634:0:8453:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1790740242.347724:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83f12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bed19f2-4c98-4684-89e7-a6871565665d+2:2401:x1877727000929152:12345-192.168.204.3@tcp:9:kworker.0 Request processed in 216us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740242.347730:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 19 00010000:00010000:2.0:1790740242.347749:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740242.351746:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790740242.351761:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790740242.351769:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790740242.538717:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790740242.538741:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83f13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021967872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790740242.538816:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740242.539454:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021967872 00000100:00100000:1.0:1790740242.539464:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021967872 00000100:00100000:1.0:1790740242.539541:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790740242.539552:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd551500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021967872:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790740242.539660:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1790740242.539760:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790740242.539875:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd551500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021967872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 324us (1057us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740242.539882:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790740242.541490:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021968000:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790740242.541573:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740242.542287:0:10118:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021968000 00000100:00100000:3.0:1790740242.542297:0:10118:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021968000 00000100:00100000:3.0:1790740242.542365:0:10118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790740242.542375:0:10118:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021968000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790740242.542407:0:10118:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790740242.542463:0:10118:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021968000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740242.542485:0:10118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1790740242.542533:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83d6b480 x1877727021968000/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740258 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740242.542551:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021968000:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1790740242.544282:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790740242.551670:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83f13800 x1877727021967872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740258 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740242.551700:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83f13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021967872:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790740242.922163:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740243.946740:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740244.074341:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790740244.074381:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83f12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021968128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790740244.074452:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740244.074476:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790740244.074492:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3641:1877727021968384:0@lo:400:kworker.0 00000100:00100000:1.0:1790740244.074535:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727021968512:0@lo:400:kworker.0 00000100:00100000:3.0:1790740244.074544:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740244.074581:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740244.074588:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021968256:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790740244.074609:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021968384 00000100:00100000:1.0:1790740244.074611:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877727021969024:0@lo:400:kworker.0 00000100:00100000:2.0:1790740244.074619:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021968384 00000100:00100000:3.0:1790740244.074622:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740244.074650:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021968896:0@lo:400:kworker.0 00000100:00100000:1.0:1790740244.074657:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740244.074670:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1790740244.074682:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3641:x1877727021968384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740244.074689:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740244.074692:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1877727021969536:0@lo:400:kworker.0 00000100:00100000:3.0:1790740244.074718:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021969408:0@lo:400:kworker.0 00000100:00100000:1.0:1790740244.074727:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740244.074790:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727021968640:0@lo:400:kworker.0 00000100:00100000:1.0:1790740244.081461:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021968512 00000100:00100000:1.0:1790740244.081490:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021968512 00000100:00100000:1.0:1790740244.081554:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021969024 00000100:00100000:1.0:1790740244.081558:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021969024 00000100:00100000:1.0:1790740244.081582:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021969536 00000100:00100000:1.0:1790740244.081586:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021969536 00000100:00100000:1.0:1790740244.081607:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1790740244.081616:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83f10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727021968512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740244.081708:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740244.081723:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83f10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727021968512:12345-0@lo:400:kworker.0 Request processed in 106us (7141us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740244.081732:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1790740244.081754:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1790740244.081763:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83f10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877727021969024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740244.081769:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3641:1877727021968384:0@lo:400:kworker.0 00000100:00100000:0.0:1790740244.081778:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740244.081796:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1790740244.081809:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877727021968768:0@lo:400:kworker.0 00000100:00100000:1.0:1790740244.081816:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83f10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877727021969024:12345-0@lo:400:kworker.0 Request processed in 53us (7157us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740244.081826:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1790740244.081827:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1877727021969152:0@lo:400:kworker.0 00000100:00100000:1.0:1790740244.081840:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1790740244.081849:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83f12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877727021969536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740244.081855:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740244.081873:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021968896 00000100:00100000:0.0:1790740244.081879:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021968896 00000100:00100000:3.0:1790740244.081887:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021969280:0@lo:400:kworker.0 00000100:00100000:1.0:1790740244.081913:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83f12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877727021969536:12345-0@lo:400:kworker.0 Request processed in 65us (7185us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740244.081914:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021968640 00000100:00100000:0.0:1790740244.081919:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021968640 00000100:00100000:1.0:1790740244.081937:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1790740244.081938:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740244.081958:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021968768 00000100:00100000:0.0:1790740244.081959:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790740244.081965:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021968768 00000100:00100000:3.0:1790740244.081967:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021969792:0@lo:400:kworker.0 00000100:00100000:0.0:1790740244.081972:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021968896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740244.081989:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1790740244.082002:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740244.082002:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877727021968768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740244.082048:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021968896:12345-0@lo:400:kworker.0 Request processed in 63us (7345us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740244.082057:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790740244.082073:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877727021968768:12345-0@lo:400:kworker.0 Request processed in 75us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740244.082082:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1790740244.082088:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1790740244.082097:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727021968640:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1790740244.082115:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790740244.082135:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021968128 00000100:00100000:1.0:1790740244.082139:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021968128 00000100:00100000:0.0:1790740244.082157:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727021968640:12345-0@lo:400:kworker.0 Request processed in 61us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740244.082164:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790740244.082172:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021968256 00000100:00100000:1.0:1790740244.082177:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021968256 00000100:00100000:1.0:1790740244.082198:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790740244.082205:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83f11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021968128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790740244.082225:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790740244.082229:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021969408 00000100:00100000:3.0:1790740244.082236:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021969408 00000100:00100000:1.0:1790740244.082263:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83f11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021968128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (7810us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740244.082270:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790740244.082285:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790740244.082292:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021968256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790740244.082301:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790740244.082326:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021968256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 35us (7705us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740244.082332:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790740244.094391:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021969280 00000100:00100000:0.0:1790740244.094405:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021969280 00000100:00100000:2.0:1790740244.094935:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3641:x1877727021968384:12345-0@lo:400:kworker.0 Request processed in 20240us (20378us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740244.094951:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1790740244.095383:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021969792 00000100:00100000:2.0:1790740244.095390:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021969792 00000100:00100000:2.0:1790740244.095431:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790740244.095440:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021969408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740244.095546:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021969408:12345-0@lo:400:kworker.0 Request processed in 108us (13840us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740244.095553:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790740244.095570:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790740244.095577:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021969792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740244.095606:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021969792:12345-0@lo:400:kworker.0 Request processed in 30us (13610us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740244.095612:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1790740244.095769:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83d92d80 x1877727021969792/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740244.095785:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021969792:0@lo:400:kworker.0 00000100:00100000:2.0:1790740244.095800:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021968896:0@lo:400:kworker.0 00010000:00080000:2.0:1790740244.095823:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83d90700 x1877727021969408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740244.095833:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021969408:0@lo:400:kworker.0 00010000:00080000:2.0:1790740244.095845:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83d6b480 x1877727021968256/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740260 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740244.095861:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021968256:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790740244.095893:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877727021968768:0@lo:400:kworker.0 00000100:00100000:2.0:1790740244.095974:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740244.096010:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1877727021969664:0@lo:400:kworker.0 00000100:00100000:2.0:1790740244.096071:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740244.096111:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727021968640:0@lo:400:kworker.0 00000100:00100000:1.0:1790740244.096205:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021969152 00000100:00100000:1.0:1790740244.096212:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021969152 00000100:00100000:3.0:1790740244.096245:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1877727021969536:0@lo:400:kworker.0 00000100:00100000:1.0:1790740244.096246:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021969664 00000100:00100000:1.0:1790740244.096252:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021969664 00000100:00100000:3.0:1790740244.096263:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727021968512:0@lo:400:kworker.0 00000100:00100000:3.0:1790740244.096280:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877727021969024:0@lo:400:kworker.0 00000100:00100000:1.0:1790740244.096280:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1790740244.096294:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877727021969152:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1790740244.096301:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83f12300 x1877727021968128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740260 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740244.096315:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83f12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021968128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790740244.096342:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877727021969152:12345-0@lo:400:kworker.0 Request processed in 51us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740244.096351:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:3.0:1790740244.096356:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790740244.096363:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790740244.096366:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790740244.096371:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1790740244.096382:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1877727021969664:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1790740244.096405:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790740244.096420:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1877727021969664:12345-0@lo:400:kworker.0 Request processed in 40us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740244.096421:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790740244.096432:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1790740244.096437:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021969280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740244.096490:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021969280:12345-0@lo:400:kworker.0 Request processed in 59us (14569us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740244.096498:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1790740244.096515:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83d91c00 x1877727021969280/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740244.096525:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021969280:0@lo:400:kworker.0 00010000:00080000:3.0:1790740244.099391:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83d92680 x1877727021969152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740244.099409:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1877727021969152:0@lo:400:kworker.0 00010000:00080000:3.0:1790740244.099422:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83d91880 x1877727021969664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740244.099430:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1877727021969664:0@lo:400:kworker.0 00010000:00010000:0.0:1790740244.983272:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740245.098512:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790740245.098534:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021969920:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790740245.098603:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740245.098735:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021969920 00000100:00100000:1.0:1790740245.098742:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021969920 00000100:00100000:1.0:1790740245.098793:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790740245.098801:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82f98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021969920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790740245.098836:0:6541:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790740245.098892:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82f98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021969920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740245.098899:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1790740245.098989:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021969920:0@lo:41:osp-pre-1-0.0 00000001:02000400:1.0:1790740245.495703:0:11142:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.59.3 00010000:00010000:0.0:1790740245.994161:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740247.021286:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740247.146284:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021970048:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790740247.146375:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740247.150429:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021970048 00000100:00100000:2.0:1790740247.150446:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021970048 00000100:00100000:2.0:1790740247.150538:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1790740247.150550:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021970048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790740247.150589:0:7846:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1790740247.150690:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021970048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 142us (4314us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740247.150697:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790740247.151146:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021970048:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790740247.448067:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740247.448115:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740247.448147:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740247.448250:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000929280 00000100:00100000:1.0:1790740247.448260:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000929280 00000100:00100000:0.0:1790740247.448287:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000929536 00000100:00100000:0.0:1790740247.448291:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000929536 00000100:00100000:1.0:1790740247.448322:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 282 00000100:00100000:0.0:1790740247.448328:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000929408 00000100:00100000:1.0:1790740247.448331:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+10:2402:x1877727000929280:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1790740247.448331:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000929408 00000100:00100000:0.0:1790740247.448350:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 98 00000100:00100000:0.0:1790740247.448355:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+5:2402:x1877727000929536:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1790740247.448540:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 99 00000100:00100000:2.0:1790740247.448551:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+6:2402:x1877727000929408:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1790740247.448614:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+5:2402:x1877727000929536:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 258us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740247.448629:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 98 00000100:00080000:3.0:1790740247.448644:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790740247.448648:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790740247.453172:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+10:2402:x1877727000929280:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 4829us (5134us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740247.453201:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 282 00000100:00100000:2.0:1790740247.455231:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+6:2402:x1877727000929408:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 6672us (7071us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740247.455247:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 99 00000100:00100000:1.0:1790740247.658513:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83f12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021970304:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790740247.658618:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740247.658710:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021970304 00000100:00100000:1.0:1790740247.658721:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021970304 00000100:00100000:3.0:1790740247.658993:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:2.0:1790740247.658995:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790740247.659011:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021970176:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790740247.659095:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740247.659388:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021970176 00000100:00100000:2.0:1790740247.659400:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021970176 00000100:00080000:3.0:1790740247.659460:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790740247.659473:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790740247.659488:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021970176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790740247.659519:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790740247.659609:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021970176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 127us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740247.659627:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790740247.660023:0:10118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790740247.660054:0:10118:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83f11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021970304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790740247.660080:0:10118:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790740247.660155:0:10118:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83f11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021970304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (1536us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740247.660171:0:10118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1790740247.660223:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83f12d80 x1877727021970304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740263 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740247.660245:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83f12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021970304:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1790740247.662193:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83d6bb80 x1877727021970176/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740263 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740247.662224:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021970176:0@lo:13:osp-pre-0-1.0 00000001:00100000:1.0:1790740247.663525:0:8446:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7bed19f2-4c98-4684-89e7-a6871565665d 00000020:00000080:1.0:1790740247.663533:0:8446:0:(genops.c:885:class_export_put()) final put ffff98db83e05800/7bed19f2-4c98-4684-89e7-a6871565665d 00000020:00000080:0.0:1790740247.669420:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98db83e05800/7bed19f2-4c98-4684-89e7-a6871565665d for lustre-OST0000 00000020:00000080:0.0:1790740247.669481:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98db83e07800 for lustre-OST0000 00000001:00100000:3.0:1790740247.672529:0:9531:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7bed19f2-4c98-4684-89e7-a6871565665d 00000020:00000080:3.0:1790740247.672539:0:9531:0:(genops.c:885:class_export_put()) final put ffff98db83e06800/7bed19f2-4c98-4684-89e7-a6871565665d 00000020:00000080:0.0:1790740247.672602:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff98db83e06800/7bed19f2-4c98-4684-89e7-a6871565665d for lustre-OST0001 00000020:00000080:0.0:1790740247.672651:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98db83e03000 for lustre-OST0001 00010000:00010000:0.0:1790740248.042250:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790740248.313019:0:11239:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.59.3 00010000:00010000:0.0:1790740249.071872:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740249.195355:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83f12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3641:1877727021970432:0@lo:400:kworker.0 00000100:00100000:1.0:1790740249.195437:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740249.195486:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83f12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021970944:0@lo:400:kworker.0 00000100:00100000:1.0:1790740249.195516:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740249.195537:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83c51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021971456:0@lo:400:kworker.0 00000100:00100000:1.0:1790740249.195564:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740249.195589:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83c52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021971968:0@lo:400:kworker.0 00000100:00100000:1.0:1790740249.195607:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740249.195628:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1790740249.195633:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83f13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877727021970816:0@lo:400:kworker.0 00000100:00100000:1.0:1790740249.195931:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740249.195951:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83c50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021971328:0@lo:400:kworker.0 00000100:00100000:1.0:1790740249.195973:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740249.195988:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83c50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021971840:0@lo:400:kworker.0 00000100:00100000:1.0:1790740249.196011:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740249.197206:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83f13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727021970560:0@lo:400:kworker.0 00000100:00100000:2.0:1790740249.197279:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740249.197320:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83f13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877727021971072:0@lo:400:kworker.0 00000100:00100000:2.0:1790740249.197342:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740249.197361:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83c51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1877727021971584:0@lo:400:kworker.0 00000100:00100000:2.0:1790740249.197383:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740249.197410:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1790740249.197416:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83f11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021970688:0@lo:400:kworker.0 00000100:00100000:2.0:1790740249.197439:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740249.197458:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83c53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1877727021971200:0@lo:400:kworker.0 00000100:00100000:2.0:1790740249.197479:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740249.197489:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83c51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1877727021971712:0@lo:400:kworker.0 00000100:00100000:2.0:1790740249.197509:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740249.197567:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021970816 00000100:00100000:2.0:1790740249.197575:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021970816 00000100:00100000:2.0:1790740249.197616:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021970560 00000100:00100000:2.0:1790740249.197619:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021970560 00000100:00100000:2.0:1790740249.197630:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021971072 00000100:00100000:2.0:1790740249.197633:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021971072 00000100:00100000:2.0:1790740249.197670:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021971584 00000100:00100000:2.0:1790740249.197673:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021971584 00000100:00100000:2.0:1790740249.197686:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021971200 00000100:00100000:2.0:1790740249.197688:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021971200 00000100:00100000:2.0:1790740249.197699:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021971712 00000100:00100000:2.0:1790740249.197702:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021971712 00000100:00100000:2.0:1790740249.197716:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1790740249.197737:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83c50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877727021970816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740249.198161:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021971456 00000100:00100000:3.0:1790740249.198168:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021971456 00000100:00100000:1.0:1790740249.198428:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790740249.198443:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727021972096:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790740249.198481:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740249.198519:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021970432 00000100:00100000:1.0:1790740249.198523:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021970432 00000100:00100000:1.0:1790740249.198552:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1790740249.198559:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3641:x1877727021970432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740249.198720:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021971968 00000100:00100000:3.0:1790740249.198726:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021971968 00000100:00100000:3.0:1790740249.198745:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021971328 00000100:00100000:3.0:1790740249.198748:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021971328 00000100:00100000:3.0:1790740249.198760:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021971840 00000100:00100000:3.0:1790740249.198763:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021971840 00000100:00100000:3.0:1790740249.198776:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790740249.198782:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83c50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021971456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740249.199463:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83c50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877727021970816:12345-0@lo:400:kworker.0 Request processed in 1721us (3525us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740249.199475:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1790740249.199507:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1790740249.199518:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727021970560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740249.199564:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727021970560:12345-0@lo:400:kworker.0 Request processed in 50us (2285us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740249.199570:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1790740249.199582:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1790740249.199590:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877727021971072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740249.199619:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877727021971072:12345-0@lo:400:kworker.0 Request processed in 31us (2277us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740249.199624:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1790740249.199636:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1790740249.199655:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877727021971584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740249.199687:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877727021971584:12345-0@lo:400:kworker.0 Request processed in 45us (2302us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740249.199693:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1790740249.199705:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1790740249.199712:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877727021971200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740249.199740:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877727021971200:12345-0@lo:400:kworker.0 Request processed in 30us (2261us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740249.199745:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1790740249.199756:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1790740249.199780:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877727021971712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740249.199814:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877727021971712:12345-0@lo:400:kworker.0 Request processed in 36us (2304us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740249.199819:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1790740249.199861:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021970944 00000100:00100000:2.0:1790740249.199867:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021970944 00000100:00100000:2.0:1790740249.199905:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021970688 00000100:00100000:2.0:1790740249.199908:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021970688 00000100:00100000:2.0:1790740249.199921:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1790740249.199927:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83c51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021970944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740249.200131:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021972096 00000100:00100000:0.0:1790740249.200136:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021972096 00000100:00100000:0.0:1790740249.200165:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790740249.200172:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83c52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3639:x1877727021972096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790740249.200194:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790740249.200248:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83c52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3639:x1877727021972096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (1766us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740249.200266:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790740249.200326:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790740249.200333:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83c50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021971968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740249.200810:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3641:x1877727021970432:12345-0@lo:400:kworker.0 Request processed in 2249us (5372us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740249.200819:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1790740249.200895:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1790740249.200904:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021970688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740249.200940:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021970688:12345-0@lo:400:kworker.0 Request processed in 38us (3500us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740249.200947:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1790740249.200981:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021972224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790740249.201050:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1790740249.201100:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83d90a80 x1877727021972096/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740265 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740249.201122:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727021972096:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790740249.201155:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021972224 00000100:00100000:1.0:1790740249.201160:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021972224 00000100:00100000:1.0:1790740249.201186:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790740249.201192:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83c52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1877727021972224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790740249.201203:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790740249.201463:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83c52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1877727021972224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 270us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740249.201470:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1790740249.201496:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db82f98a80 x1877727021972224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740265 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740249.201509:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021972224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790740249.201557:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83f13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877727021970816:0@lo:400:kworker.0 00000100:00100000:1.0:1790740249.201568:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83f12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3641:1877727021970432:0@lo:400:kworker.0 00000100:00100000:3.0:1790740249.201750:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83c50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021971456:12345-0@lo:400:kworker.0 Request processed in 2966us (6183us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740249.201759:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790740249.201777:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790740249.201786:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83c53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021971328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740249.201847:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83c53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021971328:12345-0@lo:400:kworker.0 Request processed in 63us (5872us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740249.201853:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790740249.201866:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790740249.201872:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83c51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021971840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740249.201902:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83c51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021971840:12345-0@lo:400:kworker.0 Request processed in 31us (5890us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740249.201908:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1790740249.201941:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790740249.201946:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790740249.201950:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790740249.201952:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790740249.202472:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83c50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021971968:12345-0@lo:400:kworker.0 Request processed in 2136us (6860us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740249.202481:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790740249.202619:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83c51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021970944:12345-0@lo:400:kworker.0 Request processed in 2690us (7099us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740249.202628:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1790740249.202736:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83f11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021970688:0@lo:400:kworker.0 00010000:00080000:2.0:1790740249.202752:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83c53b80 x1877727021971200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740249.202763:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83c53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1877727021971200:0@lo:400:kworker.0 00010000:00080000:2.0:1790740249.202776:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83c51f80 x1877727021971712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740249.202785:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83c51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1877727021971712:0@lo:400:kworker.0 00000100:00100000:2.0:1790740249.202796:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83f13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727021970560:0@lo:400:kworker.0 00000100:00100000:2.0:1790740249.202808:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83f13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877727021971072:0@lo:400:kworker.0 00000100:00100000:2.0:1790740249.202819:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83c51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1877727021971584:0@lo:400:kworker.0 00000100:00100000:1.0:1790740249.202934:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83f12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021970944:0@lo:400:kworker.0 00010000:00080000:1.0:1790740249.202946:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83c51180 x1877727021971456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740249.202955:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83c51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021971456:0@lo:400:kworker.0 00010000:00080000:1.0:1790740249.202965:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83c52d80 x1877727021971968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740249.202987:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83c52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021971968:0@lo:400:kworker.0 00010000:00080000:1.0:1790740249.203015:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83c50380 x1877727021971328/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740249.203023:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83c50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021971328:0@lo:400:kworker.0 00010000:00080000:1.0:1790740249.203213:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83c50e00 x1877727021971840/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740249.203222:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83c50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021971840:0@lo:400:kworker.0 00010000:00010000:2.0:1790740250.091172:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740250.218645:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790740250.218669:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021972352:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790740250.218747:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740250.218879:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021972352 00000100:00100000:1.0:1790740250.218888:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021972352 00000100:00100000:1.0:1790740250.218946:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1790740250.218956:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82f98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021972352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790740250.218995:0:6541:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790740250.219093:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82f98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021972352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 138us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740250.219101:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1790740250.219388:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021972352:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1790740251.116241:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790740251.130648:0:11337:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.59.3 00010000:00010000:0.0:1790740252.138339:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740252.266960:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790740252.266999:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021972480:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790740252.267164:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740252.267340:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021972480 00000100:00100000:0.0:1790740252.267375:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021972480 00000100:00100000:0.0:1790740252.267447:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1790740252.267458:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021972480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790740252.267510:0:7846:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1790740252.267594:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021972480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 136us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740252.267603:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790740252.268078:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021972480:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790740252.576073:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740252.576128:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740252.576164:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740252.576302:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000929792 00000100:00100000:0.0:1790740252.576317:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000929792 00000100:00100000:0.0:1790740252.576399:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000929920 00000100:00100000:0.0:1790740252.576403:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000929920 00000100:00100000:0.0:1790740252.576435:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 106 00000100:00100000:0.0:1790740252.576446:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+6:2404:x1877727000929792:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1790740252.576554:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+6:2404:x1877727000929792:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 110us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740252.576563:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 106 00000100:00100000:0.0:1790740252.576583:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 107 00000100:00100000:0.0:1790740252.576590:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+5:2404:x1877727000929920:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1790740252.576619:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+5:2404:x1877727000929920:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 30us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740252.576625:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 107 00000100:00080000:0.0:1790740252.576643:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790740252.576647:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790740252.576815:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000929664 00000100:00100000:3.0:1790740252.576821:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000929664 00000100:00100000:3.0:1790740252.576926:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 284 00000100:00100000:3.0:1790740252.576935:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+10:2404:x1877727000929664:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740252.576965:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+10:2404:x1877727000929664:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 33us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740252.576972:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 284 00000100:00100000:1.0:1790740252.778388:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790740252.778402:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790740252.778418:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021972736:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790740252.778418:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021972608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790740252.778799:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740252.779518:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740252.779734:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021972736 00000100:00100000:0.0:1790740252.779747:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021972736 00000100:00100000:0.0:1790740252.779834:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021972608 00000100:00100000:0.0:1790740252.779838:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021972608 00000100:00100000:0.0:1790740252.779872:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790740252.779881:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021972736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790740252.779938:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790740252.780120:0:10118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790740252.780132:0:10118:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83c50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727021972608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790740252.780145:0:10118:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790740252.780210:0:10118:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83c50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727021972608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740252.780227:0:10118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1790740252.780288:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83d6b480 x1877727021972608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740268 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740252.780403:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021972608:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790740252.780649:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790740252.781326:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021972736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1443us (2525us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740252.781335:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1790740252.781449:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83e1ca80 x1877727021972736/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740268 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740252.781466:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021972736:0@lo:13:osp-pre-0-1.0 00000001:02000400:2.0:1790740252.784470:0:11385:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Sep 29 23:50:51 EDT 2026 00010000:00010000:2.0:1790740253.171723:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740254.186175:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740254.314784:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3641:1877727021972992:0@lo:400:kworker.0 00000100:00100000:3.0:1790740254.314880:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740254.314937:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021973504:0@lo:400:kworker.0 00000100:00100000:3.0:1790740254.314985:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740254.315006:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ee9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021974016:0@lo:400:kworker.0 00000100:00100000:3.0:1790740254.315048:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740254.315064:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021974528:0@lo:400:kworker.0 00000100:00100000:3.0:1790740254.315082:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740254.315106:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1790740254.315111:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021972864:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790740254.315131:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740254.315145:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877727021973376:0@lo:400:kworker.0 00000100:00100000:3.0:1790740254.315178:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740254.315195:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021973888:0@lo:400:kworker.0 00000100:00100000:3.0:1790740254.315212:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740254.315225:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021974400:0@lo:400:kworker.0 00000100:00100000:3.0:1790740254.315240:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740254.315263:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727021973120:0@lo:400:kworker.0 00000100:00100000:3.0:1790740254.315283:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740254.315309:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877727021973632:0@lo:400:kworker.0 00000100:00100000:3.0:1790740254.315337:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740254.315352:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1877727021974144:0@lo:400:kworker.0 00000100:00100000:3.0:1790740254.315368:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740254.315384:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1790740254.315388:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021973248:0@lo:400:kworker.0 00000100:00100000:3.0:1790740254.315405:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740254.315419:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83eeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1877727021973760:0@lo:400:kworker.0 00000100:00100000:3.0:1790740254.315447:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740254.315456:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1877727021974272:0@lo:400:kworker.0 00000100:00100000:3.0:1790740254.315471:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740254.315501:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021972992 00000100:00100000:3.0:1790740254.315511:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021972992 00000100:00100000:3.0:1790740254.315568:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1790740254.315577:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3641:x1877727021972992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740254.315631:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3641:x1877727021972992:12345-0@lo:400:kworker.0 Request processed in 55us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740254.315638:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1790740254.315673:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021973504 00000100:00100000:3.0:1790740254.315677:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021973504 00000100:00100000:3.0:1790740254.315698:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021973248 00000100:00100000:3.0:1790740254.315701:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021973248 00000100:00100000:3.0:1790740254.315712:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1790740254.315718:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84461c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021973504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740254.315763:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84461c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021973504:12345-0@lo:400:kworker.0 Request processed in 44us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740254.315769:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1790740254.315786:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1790740254.315791:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84461f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021973248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740254.315820:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84461f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021973248:12345-0@lo:400:kworker.0 Request processed in 29us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740254.315826:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1790740254.315843:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021974016 00000100:00100000:3.0:1790740254.315847:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021974016 00000100:00100000:3.0:1790740254.315876:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021974528 00000100:00100000:3.0:1790740254.315879:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021974528 00000100:00100000:3.0:1790740254.315889:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021973888 00000100:00100000:3.0:1790740254.315892:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021973888 00000100:00100000:3.0:1790740254.315903:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021974400 00000100:00100000:3.0:1790740254.315905:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021974400 00000100:00100000:3.0:1790740254.315917:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790740254.315922:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84462a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021974016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740254.315950:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84462a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021974016:12345-0@lo:400:kworker.0 Request processed in 29us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740254.315956:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790740254.315966:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790740254.315971:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84462300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021974528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740254.315991:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84462300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021974528:12345-0@lo:400:kworker.0 Request processed in 20us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740254.315996:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790740254.316004:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790740254.316009:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021973888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740254.316028:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021973888:12345-0@lo:400:kworker.0 Request processed in 19us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740254.316067:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790740254.316078:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790740254.316083:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84463b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021974400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740254.316107:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84463b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021974400:12345-0@lo:400:kworker.0 Request processed in 24us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740254.316113:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790740254.316134:0:10118:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021972864 00000100:00100000:3.0:1790740254.316137:0:10118:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021972864 00000100:00100000:2.0:1790740254.316270:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021973376 00000100:00100000:2.0:1790740254.316275:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021973376 00000100:00100000:2.0:1790740254.316298:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021973120 00000100:00100000:2.0:1790740254.316300:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021973120 00000100:00100000:2.0:1790740254.316310:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021973632 00000100:00100000:2.0:1790740254.316311:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021973632 00000100:00100000:2.0:1790740254.316323:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021974144 00000100:00100000:2.0:1790740254.316325:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021974144 00000100:00100000:2.0:1790740254.316334:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021973760 00000100:00100000:2.0:1790740254.316336:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021973760 00000100:00100000:2.0:1790740254.316346:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021974272 00000100:00100000:2.0:1790740254.316348:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021974272 00000100:00100000:2.0:1790740254.316359:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1790740254.316365:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84463100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877727021973376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740254.316399:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84463100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877727021973376:12345-0@lo:400:kworker.0 Request processed in 35us (1220us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740254.316405:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1790740254.316415:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1790740254.316420:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84460380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727021973120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740254.316440:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84460380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727021973120:12345-0@lo:400:kworker.0 Request processed in 20us (1156us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740254.316454:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1790740254.316464:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1790740254.316469:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84461180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877727021973632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740254.316492:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84461180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877727021973632:12345-0@lo:400:kworker.0 Request processed in 23us (1154us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740254.316497:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1790740254.316505:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1790740254.316510:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84461500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877727021974144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740254.316532:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84461500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877727021974144:12345-0@lo:400:kworker.0 Request processed in 21us (1162us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740254.316537:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1790740254.316546:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1790740254.316551:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84460e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877727021973760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740254.316571:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84460e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877727021973760:12345-0@lo:400:kworker.0 Request processed in 20us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740254.316576:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1790740254.316584:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1790740254.316589:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84462d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877727021974272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740254.316608:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84462d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877727021974272:12345-0@lo:400:kworker.0 Request processed in 20us (1136us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740254.316614:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1790740254.316693:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877727021973376:0@lo:400:kworker.0 00010000:00080000:2.0:1790740254.316710:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83ee8a80 x1877727021973888/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740254.316747:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021973888:0@lo:400:kworker.0 00010000:00080000:2.0:1790740254.316760:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcaefd9880 x1877727021974400/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740254.316768:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021974400:0@lo:400:kworker.0 00000100:00100000:2.0:1790740254.316777:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3641:1877727021972992:0@lo:400:kworker.0 00000100:00100000:2.0:1790740254.316786:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021973504:0@lo:400:kworker.0 00010000:00080000:2.0:1790740254.316796:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83ee9880 x1877727021974016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740254.316804:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ee9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021974016:0@lo:400:kworker.0 00010000:00080000:2.0:1790740254.316813:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcaefdb800 x1877727021974528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740254.316821:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021974528:0@lo:400:kworker.0 00000100:00100000:2.0:1790740254.316872:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021973248:0@lo:400:kworker.0 00010000:00080000:2.0:1790740254.316882:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83eeb100 x1877727021973760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740254.316889:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83eeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1877727021973760:0@lo:400:kworker.0 00010000:00080000:2.0:1790740254.316897:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcaefd8000 x1877727021974272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740254.316904:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1877727021974272:0@lo:400:kworker.0 00000100:00100000:2.0:1790740254.316913:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727021973120:0@lo:400:kworker.0 00000100:00100000:2.0:1790740254.316937:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877727021973632:0@lo:400:kworker.0 00000100:00100000:2.0:1790740254.316947:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1877727021974144:0@lo:400:kworker.0 00000100:00080000:2.0:1790740254.316979:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790740254.316983:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790740254.316986:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790740254.316989:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790740254.317959:0:10118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790740254.317980:0:10118:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021972864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790740254.318205:0:10118:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790740254.318301:0:10118:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021972864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 330us (3167us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740254.318310:0:10118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1790740254.319659:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83d90a80 x1877727021972864/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740270 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740254.319691:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021972864:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790740254.320977:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790740254.321001:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83c50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021974656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790740254.321105:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740254.321178:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021974656 00000100:00100000:1.0:1790740254.321187:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021974656 00000100:00100000:1.0:1790740254.321243:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790740254.321253:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83c52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727021974656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790740254.321281:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790740254.321331:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83c52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727021974656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740254.321338:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1790740254.321376:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83c50380 x1877727021974656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740270 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740254.321392:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83c50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021974656:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790740255.210917:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740255.341334:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790740255.341369:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021974784:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790740255.341471:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740255.341578:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021974784 00000100:00100000:3.0:1790740255.341589:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021974784 00000100:00100000:3.0:1790740255.341665:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1790740255.341676:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84460a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021974784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790740255.341734:0:6540:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1790740255.341790:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84460a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021974784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740255.341798:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1790740255.341861:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021974784:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1790740256.234895:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740257.258387:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740257.390213:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021974912:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790740257.390323:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740257.391718:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021974912 00000100:00100000:0.0:1790740257.391737:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021974912 00000100:00100000:0.0:1790740257.391847:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1790740257.391859:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83c50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021974912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790740257.391930:0:7846:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1790740257.392092:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83c50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021974912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 235us (1768us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740257.392101:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1790740257.392378:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021974912:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790740257.696453:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740257.696505:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740257.696545:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740257.696661:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000930304 00000100:00100000:1.0:1790740257.696684:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000930304 00000100:00100000:1.0:1790740257.696793:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000930176 00000100:00100000:1.0:1790740257.696797:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000930176 00000100:00100000:1.0:1790740257.696822:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 114 00000100:00100000:1.0:1790740257.696834:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82f98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+5:2404:x1877727000930304:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1790740257.696955:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82f98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+5:2404:x1877727000930304:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 123us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740257.696965:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 114 00000100:00100000:1.0:1790740257.696985:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 115 00000100:00100000:1.0:1790740257.696992:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82f9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+6:2404:x1877727000930176:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1790740257.697020:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82f9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+6:2404:x1877727000930176:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 29us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740257.697027:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 115 00000100:00080000:0.0:1790740257.697237:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790740257.697243:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790740257.697472:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000930048 00000100:00100000:3.0:1790740257.697478:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000930048 00000100:00100000:3.0:1790740257.697526:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 286 00000100:00100000:3.0:1790740257.697534:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+10:2404:x1877727000930048:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740257.697570:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+10:2404:x1877727000930048:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 37us (1134us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740257.697577:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 286 00000100:00100000:2.0:1790740257.898431:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021975040:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790740257.898544:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740257.898738:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021975040 00000100:00100000:3.0:1790740257.898750:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021975040 00000100:00100000:3.0:1790740257.898835:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790740257.898848:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021975040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790740257.898888:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1790740257.899052:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790740257.899144:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021975040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 297us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740257.899154:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1790740257.899270:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db84461880 x1877727021975040/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740273 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740257.899292:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021975040:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790740257.902842:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790740257.902875:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021975168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790740257.902982:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740257.905183:0:10118:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021975168 00000100:00100000:2.0:1790740257.905215:0:10118:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021975168 00000100:00100000:2.0:1790740257.905322:0:10118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790740257.905334:0:10118:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83c51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727021975168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790740257.905372:0:10118:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790740257.905485:0:10118:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83c51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727021975168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 152us (2502us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740257.905493:0:10118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1790740257.905707:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790740257.906098:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcaefd8000 x1877727021975168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740273 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740257.906127:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021975168:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790740258.283250:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740259.311460:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740259.434566:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790740259.434593:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021975296:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790740259.434695:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740259.434784:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021975296 00000100:00100000:2.0:1790740259.434793:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021975296 00000100:00100000:2.0:1790740259.434859:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790740259.434870:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaefd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021975296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790740259.434905:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790740259.434953:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaefd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021975296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740259.434960:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:2.0:1790740259.435004:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcaefdb800 x1877727021975296/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740275 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740259.435025:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021975296:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1790740259.435132:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790740259.435282:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790740259.435293:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021975424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790740259.435320:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740259.435377:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021975424 00000100:00100000:1.0:1790740259.435381:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021975424 00000100:00100000:1.0:1790740259.435434:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790740259.435451:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaefd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021975424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790740259.435464:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790740259.435503:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaefd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021975424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740259.435518:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1790740259.435546:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcaefdb800 x1877727021975424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740275 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740259.435560:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021975424:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1790740259.435836:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790740259.436219:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727021975680:0@lo:400:kworker.0 00000100:00100000:2.0:1790740259.436258:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740259.436278:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877727021976192:0@lo:400:kworker.0 00000100:00100000:2.0:1790740259.436301:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740259.436319:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1877727021976704:0@lo:400:kworker.0 00000100:00100000:2.0:1790740259.436341:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740259.436365:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1790740259.436371:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83eeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021975808:0@lo:400:kworker.0 00000100:00100000:2.0:1790740259.436396:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740259.436439:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1877727021976320:0@lo:400:kworker.0 00000100:00100000:2.0:1790740259.436471:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740259.436489:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1877727021976832:0@lo:400:kworker.0 00000100:00100000:2.0:1790740259.436510:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740259.436531:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021975680 00000100:00100000:2.0:1790740259.436536:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021975680 00000100:00100000:2.0:1790740259.436564:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021976192 00000100:00100000:2.0:1790740259.436567:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021976192 00000100:00100000:2.0:1790740259.436606:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021976704 00000100:00100000:2.0:1790740259.436609:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021976704 00000100:00100000:2.0:1790740259.436622:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021976320 00000100:00100000:2.0:1790740259.436625:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021976320 00000100:00100000:2.0:1790740259.436647:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021976832 00000100:00100000:2.0:1790740259.436651:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021976832 00000100:00100000:2.0:1790740259.436668:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1790740259.436677:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83f12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727021975680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740259.436726:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83f12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727021975680:12345-0@lo:400:kworker.0 Request processed in 49us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740259.436732:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1790740259.436750:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1790740259.436758:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83f12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877727021976192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740259.436785:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83f12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877727021976192:12345-0@lo:400:kworker.0 Request processed in 29us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740259.436791:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1790740259.436801:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1790740259.436806:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83f13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877727021976704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740259.436828:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83f13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877727021976704:12345-0@lo:400:kworker.0 Request processed in 23us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740259.436842:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1790740259.436854:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1790740259.436860:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83f13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877727021976320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740259.436888:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83f13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877727021976320:12345-0@lo:400:kworker.0 Request processed in 28us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740259.436895:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1790740259.436908:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1790740259.436914:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83f11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877727021976832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740259.436942:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83f11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877727021976832:12345-0@lo:400:kworker.0 Request processed in 28us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740259.436948:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1790740259.436970:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021975808 00000100:00100000:2.0:1790740259.436974:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021975808 00000100:00100000:2.0:1790740259.437016:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1790740259.437024:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83f13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021975808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740259.437081:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83f13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021975808:12345-0@lo:400:kworker.0 Request processed in 56us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740259.437087:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:2.0:1790740259.437106:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790740259.437110:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790740259.437129:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83eeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021975808:0@lo:400:kworker.0 00010000:00080000:2.0:1790740259.437140:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83e1ea00 x1877727021976320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740259.437148:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1877727021976320:0@lo:400:kworker.0 00010000:00080000:2.0:1790740259.437158:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83e1ce00 x1877727021976832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740259.437172:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1877727021976832:0@lo:400:kworker.0 00000100:00100000:2.0:1790740259.437182:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727021975680:0@lo:400:kworker.0 00000100:00100000:2.0:1790740259.437190:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877727021976192:0@lo:400:kworker.0 00000100:00100000:2.0:1790740259.437198:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1877727021976704:0@lo:400:kworker.0 00000100:00100000:1.0:1790740259.438695:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ee9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877727021975936:0@lo:400:kworker.0 00000100:00100000:1.0:1790740259.438760:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740259.438790:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021976448:0@lo:400:kworker.0 00000100:00100000:1.0:1790740259.438816:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740259.438876:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1790740259.438883:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727021975552:0@lo:400:kworker.0 00000100:00100000:1.0:1790740259.438918:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740259.438921:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021976448 00000100:00100000:0.0:1790740259.438930:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021976448 00000100:00100000:1.0:1790740259.438945:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021976064:0@lo:400:kworker.0 00000100:00100000:1.0:1790740259.438975:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740259.438989:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790740259.439000:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83c53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021976448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740259.439102:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83c53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021976448:12345-0@lo:400:kworker.0 Request processed in 105us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740259.439110:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790740259.439279:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021976576:0@lo:400:kworker.0 00000100:00100000:1.0:1790740259.439305:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1790740259.439332:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83e1df80 x1877727021976448/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740259.439345:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021976448:0@lo:400:kworker.0 00000100:00100000:1.0:1790740259.439369:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021975552 00000100:00100000:1.0:1790740259.439372:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021975552 00000100:00100000:1.0:1790740259.439402:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1790740259.439409:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3640:x1877727021975552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740259.439530:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3640:x1877727021975552:12345-0@lo:400:kworker.0 Request processed in 120us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740259.439544:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1790740259.439697:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021976576 00000100:00100000:0.0:1790740259.439702:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021976576 00000100:00100000:0.0:1790740259.439730:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790740259.439736:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83c51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021976576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740259.439920:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83c51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021976576:12345-0@lo:400:kworker.0 Request processed in 184us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740259.439927:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790740259.439941:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021976064 00000100:00100000:1.0:1790740259.439948:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021976064 00000100:00100000:1.0:1790740259.439983:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1790740259.439990:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83c53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021976064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740259.440118:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83c53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021976064:12345-0@lo:400:kworker.0 Request processed in 128us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740259.440125:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1790740259.440164:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727021975552:0@lo:400:kworker.0 00000100:00100000:1.0:1790740259.440176:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021976064:0@lo:400:kworker.0 00010000:00080000:1.0:1790740259.440187:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83e1dc00 x1877727021976576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740259.440195:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021976576:0@lo:400:kworker.0 00000100:00080000:2.0:1790740259.440599:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790740259.440614:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021975936 00000100:00100000:2.0:1790740259.440618:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021975936 00000100:00100000:2.0:1790740259.440662:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1790740259.440671:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83c52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877727021975936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740259.440727:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83c52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877727021975936:12345-0@lo:400:kworker.0 Request processed in 58us (1967us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740259.440735:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1790740259.444805:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ee9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877727021975936:0@lo:400:kworker.0 00010000:00010000:0.0:1790740260.332081:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740260.458701:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021976960:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790740260.458794:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740260.459016:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021976960 00000100:00100000:2.0:1790740260.459027:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021976960 00000100:00100000:2.0:1790740260.459582:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1790740260.459594:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84460700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021976960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790740260.459655:0:6541:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790740260.459722:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84460700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021976960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 130us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740260.459732:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1790740260.463354:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021976960:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1790740261.354202:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740262.382145:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740262.507336:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83c51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021977088:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790740262.507409:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740262.508750:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021977088 00000100:00100000:1.0:1790740262.508762:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021977088 00000100:00100000:1.0:1790740262.508822:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1790740262.508832:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021977088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790740262.508868:0:7846:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1790740262.508940:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021977088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (1530us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740262.508947:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1790740262.509080:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83c51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021977088:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790740262.810259:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740262.810307:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740262.810400:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740262.810435:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000930688 00000100:00100000:2.0:1790740262.810444:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000930688 00000100:00100000:2.0:1790740262.810515:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000930560 00000100:00100000:2.0:1790740262.810518:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000930560 00000100:00100000:2.0:1790740262.810545:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 122 00000100:00100000:2.0:1790740262.810554:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+5:2403:x1877727000930688:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1790740262.810644:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+5:2403:x1877727000930688:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 91us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740262.810652:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 122 00000100:00100000:2.0:1790740262.810669:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 123 00000100:00100000:2.0:1790740262.810687:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+6:2403:x1877727000930560:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1790740262.810714:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+6:2403:x1877727000930560:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 39us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740262.810720:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 123 00000100:00080000:2.0:1790740262.810737:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790740262.810740:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790740262.811002:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000930432 00000100:00100000:3.0:1790740262.811008:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000930432 00000100:00100000:3.0:1790740262.811067:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 288 00000100:00100000:3.0:1790740262.811075:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+10:2403:x1877727000930432:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740262.811117:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+10:2403:x1877727000930432:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 43us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740262.811124:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 288 00000100:00100000:1.0:1790740263.019427:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021977216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790740263.019507:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740263.022775:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790740263.022799:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021977344:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790740263.022869:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740263.023158:0:10118:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021977216 00000100:00100000:2.0:1790740263.023167:0:10118:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021977216 00000100:00100000:2.0:1790740263.023219:0:10118:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021977344 00000100:00100000:2.0:1790740263.023222:0:10118:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021977344 00000100:00100000:2.0:1790740263.023240:0:10118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790740263.023248:0:10118:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83c53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021977216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790740263.023293:0:10118:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790740263.023336:0:10118:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83c53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021977216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (3828us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740263.023343:0:10118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790740263.023368:0:10118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790740263.023374:0:10118:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83c51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021977344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790740263.023384:0:10118:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790740263.023408:0:10118:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83c51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021977344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 34us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740263.023414:0:10118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1790740263.023431:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790740263.034089:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db82f9b480 x1877727021977344/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740279 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740263.034116:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021977344:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1790740263.034131:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83e1ce00 x1877727021977216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740279 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740263.034141:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021977216:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790740263.405601:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740264.430545:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740264.554316:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021977472:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790740264.554392:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740264.554469:0:10118:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021977472 00000100:00100000:2.0:1790740264.554476:0:10118:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021977472 00000100:00100000:2.0:1790740264.554529:0:10118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790740264.554556:0:10118:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021977472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790740264.554585:0:10118:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790740264.554632:0:10118:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021977472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740264.554640:0:10118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1790740264.554662:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1790740264.554695:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83e1ea00 x1877727021977472/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740280 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740264.554728:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021977472:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790740264.555669:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790740264.555682:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021977600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790740264.555734:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740264.555771:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021977600 00000100:00100000:2.0:1790740264.555776:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021977600 00000100:00100000:2.0:1790740264.555832:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790740264.555840:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021977600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790740264.555856:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790740264.555894:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021977600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740264.555901:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:2.0:1790740264.555920:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1790740264.555944:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83e1ea00 x1877727021977600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740280 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740264.555972:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021977600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790740264.556351:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ce1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877727021978112:0@lo:400:kworker.0 00000100:00100000:0.0:1790740264.556381:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740264.556400:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98534e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021978624:0@lo:400:kworker.0 00000100:00100000:0.0:1790740264.556420:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740264.556449:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1790740264.556454:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ce0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021977984:0@lo:400:kworker.0 00000100:00100000:0.0:1790740264.556479:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740264.556498:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98534380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1877727021978496:0@lo:400:kworker.0 00000100:00100000:0.0:1790740264.556544:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740264.556563:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb8139f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1877727021979008:0@lo:400:kworker.0 00000100:00100000:0.0:1790740264.556584:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740264.556610:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021978624 00000100:00100000:0.0:1790740264.556614:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021978624 00000100:00100000:0.0:1790740264.556654:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790740264.556660:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5f6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021978624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740264.556699:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5f6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021978624:12345-0@lo:400:kworker.0 Request processed in 39us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740264.556706:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790740264.556739:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021977984 00000100:00100000:0.0:1790740264.556744:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021977984 00000100:00100000:0.0:1790740264.556768:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1790740264.556774:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5f6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021977984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740264.556804:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5f6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021977984:12345-0@lo:400:kworker.0 Request processed in 30us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740264.556810:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1790740264.556826:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021978112 00000100:00100000:0.0:1790740264.556829:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021978112 00000100:00100000:0.0:1790740264.556850:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021978496 00000100:00100000:0.0:1790740264.556853:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021978496 00000100:00100000:0.0:1790740264.556872:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021979008 00000100:00100000:0.0:1790740264.556875:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021979008 00000100:00100000:0.0:1790740264.556889:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1790740264.556894:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb8138a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877727021978112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740264.556924:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb8138a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877727021978112:12345-0@lo:400:kworker.0 Request processed in 28us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740264.556930:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1790740264.556940:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1790740264.556946:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1877727021978496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740264.556970:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1877727021978496:12345-0@lo:400:kworker.0 Request processed in 25us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740264.556985:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1790740264.556997:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1790740264.557001:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5f6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1877727021979008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740264.557026:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5f6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1877727021979008:12345-0@lo:400:kworker.0 Request processed in 25us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740264.557063:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:0.0:1790740264.557088:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790740264.557108:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ce0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021977984:0@lo:400:kworker.0 00010000:00080000:0.0:1790740264.557118:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dc98534380 x1877727021978496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740264.557127:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98534380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1877727021978496:0@lo:400:kworker.0 00010000:00080000:0.0:1790740264.557135:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcb8139f80 x1877727021979008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740264.557142:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb8139f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1877727021979008:0@lo:400:kworker.0 00000100:00100000:0.0:1790740264.557150:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ce1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877727021978112:0@lo:400:kworker.0 00010000:00080000:0.0:1790740264.557157:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dc98534e00 x1877727021978624/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740264.557165:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98534e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021978624:0@lo:400:kworker.0 00000100:00100000:2.0:1790740264.559459:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727021977728:0@lo:400:kworker.0 00000100:00100000:2.0:1790740264.559611:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740264.559667:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb81b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021978240:0@lo:400:kworker.0 00000100:00100000:2.0:1790740264.559697:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740264.559733:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb8139180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021978752:0@lo:400:kworker.0 00000100:00100000:2.0:1790740264.559760:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740264.559790:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1790740264.559809:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ce0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727021977856:0@lo:400:kworker.0 00000100:00100000:2.0:1790740264.559835:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740264.559855:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb81b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877727021978368:0@lo:400:kworker.0 00000100:00100000:2.0:1790740264.559874:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740264.559891:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb8138380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1877727021978880:0@lo:400:kworker.0 00000100:00100000:2.0:1790740264.559912:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740264.559947:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021977856 00000100:00100000:2.0:1790740264.559954:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021977856 00000100:00100000:2.0:1790740264.560020:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021978368 00000100:00100000:2.0:1790740264.560023:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021978368 00000100:00100000:2.0:1790740264.560292:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021978880 00000100:00100000:2.0:1790740264.560296:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021978880 00000100:00100000:2.0:1790740264.560312:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1790740264.560319:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727021977856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740264.560377:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727021977856:12345-0@lo:400:kworker.0 Request processed in 57us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740264.560384:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1790740264.560399:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1790740264.560404:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877727021978368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740264.560428:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877727021978368:12345-0@lo:400:kworker.0 Request processed in 24us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740264.560433:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1790740264.560443:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1790740264.560448:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877727021978880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740264.560469:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877727021978880:12345-0@lo:400:kworker.0 Request processed in 22us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740264.560475:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1790740264.560491:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021978752 00000100:00100000:2.0:1790740264.560494:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021978752 00000100:00100000:2.0:1790740264.560849:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790740264.560862:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ee9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021978752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740264.560902:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ee9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021978752:12345-0@lo:400:kworker.0 Request processed in 43us (1140us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740264.560908:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1790740264.560937:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790740264.560995:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ce0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727021977856:0@lo:400:kworker.0 00000100:00100000:2.0:1790740264.561007:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb81b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877727021978368:0@lo:400:kworker.0 00000100:00100000:2.0:1790740264.561015:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb8138380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1877727021978880:0@lo:400:kworker.0 00010000:00080000:2.0:1790740264.561027:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcb8139180 x1877727021978752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740264.561156:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021977728 00000100:00100000:1.0:1790740264.561161:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021977728 00000100:00100000:1.0:1790740264.561194:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1790740264.561213:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3638:x1877727021977728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740264.561249:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3638:x1877727021977728:12345-0@lo:400:kworker.0 Request processed in 48us (1639us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740264.561255:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1790740264.561476:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb8139180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021978752:0@lo:400:kworker.0 00000100:00100000:2.0:1790740264.561512:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727021977728:0@lo:400:kworker.0 00000100:00100000:0.0:1790740264.561593:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021978240 00000100:00100000:0.0:1790740264.561598:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021978240 00000100:00100000:0.0:1790740264.561636:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1790740264.561643:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021978240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740264.561692:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021978240:12345-0@lo:400:kworker.0 Request processed in 49us (1994us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740264.561704:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1790740264.562219:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb81b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021978240:0@lo:400:kworker.0 00010000:00010000:1.0:1790740265.450335:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740265.580023:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021979136:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790740265.583955:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740265.584197:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021979136 00000100:00100000:1.0:1790740265.584206:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021979136 00000100:00100000:1.0:1790740265.584255:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1790740265.584265:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021979136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790740265.584305:0:7846:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790740265.584361:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021979136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740265.584378:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1790740265.586577:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021979136:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1790740266.474298:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740267.498339:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740267.627825:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790740267.631422:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727021979264:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790740267.631526:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740267.634361:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021979264 00000100:00100000:1.0:1790740267.634376:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021979264 00000100:00100000:1.0:1790740267.634456:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1790740267.634465:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727021979264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790740267.634517:0:6541:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1790740267.635368:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727021979264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 901us (3839us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740267.635380:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1790740267.637023:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727021979264:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790740267.929074:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740267.929152:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740267.929170:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000930944 00000100:00100000:0.0:1790740267.929181:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000930944 00000100:00100000:2.0:1790740267.929194:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00080000:2.0:1790740267.929233:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790740267.929257:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000931072 00000100:00100000:2.0:1790740267.929262:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000931072 00000100:00100000:0.0:1790740267.929267:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 130 00000100:00100000:0.0:1790740267.929281:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82f9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+6:2403:x1877727000930944:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1790740267.929304:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 131 00000100:00100000:2.0:1790740267.929313:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb81b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+5:2403:x1877727000931072:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1790740267.929371:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82f9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+6:2403:x1877727000930944:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 94us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740267.929381:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 130 00000100:00080000:3.0:1790740267.929406:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790740267.929936:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb81b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+5:2403:x1877727000931072:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 622us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740267.929945:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 131 00000100:00100000:1.0:1790740267.930065:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000930816 00000100:00100000:1.0:1790740267.930071:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000930816 00000100:00100000:1.0:1790740267.930123:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 290 00000100:00100000:1.0:1790740267.930130:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+10:2403:x1877727000930816:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1790740267.930163:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+10:2403:x1877727000930816:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 33us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740267.930170:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 290 00000100:00100000:1.0:1790740268.138791:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790740268.138825:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021979392:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790740268.138903:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740268.138969:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021979392 00000100:00100000:1.0:1790740268.138976:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021979392 00000100:00080000:3.0:1790740268.139084:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790740268.139226:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb81b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021979520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790740268.139262:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740268.139340:0:10118:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021979520 00000100:00100000:2.0:1790740268.139346:0:10118:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021979520 00000100:00100000:2.0:1790740268.139387:0:10118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790740268.139398:0:10118:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021979392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790740268.139428:0:10118:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790740268.139504:0:10118:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021979392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740268.139512:0:10118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790740268.139543:0:10118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790740268.139551:0:10118:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021979520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790740268.139561:0:10118:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790740268.139590:0:10118:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021979520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740268.139596:0:10118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1790740268.139641:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790740268.139669:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcb81b5f80 x1877727021979520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740284 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740268.139688:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb81b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021979520:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1790740268.139884:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcaefdb800 x1877727021979392/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740284 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740268.139898:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021979392:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1790740268.526583:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790740268.730432:0:12017:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 23:51:07 (1790740267) === 00000100:00100000:0.0:1790740269.213293:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740269.213400:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000931200 00000100:00100000:1.0:1790740269.213410:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000931200 00000100:00100000:1.0:1790740269.213483:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 291 00000100:00100000:1.0:1790740269.213494:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+10:8733:x1877727000931200:12345-192.168.204.3@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790740269.213512:0:6529:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740269.213530:0:6529:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcc2174a00/0xb25dda4f4e92dc14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23b7a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740269.213559:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcc2174a00/0xb25dda4f4e92dc14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23b7a expref: 11 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740269.213570:0:6529:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcc2174a00/0xb25dda4f4e92dc14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23b7a expref: 11 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740269.213579:0:6529:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcc2174a00, rc 0) 00000100:00100000:1.0:1790740269.213641:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+11:8733:x1877727000931200:12345-192.168.204.3@tcp:101:mount.lustre.0 Request processed in 149us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740269.213648:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 291 00000100:00100000:0.0:1790740269.225957:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740269.226106:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000931328 00000100:00100000:3.0:1790740269.226117:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000931328 00000100:00100000:3.0:1790740269.226184:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 292 00000100:00100000:3.0:1790740269.226194:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+11:8733:x1877727000931328:12345-192.168.204.3@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790740269.226709:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+11:8733:x1877727000931328:12345-192.168.204.3@tcp:501:mount.lustre.0 Request processed in 515us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740269.226737:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 292 00000100:00100000:3.0:1790740269.228705:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740269.232954:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000931456 00000100:00100000:2.0:1790740269.232971:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000931456 00000100:00100000:2.0:1790740269.233117:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 293 00000100:00100000:2.0:1790740269.233127:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+11:8733:x1877727000931456:12345-192.168.204.3@tcp:503:mount.lustre.0 00000100:00100000:2.0:1790740269.233459:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+11:8733:x1877727000931456:12345-192.168.204.3@tcp:503:mount.lustre.0 Request processed in 332us (4762us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740269.233468:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 293 00000100:00100000:0.0:1790740269.239289:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740269.239726:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000931584 00000100:00100000:3.0:1790740269.239736:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000931584 00000100:00100000:3.0:1790740269.239790:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 294 00000100:00100000:3.0:1790740269.239800:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+11:8737:x1877727000931584:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790740269.239992:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+11:8737:x1877727000931584:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 193us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740269.240001:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 294 00000100:00100000:0.0:1790740269.267621:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740269.267749:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000931712 00000100:00100000:2.0:1790740269.267759:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000931712 00000100:00100000:2.0:1790740269.267934:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 295 00000100:00100000:2.0:1790740269.267946:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+11:8737:x1877727000931712:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790740269.268348:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+11:8737:x1877727000931712:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 403us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740269.268357:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 295 00000100:00100000:2.0:1790740269.274596:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740269.275263:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000931840 00000100:00100000:1.0:1790740269.275459:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000931840 00000100:00100000:1.0:1790740269.275527:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 296 00000100:00100000:1.0:1790740269.275537:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+11:8737:x1877727000931840:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790740269.275713:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+11:8737:x1877727000931840:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 176us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740269.275721:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 296 00000100:00100000:0.0:1790740269.280336:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740269.280624:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000931968 00000100:00100000:2.0:1790740269.280656:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000931968 00000100:00100000:2.0:1790740269.280727:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 297 00000100:00100000:2.0:1790740269.280739:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+11:8733:x1877727000931968:12345-192.168.204.3@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790740269.280757:0:6530:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740269.280776:0:6530:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dc81488000/0xb25dda4f4e92dc1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23bab expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740269.280804:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dc81488000/0xb25dda4f4e92dc1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23bab expref: 12 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740269.280815:0:6530:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dc81488000/0xb25dda4f4e92dc1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23bab expref: 12 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740269.280825:0:6530:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dc81488000, rc 0) 00000100:00100000:2.0:1790740269.280903:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+12:8733:x1877727000931968:12345-192.168.204.3@tcp:101:mount.lustre.0 Request processed in 164us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740269.280913:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 297 00000100:00100000:0.0:1790740269.288846:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740269.288954:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000932096 00000100:00100000:3.0:1790740269.288967:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000932096 00000100:00100000:3.0:1790740269.289150:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 298 00000100:00100000:3.0:1790740269.289164:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+12:8733:x1877727000932096:12345-192.168.204.3@tcp:256:mount.lustre.0 20000000:01000000:3.0:1790740269.289198:0:6528:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1790740269.289232:0:6528:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1790740269.289236:0:6528:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1790740269.289239:0:6528:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1790740269.289242:0:6528:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1790740269.289244:0:6528:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1790740269.291395:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+12:8733:x1877727000932096:12345-192.168.204.3@tcp:256:mount.lustre.0 Request processed in 2223us (2553us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740269.291427:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 298 00000100:00100000:0.0:1790740269.295273:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740269.295676:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000932224 00000100:00100000:1.0:1790740269.295686:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000932224 00000100:00100000:1.0:1790740269.295803:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 299 00000100:00100000:1.0:1790740269.295815:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+12:8733:x1877727000932224:12345-192.168.204.3@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790740269.295834:0:6529:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740269.295854:0:6529:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcc2174600/0xb25dda4f4e92dc22 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23bb2 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740269.295885:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcc2174600/0xb25dda4f4e92dc22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23bb2 expref: 13 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740269.295897:0:6529:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcc2174600/0xb25dda4f4e92dc22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23bb2 expref: 13 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740269.295907:0:6529:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcc2174600, rc 0) 00000100:00100000:1.0:1790740269.295976:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:8733:x1877727000932224:12345-192.168.204.3@tcp:101:mount.lustre.0 Request processed in 163us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740269.295984:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 299 00000100:00100000:0.0:1790740269.299853:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740269.303651:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000932352 00000100:00100000:1.0:1790740269.303668:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000932352 00000100:00100000:1.0:1790740269.303745:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 300 00000100:00100000:1.0:1790740269.303756:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:8733:x1877727000932352:12345-192.168.204.3@tcp:501:mount.lustre.0 00000100:00100000:1.0:1790740269.303948:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:8733:x1877727000932352:12345-192.168.204.3@tcp:501:mount.lustre.0 Request processed in 194us (4104us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740269.303957:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 300 00000100:00100000:3.0:1790740269.315275:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740269.315396:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000932480 00000100:00100000:1.0:1790740269.315407:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000932480 00000100:00100000:1.0:1790740269.315482:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 301 00000100:00100000:1.0:1790740269.315493:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:8733:x1877727000932480:12345-192.168.204.3@tcp:503:mount.lustre.0 00000100:00100000:1.0:1790740269.315832:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:8733:x1877727000932480:12345-192.168.204.3@tcp:503:mount.lustre.0 Request processed in 340us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740269.315850:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 301 00000100:00100000:0.0:1790740269.329338:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740269.329518:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000932608 00000100:00100000:2.0:1790740269.329535:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000932608 00000100:00100000:2.0:1790740269.329619:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 302 00000100:00100000:2.0:1790740269.329630:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:8742:x1877727000932608:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790740269.329815:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:8742:x1877727000932608:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 187us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740269.329825:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 302 00000100:00100000:0.0:1790740269.334083:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740269.334238:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000932736 00000100:00100000:1.0:1790740269.334251:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000932736 00000100:00100000:1.0:1790740269.334334:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 303 00000100:00100000:1.0:1790740269.334364:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:8742:x1877727000932736:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790740269.334600:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:8742:x1877727000932736:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 246us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740269.334609:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 303 00000100:00100000:0.0:1790740269.342154:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740269.342203:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740269.342304:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740269.347053:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000932864 00000100:00100000:3.0:1790740269.347079:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000932864 00000100:00100000:3.0:1790740269.347168:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000932992 00000100:00100000:3.0:1790740269.347173:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000932992 00000100:00100000:1.0:1790740269.347222:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 16 00000100:00100000:3.0:1790740269.347258:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 132 00000100:00100000:3.0:1790740269.347270:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb8139180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+6:2405:x1877727000932992:12345-192.168.204.3@tcp:400:kworker.0 00000100:00080000:2.0:1790740269.347453:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790740269.347623:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5f6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1877727000932864:12345-192.168.204.3@tcp:38:mount.lustre.0 00010000:00080000:1.0:1790740269.347657:0:6535:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 4188ca3f-be2e-4a39-97db-9401a3b70751@192.168.204.3@tcp t0 exp 0000000000000000 cur 340 last 0 00000020:00000080:1.0:1790740269.347710:0:6535:0:(genops.c:1384:class_connect()) connect: client 4188ca3f-be2e-4a39-97db-9401a3b70751, cookie 0xb25dda4f4e92dc29 00000004:00100000:1.0:1790740269.347746:0:6535:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1790740269.347937:0:6535:0:(import.c:65:import_set_state_nolock()) ffff98dcb6c72000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790740269.348008:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5f6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188ca3f-be2e-4a39-97db-9401a3b70751+6:2401:x1877727000932864:12345-192.168.204.3@tcp:38:mount.lustre.0 Request processed in 388us (5869us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740269.348018:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 16 00000100:00100000:2.0:1790740269.348725:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb8139180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+6:2405:x1877727000932992:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 1454us (6517us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740269.348750:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 132 00000100:00100000:2.0:1790740269.357903:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000933120 00000100:00100000:2.0:1790740269.357925:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000933120 00000100:00100000:2.0:1790740269.358084:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 133 00000100:00100000:2.0:1790740269.358098:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb8138380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+5:2405:x1877727000933120:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1790740269.358234:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb8138380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+5:2405:x1877727000933120:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 139us (15927us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740269.358243:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 133 00000100:00080000:3.0:1790740269.358397:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790740269.358683:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740269.358753:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740269.358796:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740269.358928:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000933376 00000100:00100000:3.0:1790740269.358935:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000933376 00000100:00100000:3.0:1790740269.358974:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000933632 00000100:00100000:3.0:1790740269.358977:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000933632 00000100:00100000:3.0:1790740269.359008:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000933248 00000100:00100000:3.0:1790740269.359011:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000933248 00000100:00100000:3.0:1790740269.359065:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 17 00000100:00100000:3.0:1790740269.359072:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb81b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1877727000933376:12345-192.168.204.3@tcp:38:mount.lustre.0 00010000:00080000:3.0:1790740269.359109:0:7760:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 4188ca3f-be2e-4a39-97db-9401a3b70751@192.168.204.3@tcp t0 exp 0000000000000000 cur 340 last 0 00000020:00000080:3.0:1790740269.359155:0:7760:0:(genops.c:1384:class_connect()) connect: client 4188ca3f-be2e-4a39-97db-9401a3b70751, cookie 0xb25dda4f4e92dc30 00000004:00100000:3.0:1790740269.359190:0:7760:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1790740269.359338:0:7760:0:(import.c:65:import_set_state_nolock()) ffff98db83e38800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790740269.359547:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb81b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4188ca3f-be2e-4a39-97db-9401a3b70751+6:2401:x1877727000933376:12345-192.168.204.3@tcp:38:mount.lustre.0 Request processed in 473us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740269.359556:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 17 00000100:00100000:3.0:1790740269.359577:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 18 00000100:00100000:3.0:1790740269.359585:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc81327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4188ca3f-be2e-4a39-97db-9401a3b70751+7:8733:x1877727000933632:12345-192.168.204.3@tcp:41:mount.lustre.0 00000004:00000024:3.0:1790740269.359619:0:7760:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1790740269.359679:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc81327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4188ca3f-be2e-4a39-97db-9401a3b70751+7:8733:x1877727000933632:12345-192.168.204.3@tcp:41:mount.lustre.0 Request processed in 96us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740269.359685:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 18 00000100:00100000:3.0:1790740269.359698:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 19 00000100:00100000:3.0:1790740269.359706:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc81327800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4188ca3f-be2e-4a39-97db-9401a3b70751+6:0:x1877727000933248:12345-192.168.204.3@tcp:41:mount.lustre.0 00000004:00000024:3.0:1790740269.359717:0:7760:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1790740269.359751:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc81327800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4188ca3f-be2e-4a39-97db-9401a3b70751+6:0:x1877727000933248:12345-192.168.204.3@tcp:41:mount.lustre.0 Request processed in 47us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740269.359757:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 19 00000100:00080000:3.0:1790740269.359777:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790740269.365645:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740269.365753:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000933760 00000100:00100000:3.0:1790740269.365766:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000933760 00000100:00100000:3.0:1790740269.365857:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 20 00000100:00100000:3.0:1790740269.365868:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaefdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4188ca3f-be2e-4a39-97db-9401a3b70751+6:8733:x1877727000933760:12345-192.168.204.3@tcp:40:mount.lustre.0 00000100:00100000:3.0:1790740269.366002:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaefdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4188ca3f-be2e-4a39-97db-9401a3b70751+6:8733:x1877727000933760:12345-192.168.204.3@tcp:40:mount.lustre.0 Request processed in 135us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740269.366011:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 20 00000100:00100000:3.0:1790740269.374288:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740269.374498:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000933504 00000100:00100000:0.0:1790740269.374512:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000933504 00000100:00100000:2.0:1790740269.374670:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 21 00000100:00100000:2.0:1790740269.374687:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4188ca3f-be2e-4a39-97db-9401a3b70751+6:0:x1877727000933504:12345-192.168.204.3@tcp:41:mount.lustre.0 00000004:00000024:2.0:1790740269.374740:0:6537:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00080000:3.0:1790740269.374814:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790740269.374880:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4188ca3f-be2e-4a39-97db-9401a3b70751+6:0:x1877727000933504:12345-192.168.204.3@tcp:41:mount.lustre.0 Request processed in 198us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740269.374888:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 21 00000100:00100000:0.0:1790740269.382193:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740269.382245:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740269.382303:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740269.382589:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000933888 00000100:00100000:3.0:1790740269.382602:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000933888 00000100:00100000:3.0:1790740269.382656:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000934016 00000100:00100000:3.0:1790740269.382660:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000934016 00000100:00100000:3.0:1790740269.382686:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 20 00000100:00100000:3.0:1790740269.382696:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc98534e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2401:x1877727000933888:12345-192.168.204.3@tcp:8:mount.lustre.0 00010000:00080000:3.0:1790740269.382743:0:8453:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 4188ca3f-be2e-4a39-97db-9401a3b70751@192.168.204.3@tcp t0 exp 0000000000000000 cur 340 last 0 00000020:00000080:3.0:1790740269.382784:0:8453:0:(genops.c:1384:class_connect()) connect: client 4188ca3f-be2e-4a39-97db-9401a3b70751, cookie 0xb25dda4f4e92dc37 00002000:00100000:3.0:1790740269.382800:0:8453:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4188ca3f-be2e-4a39-97db-9401a3b70751/ffff98db83e38000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790740269.382815:0:8453:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790740269.382934:0:8453:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1790740269.382976:0:8453:0:(import.c:65:import_set_state_nolock()) ffff98db83e3a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790740269.383091:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc98534e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4188ca3f-be2e-4a39-97db-9401a3b70751+6:2401:x1877727000933888:12345-192.168.204.3@tcp:8:mount.lustre.0 Request processed in 394us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740269.383269:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 21 00000100:00100000:0.0:1790740269.383276:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc98534380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2401:x1877727000934016:12345-192.168.204.3@tcp:8:mount.lustre.0 00010000:00080000:0.0:1790740269.383298:0:8451:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 4188ca3f-be2e-4a39-97db-9401a3b70751@192.168.204.3@tcp t0 exp 0000000000000000 cur 340 last 0 00000020:00000080:0.0:1790740269.383320:0:8451:0:(genops.c:1384:class_connect()) connect: client 4188ca3f-be2e-4a39-97db-9401a3b70751, cookie 0xb25dda4f4e92dc3e 00002000:00100000:0.0:1790740269.383327:0:8451:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4188ca3f-be2e-4a39-97db-9401a3b70751/ffff98dcbfc4d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790740269.383342:0:8451:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790740269.383405:0:8451:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1790740269.383421:0:8451:0:(import.c:65:import_set_state_nolock()) ffff98dcbfc49000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790740269.383458:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc98534380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4188ca3f-be2e-4a39-97db-9401a3b70751+6:2401:x1877727000934016:12345-192.168.204.3@tcp:8:mount.lustre.0 Request processed in 181us (1155us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740269.383466:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 21 00000100:00100000:3.0:1790740269.383585:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 20 00000100:00100000:1.0:1790740269.383759:0:6547:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000934144 00000100:00100000:1.0:1790740269.383775:0:6547:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000934144 00000100:00100000:1.0:1790740269.383829:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 5 00000100:00100000:1.0:1790740269.383836:0:6547:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb8139f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4188ca3f-be2e-4a39-97db-9401a3b70751+6:8733:x1877727000934144:12345-192.168.204.3@tcp:900:mount.lustre.0 00000100:00100000:1.0:1790740269.383890:0:6547:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb8139f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4188ca3f-be2e-4a39-97db-9401a3b70751+6:8733:x1877727000934144:12345-192.168.204.3@tcp:900:mount.lustre.0 Request processed in 55us (1713us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740269.383898:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 5 00000100:00100000:1.0:1790740269.386187:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740269.386300:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000934272 00000100:00100000:2.0:1790740269.386312:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000934272 00000100:00100000:2.0:1790740269.386469:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 1 00000100:00100000:2.0:1790740269.386483:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4188ca3f-be2e-4a39-97db-9401a3b70751+6:8733:x1877727000934272:12345-192.168.204.3@tcp:33:mount.lustre.0 00000004:00200000:2.0:1790740269.386804:0:6538:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1790740269.386975:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4188ca3f-be2e-4a39-97db-9401a3b70751+6:8733:x1877727000934272:12345-192.168.204.3@tcp:33:mount.lustre.0 Request processed in 494us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740269.386984:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 1 00010000:00010000:0.0:1790740269.546355:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740269.674296:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877727021980160:0@lo:400:kworker.0 00000100:00100000:0.0:1790740269.674329:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ce0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727021980032:0@lo:400:kworker.0 00000100:00100000:1.0:1790740269.674424:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc81327b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021979648:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790740269.674498:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ce1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727021979904:0@lo:400:kworker.0 00000100:00100000:0.0:1790740269.681890:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740269.682004:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1877727021980544:0@lo:400:kworker.0 00000100:00100000:0.0:1790740269.682067:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740269.682106:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1877727021981056:0@lo:400:kworker.0 00000100:00100000:0.0:1790740269.682129:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740269.682223:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021980032 00000100:00100000:0.0:1790740269.682235:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021980032 00000100:00100000:0.0:1790740269.682298:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1790740269.682308:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc82f1d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727021980032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740269.685199:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc82f1d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727021980032:12345-0@lo:400:kworker.0 Request processed in 2878us (3307us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740269.685219:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1790740269.685683:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ce0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727021980032:0@lo:400:kworker.0 00000100:00100000:0.0:1790740269.685755:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021980544 00000100:00100000:0.0:1790740269.685765:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021980544 00000100:00100000:0.0:1790740269.685831:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021981056 00000100:00100000:0.0:1790740269.685835:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021981056 00000100:00100000:0.0:1790740269.685860:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1790740269.685870:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877727021980544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740269.685932:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877727021980544:12345-0@lo:400:kworker.0 Request processed in 63us (3863us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740269.685961:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740269.686020:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021980672:0@lo:400:kworker.0 00000100:00100000:2.0:1790740269.686072:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740269.686100:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021980672 00000100:00100000:2.0:1790740269.686104:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021980672 00000100:00100000:2.0:1790740269.686137:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790740269.686144:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc81325180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021980672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740269.686177:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc81325180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021980672:12345-0@lo:400:kworker.0 Request processed in 34us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740269.686183:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1790740269.686223:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83cc4000 x1877727021980672/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740269.686235:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021980672:0@lo:400:kworker.0 00000100:00100000:2.0:1790740269.686243:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021981184:0@lo:400:kworker.0 00000100:00100000:2.0:1790740269.686267:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740269.686291:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021981184 00000100:00100000:2.0:1790740269.686296:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021981184 00000100:00100000:2.0:1790740269.686323:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790740269.686329:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc81325500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021981184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740269.686360:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc81325500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021981184:12345-0@lo:400:kworker.0 Request processed in 31us (92us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740269.686366:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:2.0:1790740269.686392:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83cc4380 x1877727021981184/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740269.686419:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021981184:0@lo:400:kworker.0 00000100:00100000:2.0:1790740269.686461:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021980160 00000100:00100000:2.0:1790740269.686465:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021980160 00000100:00100000:2.0:1790740269.686487:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1790740269.686494:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1877727021981056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740269.686531:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1877727021981056:12345-0@lo:400:kworker.0 Request processed in 37us (4401us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740269.686538:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1790740269.686552:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1790740269.686559:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc81324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877727021980160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740269.686610:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc81324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877727021980160:12345-0@lo:400:kworker.0 Request processed in 50us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740269.686617:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1790740269.686638:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1790740269.686644:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877727021980160:0@lo:400:kworker.0 00000100:00080000:0.0:1790740269.686657:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790740269.686663:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1790740269.686692:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83cc7100 x1877727021980544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740269.686702:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1877727021980544:0@lo:400:kworker.0 00010000:00080000:0.0:1790740269.686714:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83cc6a00 x1877727021981056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740269.686723:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1877727021981056:0@lo:400:kworker.0 00000100:00100000:1.0:1790740269.687559:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740269.687669:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ce0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3641:1877727021979776:0@lo:400:kworker.0 00000100:00100000:1.0:1790740269.687724:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740269.687751:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021980288:0@lo:400:kworker.0 00000100:00100000:1.0:1790740269.687779:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740269.687807:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021980288 00000100:00100000:1.0:1790740269.687814:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021980288 00000100:00100000:1.0:1790740269.687856:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1790740269.687865:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021980288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740269.687915:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021980288:12345-0@lo:400:kworker.0 Request processed in 51us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740269.687923:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1790740269.687952:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021979776 00000100:00100000:1.0:1790740269.687956:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021979776 00000100:00100000:1.0:1790740269.687982:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1790740269.687988:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3641:x1877727021979776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740269.688058:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3641:x1877727021979776:12345-0@lo:400:kworker.0 Request processed in 68us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740269.688084:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1790740269.688138:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021980288:0@lo:400:kworker.0 00000100:00100000:1.0:1790740269.688147:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021980800:0@lo:400:kworker.0 00000100:00100000:1.0:1790740269.688174:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740269.688211:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021980800 00000100:00100000:1.0:1790740269.688216:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021980800 00000100:00100000:1.0:1790740269.688245:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790740269.688252:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021980800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740269.688285:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021980800:12345-0@lo:400:kworker.0 Request processed in 34us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740269.688291:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1790740269.688318:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83cc6d80 x1877727021980800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740269.688330:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021980800:0@lo:400:kworker.0 00000100:00100000:1.0:1790740269.688337:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021981312:0@lo:400:kworker.0 00000100:00100000:1.0:1790740269.688372:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740269.688393:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021981312 00000100:00100000:1.0:1790740269.688396:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021981312 00000100:00100000:1.0:1790740269.688431:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790740269.688448:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021981312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740269.688479:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021981312:12345-0@lo:400:kworker.0 Request processed in 43us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740269.688485:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1790740269.688504:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1790740269.688529:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83cc4e00 x1877727021981312/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740269.688540:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021981312:0@lo:400:kworker.0 00000100:00100000:1.0:1790740269.688566:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ce0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3641:1877727021979776:0@lo:400:kworker.0 00000100:00100000:0.0:1790740269.688979:0:10118:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021979648 00000100:00100000:0.0:1790740269.688986:0:10118:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021979648 00000100:00100000:0.0:1790740269.689053:0:10118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790740269.689062:0:10118:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021979648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790740269.689081:0:10118:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790740269.689141:0:10118:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021979648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (1587us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740269.689147:0:10118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:1.0:1790740269.689327:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dc81327b80 x1877727021979648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740285 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740269.689345:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc81327b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021979648:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790740269.693642:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740269.693721:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877727021980416:0@lo:400:kworker.0 00000100:00100000:3.0:1790740269.693759:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740269.693802:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1877727021980928:0@lo:400:kworker.0 00000100:00100000:3.0:1790740269.693825:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740269.693855:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021981440:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790740269.693883:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740269.694077:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021979904 00000100:00100000:2.0:1790740269.694088:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021979904 00000100:00100000:2.0:1790740269.694144:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021980416 00000100:00100000:2.0:1790740269.694147:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021980416 00000100:00080000:2.0:1790740269.694176:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790740269.694192:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021980928 00000100:00100000:2.0:1790740269.694195:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021980928 00000100:00080000:2.0:1790740269.694206:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790740269.694223:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1790740269.694234:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727021979904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740269.694247:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021981440 00000100:00100000:1.0:1790740269.694254:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021981440 00000100:00100000:1.0:1790740269.694293:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1790740269.694302:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021981440:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790740269.694313:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727021979904:12345-0@lo:400:kworker.0 Request processed in 80us (682us total) trans 0 rc 0/0 00002000:00000024:1.0:1790740269.694323:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790740269.694344:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1790740269.694366:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1790740269.694373:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877727021980416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740269.694404:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877727021980416:12345-0@lo:400:kworker.0 Request processed in 33us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740269.694411:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1790740269.694423:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1790740269.694429:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877727021980928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740269.694459:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021981440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 157us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740269.694469:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790740269.694474:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877727021980928:12345-0@lo:400:kworker.0 Request processed in 44us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740269.694481:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1790740269.694619:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ce1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727021979904:0@lo:400:kworker.0 00000100:00100000:3.0:1790740269.694632:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877727021980416:0@lo:400:kworker.0 00000100:00100000:3.0:1790740269.694642:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1877727021980928:0@lo:400:kworker.0 00010000:00080000:3.0:1790740269.694655:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcbd5fa300 x1877727021981440/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740285 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740269.694685:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021981440:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1790740270.570254:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740270.700278:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021981568:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790740270.700397:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740270.700950:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021981568 00000100:00100000:3.0:1790740270.700962:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021981568 00000100:00100000:3.0:1790740270.701048:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1790740270.701059:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727021981568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790740270.701106:0:7846:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1790740270.701181:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727021981568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 122us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740270.701190:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1790740270.701248:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021981568:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1790740271.595613:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740272.623286:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740272.747544:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790740272.747576:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021981696:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790740272.747674:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740272.747750:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021981696 00000100:00100000:0.0:1790740272.747767:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021981696 00000100:00100000:1.0:1790740272.747915:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1790740272.747927:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021981696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790740272.747977:0:6540:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1790740272.748080:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021981696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 155us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740272.748111:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1790740272.748172:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021981696:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790740273.258854:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790740273.258897:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc81325f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021981824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790740273.259005:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740273.259268:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021981824 00000100:00100000:2.0:1790740273.259281:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021981824 00000100:00100000:2.0:1790740273.259366:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790740273.259390:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021981824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790740273.259438:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790740273.259500:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021981824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740273.259511:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021981952:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790740273.259520:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790740273.259545:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1790740273.259573:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dc81325f80 x1877727021981824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740289 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740273.259583:0:10118:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021981952 00000100:00100000:1.0:1790740273.259586:0:10118:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021981952 00000100:00100000:2.0:1790740273.259594:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc81325f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021981824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790740273.259612:0:10118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790740273.259619:0:10118:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021981952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790740273.259630:0:10118:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790740273.259674:0:10118:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021981952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740273.259680:0:10118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:2.0:1790740273.259725:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcbd5fea00 x1877727021981952/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740289 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740273.259763:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021981952:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1790740273.259841:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790740273.642963:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740274.592380:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740274.592433:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740274.592468:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740274.592502:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740274.592528:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740274.592544:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740274.592568:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740274.592602:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000935168 00000100:00100000:2.0:1790740274.592614:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000935168 00000100:00100000:2.0:1790740274.592690:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000935040 00000100:00100000:2.0:1790740274.592693:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000935040 00000100:00100000:2.0:1790740274.592722:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 59 00000100:00100000:2.0:1790740274.592733:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc81326d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4188ca3f-be2e-4a39-97db-9401a3b70751+6:2405:x1877727000935168:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1790740274.592831:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000934656 00000100:00100000:0.0:1790740274.592838:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000934656 00000100:00100000:2.0:1790740274.592844:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc81326d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4188ca3f-be2e-4a39-97db-9401a3b70751+6:2405:x1877727000935168:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 110us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740274.592853:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 59 00000100:00100000:2.0:1790740274.592878:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 60 00000100:00100000:0.0:1790740274.592879:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000934912 00000100:00100000:0.0:1790740274.592884:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000934912 00000100:00100000:2.0:1790740274.592889:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc81324700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4188ca3f-be2e-4a39-97db-9401a3b70751+6:2405:x1877727000935040:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1790740274.592903:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000934528 00000100:00100000:0.0:1790740274.592908:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000934528 00000100:00100000:2.0:1790740274.592923:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc81324700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4188ca3f-be2e-4a39-97db-9401a3b70751+6:2405:x1877727000935040:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 37us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740274.592926:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000934784 00000100:00100000:0.0:1790740274.592931:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000934784 00000100:00100000:0.0:1790740274.592948:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 140 00000100:00100000:0.0:1790740274.592956:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc81325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+5:2405:x1877727000934656:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1790740274.593005:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc81325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+5:2405:x1877727000934656:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 49us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740274.593012:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 140 00000100:00100000:0.0:1790740274.593026:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 141 00000100:00100000:2.0:1790740274.593080:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 60 00000100:00100000:0.0:1790740274.593081:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc81324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188ca3f-be2e-4a39-97db-9401a3b70751+6:2405:x1877727000934912:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1790740274.593112:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc81324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188ca3f-be2e-4a39-97db-9401a3b70751+6:2405:x1877727000934912:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 38us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740274.593119:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 141 00000100:00100000:2.0:1790740274.593140:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 142 00000100:00100000:2.0:1790740274.593210:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc81325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+6:2405:x1877727000934528:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1790740274.593255:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 143 00000100:00100000:0.0:1790740274.593266:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc81324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188ca3f-be2e-4a39-97db-9401a3b70751+6:2405:x1877727000934784:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1790740274.593273:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc81325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+6:2405:x1877727000934528:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 124us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740274.593284:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 142 00000100:00100000:0.0:1790740274.593309:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc81324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188ca3f-be2e-4a39-97db-9401a3b70751+6:2405:x1877727000934784:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 45us (763us total) trans 0 rc 0/0 00000100:00080000:2.0:1790740274.593323:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790740274.593329:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 143 00000100:00080000:2.0:1790740274.593330:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790740274.593335:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790740274.593338:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790740274.593957:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000934400 00000100:00100000:1.0:1790740274.593966:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000934400 00000100:00100000:1.0:1790740274.594020:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 305 00000100:00100000:1.0:1790740274.594068:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:2405:x1877727000934400:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1790740274.594112:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:2405:x1877727000934400:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 85us (1747us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740274.594120:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 305 00010000:00010000:1.0:1790740274.667175:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740274.795782:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790740274.795976:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc81324000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021982080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790740274.796112:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740274.796192:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021982080 00000100:00100000:2.0:1790740274.796202:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021982080 00000100:00100000:2.0:1790740274.796590:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790740274.796602:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc81327480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021982080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790740274.796646:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790740274.797133:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc81327480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021982080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 531us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740274.797144:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1790740274.797176:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790740274.798992:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727021982208:0@lo:400:kworker.0 00000100:00100000:3.0:1790740274.799112:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740274.799164:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021982720:0@lo:400:kworker.0 00000100:00100000:3.0:1790740274.799269:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740274.799293:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021983232:0@lo:400:kworker.0 00000100:00100000:3.0:1790740274.799323:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740274.799355:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83eeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021983744:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790740274.799380:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740274.799411:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1790740274.799418:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877727021982336:0@lo:400:kworker.0 00000100:00100000:3.0:1790740274.799446:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740274.799468:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1877727021982848:0@lo:400:kworker.0 00000100:00100000:3.0:1790740274.799491:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740274.799508:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1877727021983360:0@lo:400:kworker.0 00000100:00100000:3.0:1790740274.799527:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740274.799565:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021982720 00000100:00100000:3.0:1790740274.799575:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021982720 00000100:00100000:3.0:1790740274.799627:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1790740274.799637:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021982720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740274.799700:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021982720:12345-0@lo:400:kworker.0 Request processed in 63us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740274.799719:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1790740274.799746:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021983232 00000100:00100000:3.0:1790740274.799750:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021983232 00000100:00100000:3.0:1790740274.799780:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790740274.799788:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021983232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740274.800229:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021983232:12345-0@lo:400:kworker.0 Request processed in 440us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740274.800239:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790740274.800280:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021983744 00000100:00100000:3.0:1790740274.800286:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021983744 00000100:00100000:3.0:1790740274.800348:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790740274.800356:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021983744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790740274.800377:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790740274.800416:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021983744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740274.800423:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790740274.800442:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021982336 00000100:00100000:3.0:1790740274.800446:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021982336 00000100:00080000:0.0:1790740274.801589:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1790740274.801893:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dc81324000 x1877727021982080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740290 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740274.802028:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc81324000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021982080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790740274.802099:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021982464:0@lo:400:kworker.0 00000100:00100000:1.0:1790740274.802218:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740274.802278:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1877727021982976:0@lo:400:kworker.0 00000100:00100000:1.0:1790740274.802310:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740274.802351:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1877727021983488:0@lo:400:kworker.0 00000100:00100000:1.0:1790740274.802379:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740274.802398:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1790740274.802407:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877727021982592:0@lo:400:kworker.0 00000100:00100000:1.0:1790740274.802438:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740274.802535:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021983104:0@lo:400:kworker.0 00000100:00100000:1.0:1790740274.802569:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740274.802603:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021982464 00000100:00100000:1.0:1790740274.802605:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021983616:0@lo:400:kworker.0 00000100:00100000:0.0:1790740274.802618:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021982464 00000100:00100000:0.0:1790740274.802683:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1790740274.802692:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021982464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740274.802911:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740274.802936:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021982464:12345-0@lo:400:kworker.0 Request processed in 243us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740274.802945:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000001:00100000:0.0:1790740274.803000:0:9531:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4188ca3f-be2e-4a39-97db-9401a3b70751 00000100:00100000:3.0:1790740274.803095:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021982848 00000100:00100000:1.0:1790740274.803103:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021982464:0@lo:400:kworker.0 00000100:00100000:3.0:1790740274.803104:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021982848 00000100:00100000:1.0:1790740274.803151:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021982208 00000100:00100000:1.0:1790740274.803156:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021982208 00000100:00100000:1.0:1790740274.803200:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1790740274.803211:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3640:x1877727021982208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740274.803217:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021983360 00000100:00100000:3.0:1790740274.803223:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021983360 00000100:00100000:1.0:1790740274.803266:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3640:x1877727021982208:12345-0@lo:400:kworker.0 Request processed in 59us (4155us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740274.803275:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1790740274.803312:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021982976 00000100:00100000:1.0:1790740274.803315:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021982976 00000100:00080000:0.0:1790740274.804398:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790740274.804406:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790740274.805173:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021983104 00000100:00100000:0.0:1790740274.805186:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021983104 00000100:00100000:0.0:1790740274.805242:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021983616 00000100:00100000:0.0:1790740274.805246:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021983616 00000100:00100000:0.0:1790740274.805279:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790740274.805288:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021983104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740274.805404:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021983104:12345-0@lo:400:kworker.0 Request processed in 117us (2837us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740274.805412:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790740274.805432:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790740274.805440:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021983616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740274.805489:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021983616:12345-0@lo:400:kworker.0 Request processed in 50us (2580us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740274.805496:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790740274.806437:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021983488 00000100:00100000:2.0:1790740274.806448:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021983488 00000100:00100000:2.0:1790740274.806577:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021982592 00000100:00100000:2.0:1790740274.806581:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021982592 00000100:00100000:2.0:1790740274.806659:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1790740274.806671:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877727021982336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740274.806744:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877727021982336:12345-0@lo:400:kworker.0 Request processed in 77us (7297us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740274.806751:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1790740274.806780:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1790740274.806787:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877727021982848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740274.806828:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877727021982848:12345-0@lo:400:kworker.0 Request processed in 42us (7336us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740274.806833:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1790740274.806844:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1790740274.806849:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877727021983488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740274.806878:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877727021983488:12345-0@lo:400:kworker.0 Request processed in 30us (4500us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740274.806884:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1790740274.806895:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1790740274.806901:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877727021982592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740274.806928:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877727021982592:12345-0@lo:400:kworker.0 Request processed in 28us (4493us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740274.806933:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:2.0:1790740274.806969:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790740274.808367:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877727021982336:0@lo:400:kworker.0 00000100:00100000:2.0:1790740274.808391:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1877727021982848:0@lo:400:kworker.0 00000100:00100000:3.0:1790740274.808400:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1790740274.808404:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727021982208:0@lo:400:kworker.0 00000100:00100000:3.0:1790740274.808415:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877727021983360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740274.808419:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021982720:0@lo:400:kworker.0 00010000:00080000:2.0:1790740274.808434:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcbd5f8700 x1877727021983232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740274.808446:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021983232:0@lo:400:kworker.0 00010000:00080000:2.0:1790740274.808468:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83eeb800 x1877727021983744/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740290 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740274.808486:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83eeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021983744:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790740274.808498:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877727021983360:12345-0@lo:400:kworker.0 Request processed in 88us (8968us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740274.808507:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1790740274.808523:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1877727021983360:0@lo:400:kworker.0 00000100:00100000:3.0:1790740274.808589:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877727021982592:0@lo:400:kworker.0 00010000:00080000:3.0:1790740274.808608:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcbd5f8a80 x1877727021983104/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740274.808618:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021983104:0@lo:400:kworker.0 00010000:00080000:3.0:1790740274.808630:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcbd5f9c00 x1877727021983616/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740274.808638:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021983616:0@lo:400:kworker.0 00010000:00080000:3.0:1790740274.808650:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcbd5fb480 x1877727021983488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740274.808658:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1877727021983488:0@lo:400:kworker.0 00000100:00100000:1.0:1790740274.809520:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1790740274.809536:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877727021982976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740274.809644:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877727021982976:12345-0@lo:400:kworker.0 Request processed in 112us (7332us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740274.809667:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00010000:00080000:1.0:1790740274.809728:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcbd5f9880 x1877727021982976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740274.809749:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1877727021982976:0@lo:400:kworker.0 00000001:00100000:2.0:1790740274.814058:0:8446:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4188ca3f-be2e-4a39-97db-9401a3b70751 00000001:00100000:1.0:1790740274.814247:0:6514:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4188ca3f-be2e-4a39-97db-9401a3b70751 00000001:00100000:0.0:1790740274.815879:0:7466:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 4188ca3f-be2e-4a39-97db-9401a3b70751 00000001:02000400:3.0:1790740275.426539:0:12210:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg403-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1790740275.691135:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740275.818612:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790740275.818640:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021983872:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790740275.818714:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740275.818935:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021983872 00000100:00100000:3.0:1790740275.818945:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021983872 00000100:00100000:3.0:1790740275.818998:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1790740275.819007:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021983872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790740275.819062:0:7846:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1790740275.819117:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021983872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740275.819124:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1790740275.819235:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021983872:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1790740276.720992:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740277.738953:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740277.868018:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021984000:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790740277.868103:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740277.868176:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021984000 00000100:00100000:3.0:1790740277.868183:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021984000 00000100:00100000:3.0:1790740277.868234:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1790740277.868243:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021984000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790740277.868290:0:6541:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1790740277.868340:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021984000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740277.868347:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1790740277.868392:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021984000:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790740278.378263:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790740278.378295:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790740278.378320:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021984256:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790740278.378321:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc81325c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021984128:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790740278.381011:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740278.381235:0:10118:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021984256 00000100:00100000:3.0:1790740278.381243:0:10118:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021984256 00000100:00100000:3.0:1790740278.381322:0:10118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790740278.381332:0:10118:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaf260450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021984256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790740278.381363:0:10118:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790740278.381414:0:10118:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaf260450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021984256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740278.381421:0:10118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:1.0:1790740278.381737:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcbd5fce00 x1877727021984256/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740294 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740278.381756:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021984256:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1790740278.381905:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790740278.383566:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740278.383654:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021984128 00000100:00100000:0.0:1790740278.383662:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021984128 00000100:00100000:0.0:1790740278.383742:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1790740278.383752:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc81326a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021984128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790740278.383775:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790740278.383835:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc81326a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021984128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740278.383843:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:3.0:1790740278.383985:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dc81325c00 x1877727021984128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740294 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740278.384004:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc81325c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021984128:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790740278.384088:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790740278.764456:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740279.708648:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740279.708725:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740279.708752:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740279.708789:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740279.708810:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740279.708828:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740279.708853:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740279.708899:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000935552 00000100:00100000:3.0:1790740279.708909:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000935552 00000100:00100000:3.0:1790740279.708963:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000935424 00000100:00100000:3.0:1790740279.708967:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000935424 00000100:00100000:3.0:1790740279.708986:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000935808 00000100:00100000:3.0:1790740279.708989:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000935808 00000100:00100000:3.0:1790740279.709008:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000935680 00000100:00100000:3.0:1790740279.709011:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000935680 00000100:00100000:3.0:1790740279.709028:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 150 00000100:00100000:2.0:1790740279.709073:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000936064 00000100:00100000:3.0:1790740279.709078:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+5:2403:x1877727000935552:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1790740279.709080:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000936064 00000100:00100000:2.0:1790740279.709118:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000935936 00000100:00100000:2.0:1790740279.709122:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000935936 00000100:00100000:2.0:1790740279.709151:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 64 00000100:00100000:2.0:1790740279.709160:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2403:x1877727000936064:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740279.709188:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+5:2403:x1877727000935552:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 113us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740279.709196:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2403:x1877727000936064:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 36us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740279.709201:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 150 00000100:00100000:2.0:1790740279.709211:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 64 00000100:00100000:3.0:1790740279.709235:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 151 00000100:00100000:2.0:1790740279.709236:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 65 00000100:00100000:3.0:1790740279.709260:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+6:2402:x1877727000935424:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1790740279.709261:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2402:x1877727000935936:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740279.709299:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+6:2402:x1877727000935424:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 53us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740279.709306:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2402:x1877727000935936:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 58us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740279.709310:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 151 00000100:00100000:2.0:1790740279.709320:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 65 00000100:00100000:3.0:1790740279.709333:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 152 00000100:00100000:3.0:1790740279.709343:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2403:x1877727000935808:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1790740279.709351:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 153 00000100:00100000:2.0:1790740279.709372:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2402:x1877727000935680:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740279.709374:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2403:x1877727000935808:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 30us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740279.709384:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 152 00000100:00080000:3.0:1790740279.709412:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790740279.709413:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2402:x1877727000935680:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 44us (599us total) trans 0 rc 0/0 00000100:00080000:3.0:1790740279.709417:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790740279.709422:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790740279.709424:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 153 00000100:00080000:3.0:1790740279.709426:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790740279.709968:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000935296 00000100:00100000:1.0:1790740279.709975:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000935296 00000100:00100000:1.0:1790740279.710021:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 307 00000100:00100000:1.0:1790740279.710047:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca1332050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:2403:x1877727000935296:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1790740279.710095:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca1332050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:2403:x1877727000935296:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 66us (1460us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740279.710103:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 307 00010000:00010000:2.0:1790740279.787057:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740279.914807:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfc13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3641:1877727021984384:0@lo:400:kworker.0 00000100:00100000:3.0:1790740279.914915:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740279.915430:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc81326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021984512:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790740279.915698:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740279.915761:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790740279.915768:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc81326680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021984640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790740279.915790:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740279.915822:0:10118:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021984512 00000100:00100000:2.0:1790740279.915830:0:10118:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021984512 00000100:00100000:2.0:1790740279.916222:0:10118:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021984640 00000100:00100000:2.0:1790740279.916226:0:10118:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021984640 00000100:00100000:2.0:1790740279.916256:0:10118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790740279.916267:0:10118:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc81325c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021984512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790740279.916301:0:10118:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790740279.916306:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021984384 00000100:00100000:3.0:1790740279.916312:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021984384 00000100:00100000:3.0:1790740279.916346:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1790740279.916358:0:10118:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc81325c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021984512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740279.916365:0:10118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790740279.916383:0:10118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790740279.916390:0:10118:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc81327480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021984640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790740279.916400:0:10118:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790740279.916423:0:10118:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc81327480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021984640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 34us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740279.916430:0:10118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790740279.916638:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca1333c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3641:x1877727021984384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740279.916684:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca1333c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3641:x1877727021984384:12345-0@lo:400:kworker.0 Request processed in 332us (1772us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740279.916692:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1790740279.916737:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfc13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3641:1877727021984384:0@lo:400:kworker.0 00000100:00100000:3.0:1790740279.916803:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfc13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877727021984768:0@lo:400:kworker.0 00000100:00100000:3.0:1790740279.916833:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740279.916874:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021984768 00000100:00100000:3.0:1790740279.916878:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021984768 00000100:00100000:3.0:1790740279.916912:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1790740279.916921:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877727021984768:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1790740279.917275:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1790740279.917315:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dc81326680 x1877727021984640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740295 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740279.917334:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc81326680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021984640:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1790740279.917345:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dc81326300 x1877727021984512/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740295 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740279.917355:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc81326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021984512:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790740279.918549:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877727021984768:12345-0@lo:400:kworker.0 Request processed in 1625us (1710us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740279.918560:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1790740279.918634:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021984896:0@lo:400:kworker.0 00000100:00100000:0.0:1790740279.918649:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfc13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877727021984768:0@lo:400:kworker.0 00000100:00100000:3.0:1790740279.918691:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740279.918759:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877727021985024:0@lo:400:kworker.0 00000100:00100000:3.0:1790740279.918786:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740279.918826:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021984896 00000100:00100000:3.0:1790740279.918829:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790740279.918834:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021984896 00000100:00100000:3.0:1790740279.918839:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021985152:0@lo:400:kworker.0 00000100:00100000:0.0:1790740279.918876:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1790740279.918887:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021984896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740279.918895:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740279.918926:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021985152 00000100:00100000:3.0:1790740279.918931:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021985152 00000100:00100000:0.0:1790740279.918948:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021984896:12345-0@lo:400:kworker.0 Request processed in 64us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740279.918956:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1790740279.919532:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021985024 00000100:00100000:2.0:1790740279.919540:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021985024 00000100:00100000:2.0:1790740279.919576:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1790740279.919583:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877727021985024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740279.919645:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877727021985024:12345-0@lo:400:kworker.0 Request processed in 63us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740279.919652:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1790740279.919693:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877727021985024:0@lo:400:kworker.0 00000100:00100000:0.0:1790740279.920154:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc81324000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1877727021985280:0@lo:400:kworker.0 00000100:00100000:2.0:1790740279.920158:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc81326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021985536:0@lo:400:kworker.0 00000100:00100000:2.0:1790740279.920187:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740279.920187:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740279.920209:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790740279.920214:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc81327b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1877727021985408:0@lo:400:kworker.0 00000100:00100000:2.0:1790740279.920218:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021985536 00000100:00100000:2.0:1790740279.920222:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021985536 00000100:00100000:0.0:1790740279.920235:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740279.920260:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790740279.920268:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc81326680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021985536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740279.920305:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc81326680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021985536:12345-0@lo:400:kworker.0 Request processed in 38us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740279.920310:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:2.0:1790740279.920336:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dc81326300 x1877727021985536/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740279.920347:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc81326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021985536:0@lo:400:kworker.0 00000100:00100000:2.0:1790740279.920378:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc81326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021985664:0@lo:400:kworker.0 00000100:00100000:2.0:1790740279.920400:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740279.920439:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1877727021985792:0@lo:400:kworker.0 00000100:00100000:3.0:1790740279.921501:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1790740279.921520:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021985152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740279.921605:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021985152:12345-0@lo:400:kworker.0 Request processed in 94us (2711us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740279.921612:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1790740279.921642:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021985664 00000100:00100000:3.0:1790740279.921650:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021985664 00000100:00100000:3.0:1790740279.921682:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790740279.921689:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ee9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727021985664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740279.921730:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ee9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727021985664:12345-0@lo:400:kworker.0 Request processed in 42us (1329us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740279.921737:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:3.0:1790740279.922522:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dc81326300 x1877727021985664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740279.922542:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc81326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021985664:0@lo:400:kworker.0 00000100:00100000:3.0:1790740279.922581:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021985280 00000100:00100000:3.0:1790740279.922586:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021985280 00000100:00100000:3.0:1790740279.922630:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021985408 00000100:00100000:3.0:1790740279.922633:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021985408 00000100:00100000:3.0:1790740279.922653:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1790740279.922658:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877727021985280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740279.922702:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877727021985280:12345-0@lo:400:kworker.0 Request processed in 44us (2515us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740279.922708:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1790740279.922732:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1790740279.922737:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877727021985408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740279.922763:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877727021985408:12345-0@lo:400:kworker.0 Request processed in 26us (2527us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740279.922769:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:3.0:1790740279.922782:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790740279.923659:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790740279.925543:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021984896:0@lo:400:kworker.0 00000100:00100000:3.0:1790740279.926867:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1877727021985920:0@lo:400:kworker.0 00000100:00100000:3.0:1790740279.926938:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740279.926993:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021985920 00000100:00100000:3.0:1790740279.927000:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021985920 00000100:00100000:3.0:1790740279.927153:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1790740279.927164:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1877727021985920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740279.927225:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1877727021985920:12345-0@lo:400:kworker.0 Request processed in 61us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740279.927232:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:3.0:1790740279.927270:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790740279.927340:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021985152:0@lo:400:kworker.0 00010000:00080000:3.0:1790740279.930673:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83d68e00 x1877727021985920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740279.930698:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1877727021985920:0@lo:400:kworker.0 00000100:00100000:2.0:1790740279.933768:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740279.933906:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021985792 00000100:00100000:1.0:1790740279.933934:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021985792 00000100:00100000:1.0:1790740279.934015:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1790740279.934026:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877727021985792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740279.934121:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877727021985792:12345-0@lo:400:kworker.0 Request processed in 97us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740279.934128:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:3.0:1790740279.934330:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790740279.934771:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1877727021985792:0@lo:400:kworker.0 00010000:00080000:2.0:1790740279.934790:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dc81327b80 x1877727021985408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740279.934801:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc81327b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1877727021985408:0@lo:400:kworker.0 00000100:00100000:2.0:1790740279.934812:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc81324000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1877727021985280:0@lo:400:kworker.0 00010000:00010000:3.0:1790740280.811431:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740280.939984:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790740280.940007:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021986048:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790740280.940110:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740280.940399:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021986048 00000100:00100000:0.0:1790740280.940408:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021986048 00000100:00100000:0.0:1790740280.940465:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1790740280.940475:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82f99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727021986048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790740280.940511:0:6540:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1790740280.940565:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82f99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727021986048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740280.940571:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1790740280.940618:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021986048:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1790740281.835871:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740282.860969:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740282.986471:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727021986176:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790740282.986556:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740282.986893:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021986176 00000100:00100000:2.0:1790740282.986903:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021986176 00000100:00100000:2.0:1790740282.986972:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1790740282.986981:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727021986176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790740282.987014:0:7846:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1790740282.994845:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727021986176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 7854us (8277us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740282.994861:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1790740282.995204:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727021986176:0@lo:41:osp-pre-0-1.0 00000020:00000004:0.0:1790740283.157824:0:12527:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790740283.158738:0:12527:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1790740283.499220:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021986304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790740283.499342:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740283.499952:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021986304 00000100:00100000:0.0:1790740283.499962:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021986304 00000100:00100000:0.0:1790740283.500054:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790740283.500068:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82f99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021986304:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1790740283.500189:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790740283.500283:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790740283.500293:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021986432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790740283.500349:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740283.500473:0:10118:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021986432 00000100:00100000:3.0:1790740283.500490:0:10118:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021986432 00000100:00100000:3.0:1790740283.500520:0:10118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00002000:00000024:0.0:1790740283.500900:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790740283.500955:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82f99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021986304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 891us (1612us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740283.500969:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1790740283.501005:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790740283.501235:0:10118:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82f99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021986432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790740283.501252:0:10118:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00080000:2.0:1790740283.501294:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcbd5fce00 x1877727021986304/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740299 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740283.501331:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021986304:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790740283.504147:0:10118:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82f99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021986432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3611us (3787us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740283.504162:0:10118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:2.0:1790740283.504337:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db82f9b100 x1877727021986432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740299 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740283.504361:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021986432:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790740283.883814:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740284.825187:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740284.825240:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740284.825272:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740284.825299:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740284.825328:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740284.825348:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740284.825375:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740284.825413:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000936448 00000100:00100000:3.0:1790740284.825428:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000936448 00000100:00100000:3.0:1790740284.825502:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000936704 00000100:00100000:3.0:1790740284.825506:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000936704 00000100:00100000:3.0:1790740284.825522:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000936320 00000100:00100000:3.0:1790740284.825525:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000936320 00000100:00100000:3.0:1790740284.825551:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000936576 00000100:00100000:3.0:1790740284.825555:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000936576 00000100:00100000:3.0:1790740284.825577:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 160 00000100:00100000:3.0:1790740284.825599:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+5:2404:x1877727000936448:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740284.825703:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+5:2404:x1877727000936448:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 106us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740284.825711:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 160 00000100:00100000:3.0:1790740284.825732:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 161 00000100:00100000:3.0:1790740284.825761:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2404:x1877727000936704:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740284.825790:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2404:x1877727000936704:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 30us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740284.825797:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 161 00000100:00100000:3.0:1790740284.825811:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 162 00000100:00100000:3.0:1790740284.825817:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+6:2404:x1877727000936320:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740284.825842:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+6:2404:x1877727000936320:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 26us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740284.825848:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 162 00000100:00100000:3.0:1790740284.825859:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 163 00000100:00100000:3.0:1790740284.825865:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2404:x1877727000936576:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740284.825887:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2404:x1877727000936576:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 22us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740284.825893:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 163 00000100:00100000:3.0:1790740284.825920:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000936960 00000100:00100000:3.0:1790740284.825923:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000936960 00000100:00100000:3.0:1790740284.825950:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000936832 00000100:00100000:3.0:1790740284.825953:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000936832 00000100:00100000:3.0:1790740284.825975:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 68 00000100:00100000:3.0:1790740284.825980:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2404:x1877727000936960:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740284.826006:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2404:x1877727000936960:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 26us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740284.826012:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 68 00000100:00100000:3.0:1790740284.826023:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 69 00000100:00100000:3.0:1790740284.826028:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc81324000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2404:x1877727000936832:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740284.826091:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc81324000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2404:x1877727000936832:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 63us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740284.826098:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 69 00000100:00080000:3.0:1790740284.826122:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790740284.826127:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790740284.826130:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790740284.826132:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790740284.829735:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000936192 00000100:00100000:1.0:1790740284.829757:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000936192 00000100:00100000:1.0:1790740284.829848:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 309 00000100:00100000:1.0:1790740284.829861:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca1332850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:2404:x1877727000936192:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1790740284.829984:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca1332850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:2404:x1877727000936192:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 126us (4818us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740284.829993:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 309 00010000:00010000:3.0:1790740284.906795:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740285.035358:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727021986560:0@lo:400:kworker.0 00000100:00100000:2.0:1790740285.035475:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740285.035686:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021986560 00000100:00100000:1.0:1790740285.035696:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021986560 00000100:00100000:1.0:1790740285.035762:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1790740285.035775:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3638:x1877727021986560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740285.035846:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3638:x1877727021986560:12345-0@lo:400:kworker.0 Request processed in 73us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740285.035855:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1790740285.036524:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877727021986944:0@lo:400:kworker.0 00000100:00100000:2.0:1790740285.037832:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727021986560:0@lo:400:kworker.0 00000100:00100000:2.0:1790740285.037851:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021987072:0@lo:400:kworker.0 00000100:00100000:2.0:1790740285.037955:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740285.038004:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021987584:0@lo:400:kworker.0 00000100:00100000:2.0:1790740285.038065:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740285.038092:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021988096:0@lo:400:kworker.0 00000100:00100000:2.0:1790740285.038117:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740285.038180:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1790740285.038189:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727021986688:0@lo:400:kworker.0 00000100:00100000:2.0:1790740285.038221:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740285.038251:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877727021987200:0@lo:400:kworker.0 00000100:00100000:2.0:1790740285.038278:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740285.038300:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1877727021987712:0@lo:400:kworker.0 00000100:00100000:2.0:1790740285.038328:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740285.038379:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021986816:0@lo:400:kworker.0 00000100:00100000:2.0:1790740285.038407:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740285.038441:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1877727021987328:0@lo:400:kworker.0 00000100:00100000:2.0:1790740285.038465:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740285.038484:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1877727021987840:0@lo:400:kworker.0 00000100:00100000:2.0:1790740285.038507:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740285.038924:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740285.038965:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021987456:0@lo:400:kworker.0 00000100:00100000:3.0:1790740285.038994:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740285.039017:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021987968:0@lo:400:kworker.0 00000100:00100000:3.0:1790740285.039064:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740285.039109:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021987072 00000100:00100000:2.0:1790740285.039121:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021987072 00000100:00100000:2.0:1790740285.039201:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021986816 00000100:00100000:2.0:1790740285.039204:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021986816 00000100:00100000:2.0:1790740285.039229:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1790740285.039231:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021987584 00000100:00100000:2.0:1790740285.039241:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83f11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021987072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740285.039242:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021987584 00000100:00100000:3.0:1790740285.039300:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021988096 00000100:00100000:3.0:1790740285.039306:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021988096 00000100:00100000:3.0:1790740285.039342:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021987456 00000100:00100000:2.0:1790740285.039345:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83f11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021987072:12345-0@lo:400:kworker.0 Request processed in 105us (1389us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740285.039349:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021987456 00000100:00100000:2.0:1790740285.039363:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1790740285.039379:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021987968 00000100:00100000:3.0:1790740285.039385:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021987968 00000100:00100000:2.0:1790740285.039398:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1790740285.039410:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83c52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021986816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740285.039421:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790740285.039435:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83f11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021987584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740285.039461:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83c52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021986816:12345-0@lo:400:kworker.0 Request processed in 52us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740285.039469:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1790740285.039505:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790740285.039513:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83f11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021987584:12345-0@lo:400:kworker.0 Request processed in 81us (1445us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740285.039519:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83f10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021988096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740285.039531:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790740285.039568:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790740285.039650:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc81326300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021987456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740285.039707:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc81326300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021987456:12345-0@lo:400:kworker.0 Request processed in 58us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740285.039726:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83f10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727021988096:12345-0@lo:400:kworker.0 Request processed in 203us (1598us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740285.039827:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790740285.043191:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790740285.043457:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727021988224:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790740285.043476:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790740285.043513:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd552680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021987968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740285.043525:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021986688 00000100:00100000:1.0:1790740285.043556:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740285.043905:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021986688 00000100:00100000:2.0:1790740285.043960:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021987200 00000100:00100000:2.0:1790740285.043964:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021987200 00000100:00100000:2.0:1790740285.046256:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021987712 00000100:00100000:2.0:1790740285.046266:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021987712 00000100:00100000:2.0:1790740285.046285:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021987328 00000100:00100000:2.0:1790740285.046288:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021987328 00000100:00100000:2.0:1790740285.046300:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021987840 00000100:00100000:2.0:1790740285.046303:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021987840 00000100:00100000:2.0:1790740285.046316:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021986944 00000100:00100000:2.0:1790740285.046319:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021986944 00000100:00100000:2.0:1790740285.046337:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1790740285.046349:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83f13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727021986688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740285.052555:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd552680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021987968:12345-0@lo:400:kworker.0 Request processed in 9049us (13477us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740285.052576:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790740285.052599:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021988224 00000100:00100000:1.0:1790740285.052612:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021988224 00000100:00080000:3.0:1790740285.052633:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790740285.052641:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790740285.052645:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790740285.052650:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790740285.052690:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790740285.052703:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727021988224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790740285.052769:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790740285.052841:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727021988224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 141us (9285us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740285.052847:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:1.0:1790740285.052886:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcbd5fed80 x1877727021988224/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740301 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740285.052911:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727021988224:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1790740285.053005:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83d93480 x1877727021987456/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740285.053018:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021987456:0@lo:400:kworker.0 00010000:00080000:3.0:1790740285.053417:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83d91c00 x1877727021987968/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740285.053429:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021987968:0@lo:400:kworker.0 00000100:00100000:2.0:1790740285.053855:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83f13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727021986688:12345-0@lo:400:kworker.0 Request processed in 7505us (15630us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740285.053867:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1790740285.053896:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1790740285.053908:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82f9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877727021987200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740285.053956:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82f9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877727021987200:12345-0@lo:400:kworker.0 Request processed in 52us (15678us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740285.053962:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1790740285.053973:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1790740285.053979:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83c52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877727021987712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740285.054008:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83c52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877727021987712:12345-0@lo:400:kworker.0 Request processed in 29us (15680us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740285.054014:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1790740285.054025:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1790740285.054140:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1790740285.054163:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83c52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877727021987840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740285.054212:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83c52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877727021987840:12345-0@lo:400:kworker.0 Request processed in 51us (15703us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740285.054219:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1790740285.054233:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1790740285.054241:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc81327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877727021986944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740285.054289:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc81327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877727021986944:12345-0@lo:400:kworker.0 Request processed in 48us (15373us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740285.054296:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1790740285.054321:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877727021986944:0@lo:400:kworker.0 00000100:00100000:0.0:1790740285.054353:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727021986688:0@lo:400:kworker.0 00000100:00100000:0.0:1790740285.054368:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877727021987200:0@lo:400:kworker.0 00000100:00100000:0.0:1790740285.054381:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1877727021987712:0@lo:400:kworker.0 00000100:00100000:0.0:1790740285.054394:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021987072:0@lo:400:kworker.0 00010000:00080000:0.0:1790740285.054410:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83d92a00 x1877727021987584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740285.054422:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021987584:0@lo:400:kworker.0 00010000:00080000:0.0:1790740285.054436:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83d93b80 x1877727021988096/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740285.054445:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727021988096:0@lo:400:kworker.0 00000100:00100000:2.0:1790740285.055162:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83c50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877727021987328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740285.055230:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83c50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877727021987328:12345-0@lo:400:kworker.0 Request processed in 1199us (16764us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740285.055250:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1790740285.055408:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83c51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021988352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790740285.055453:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740285.055503:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021986816:0@lo:400:kworker.0 00010000:00080000:2.0:1790740285.055520:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83d90a80 x1877727021987328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740285.055530:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1877727021987328:0@lo:400:kworker.0 00010000:00080000:2.0:1790740285.057233:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83d93100 x1877727021987840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740285.057256:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1877727021987840:0@lo:400:kworker.0 00000100:00100000:2.0:1790740285.057319:0:10118:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021988352 00000100:00100000:2.0:1790740285.057328:0:10118:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021988352 00000100:00100000:2.0:1790740285.057391:0:10118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790740285.057402:0:10118:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83c53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021988352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790740285.057433:0:10118:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790740285.057526:0:10118:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83c53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021988352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (2072us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740285.058644:0:10118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:2.0:1790740285.058726:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83c51180 x1877727021988352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740301 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740285.058753:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83c51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021988352:0@lo:13:osp-pre-1-0.0 00000020:00000004:1.0:1790740285.782783:0:12625:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790740285.783338:0:12625:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1790740285.930195:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740286.072544:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021988480:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790740286.072654:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740286.072907:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021988480 00000100:00100000:3.0:1790740286.072915:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021988480 00000100:00100000:3.0:1790740286.072970:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1790740286.072979:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83c51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021988480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790740286.073020:0:6541:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1790740286.073120:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83c51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021988480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 141us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740286.073142:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1790740286.075568:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021988480:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1790740286.958189:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740287.978389:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1790740288.038983:0:12722:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790740288.039259:0:12722:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1790740288.109259:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790740288.109282:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727021988608:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790740288.109354:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740288.109421:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021988608 00000100:00100000:1.0:1790740288.109428:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021988608 00000100:00100000:1.0:1790740288.109483:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1790740288.109492:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727021988608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790740288.109635:0:6540:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1790740288.109688:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727021988608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 196us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740288.109696:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1790740288.109744:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727021988608:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790740288.618996:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727021988736:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790740288.619106:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740288.619176:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021988736 00000100:00100000:0.0:1790740288.619183:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021988736 00000100:00100000:0.0:1790740288.619247:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1790740288.619257:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727021988736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790740288.619286:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790740288.619331:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727021988736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740288.619339:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:0.0:1790740288.619379:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcbd5fed80 x1877727021988736/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740304 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740288.619398:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727021988736:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1790740288.619558:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790740288.626330:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83c51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021988864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790740288.626420:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740288.626498:0:10118:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021988864 00000100:00100000:0.0:1790740288.626506:0:10118:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021988864 00000100:00100000:0.0:1790740288.626572:0:10118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1790740288.626582:0:10118:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021988864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790740288.626604:0:10118:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790740288.626648:0:10118:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021988864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740288.626655:0:10118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1790740288.626683:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790740288.626714:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83c51f80 x1877727021988864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740304 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740288.626734:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83c51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021988864:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790740289.003271:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740289.949862:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740289.950345:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000937088 00000100:00100000:2.0:1790740289.950359:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000937088 00000100:00100000:2.0:1790740289.950438:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 311 00000100:00100000:2.0:1790740289.950451:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:2402:x1877727000937088:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1790740289.950552:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:2402:x1877727000937088:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 104us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740289.950561:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 311 00000100:00100000:2.0:1790740289.960533:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740289.960983:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000937216 00000100:00100000:2.0:1790740289.960997:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000937216 00000100:00100000:2.0:1790740289.961122:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 170 00000100:00100000:2.0:1790740289.961136:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83c51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+6:2402:x1877727000937216:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1790740289.963240:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83c51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+6:2402:x1877727000937216:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 2089us (2703us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740289.963262:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 170 00000100:00080000:2.0:1790740289.963328:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790740289.964504:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740289.964719:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740289.964827:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000937344 00000100:00100000:2.0:1790740289.964842:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000937344 00000100:00100000:0.0:1790740289.964877:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000937472 00000100:00100000:0.0:1790740289.964882:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000937472 00000100:00100000:0.0:1790740289.964921:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 171 00000100:00100000:0.0:1790740289.964932:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2402:x1877727000937472:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1790740289.965026:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2402:x1877727000937472:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 95us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740289.965062:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 171 00000100:00100000:2.0:1790740289.965162:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 172 00000100:00100000:2.0:1790740289.965172:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+5:2402:x1877727000937344:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1790740289.965211:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+5:2402:x1877727000937344:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 42us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740289.965236:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 172 00000100:00080000:2.0:1790740289.965260:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790740289.965264:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790740289.984028:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740289.984260:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740289.984303:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740289.984341:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000937728 00000100:00100000:0.0:1790740289.984356:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000937728 00000100:00100000:0.0:1790740289.984429:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000937856 00000100:00100000:0.0:1790740289.984431:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000937856 00000100:00100000:0.0:1790740289.984454:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 22 00000100:00100000:0.0:1790740289.984464:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2401:x1877727000937728:12345-192.168.204.3@tcp:9:kworker.0 00000020:00000080:0.0:1790740289.984503:0:8454:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92dc37 00000100:00080000:0.0:1790740289.984513:0:8454:0:(import.c:65:import_set_state_nolock()) ffff98db83e3a800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1790740289.984714:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 23 00000100:00100000:3.0:1790740289.984726:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2401:x1877727000937856:12345-192.168.204.3@tcp:9:kworker.0 00000020:00000080:3.0:1790740289.984743:0:9806:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92dc3e 00000100:00080000:3.0:1790740289.984750:0:9806:0:(import.c:65:import_set_state_nolock()) ffff98dcbfc49000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790740289.984787:0:9806:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1790740289.984993:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4188ca3f-be2e-4a39-97db-9401a3b70751+2:2401:x1877727000937856:12345-192.168.204.3@tcp:9:kworker.0 Request processed in 270us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740289.985002:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 23 00010000:00010000:3.0:1790740289.985061:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740289.985068:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1790740289.985181:0:8454:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1790740289.985292:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4188ca3f-be2e-4a39-97db-9401a3b70751+2:2401:x1877727000937728:12345-192.168.204.3@tcp:9:kworker.0 Request processed in 828us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740289.985300:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 22 00000100:00080000:0.0:1790740289.985335:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790740289.985341:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790740289.989330:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000937600 00000100:00100000:2.0:1790740289.989355:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000937600 00000100:00100000:2.0:1790740289.991253:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 173 00000100:00100000:2.0:1790740289.991274:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2402:x1877727000937600:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1790740289.991410:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2402:x1877727000937600:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 143us (7398us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740289.991419:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 173 00000100:00080000:0.0:1790740289.993510:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1790740290.026802:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740290.154231:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790740290.154258:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83c50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021988992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790740290.154334:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740290.154417:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021988992 00000100:00100000:2.0:1790740290.154425:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021988992 00000100:00100000:2.0:1790740290.154478:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1790740290.154488:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83c53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021988992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790740290.154517:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790740290.154562:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83c53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021988992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740290.154570:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:2.0:1790740290.154591:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1790740290.154621:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83c50380 x1877727021988992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740306 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740290.154640:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83c50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021988992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790740290.154880:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877727021989248:0@lo:400:kworker.0 00000100:00100000:0.0:1790740290.154913:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740290.154933:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfc13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1877727021989760:0@lo:400:kworker.0 00000100:00100000:0.0:1790740290.154953:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740290.154970:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5df0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1877727021990272:0@lo:400:kworker.0 00000100:00100000:0.0:1790740290.154990:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740290.155026:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1790740290.155069:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3639:1877727021989120:0@lo:400:kworker.0 00000100:00100000:0.0:1790740290.155097:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740290.155121:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021989632:0@lo:400:kworker.0 00000100:00100000:0.0:1790740290.155144:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740290.155160:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5df1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021990144:0@lo:400:kworker.0 00000100:00100000:0.0:1790740290.155180:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740290.155221:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021989248 00000100:00100000:0.0:1790740290.155227:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021989248 00000100:00100000:0.0:1790740290.155257:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021989760 00000100:00100000:0.0:1790740290.155260:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021989760 00000100:00100000:0.0:1790740290.155278:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021990272 00000100:00100000:0.0:1790740290.155280:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021990272 00000100:00100000:0.0:1790740290.155294:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1790740290.155301:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877727021989248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740290.155353:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877727021989248:12345-0@lo:400:kworker.0 Request processed in 52us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740290.155360:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1790740290.155382:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1790740290.155388:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1877727021989760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740290.155417:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1877727021989760:12345-0@lo:400:kworker.0 Request processed in 29us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740290.155424:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1790740290.155434:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1790740290.155439:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1877727021990272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740290.155464:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1877727021990272:12345-0@lo:400:kworker.0 Request processed in 24us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740290.155469:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1790740290.155486:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021989120 00000100:00100000:0.0:1790740290.155490:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021989120 00000100:00100000:0.0:1790740290.155511:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1790740290.155517:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3639:x1877727021989120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740290.155544:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3639:x1877727021989120:12345-0@lo:400:kworker.0 Request processed in 27us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740290.155550:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1790740290.155577:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021989632 00000100:00100000:0.0:1790740290.155581:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021989632 00000100:00100000:0.0:1790740290.155603:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1790740290.155608:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb8139500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727021989632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740290.155639:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb8139500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727021989632:12345-0@lo:400:kworker.0 Request processed in 30us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740290.155644:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1790740290.155660:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021990144 00000100:00100000:0.0:1790740290.155663:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021990144 00000100:00100000:0.0:1790740290.155688:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1790740290.155702:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb8138000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727021990144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740290.155733:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb8138000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727021990144:12345-0@lo:400:kworker.0 Request processed in 32us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740290.155738:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1790740290.155774:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3639:1877727021989120:0@lo:400:kworker.0 00000100:00100000:0.0:1790740290.155783:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021989632:0@lo:400:kworker.0 00010000:00080000:0.0:1790740290.155795:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcb5df1880 x1877727021990144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740290.155804:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5df1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021990144:0@lo:400:kworker.0 00000100:00100000:0.0:1790740290.155813:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877727021989248:0@lo:400:kworker.0 00000100:00100000:0.0:1790740290.155821:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfc13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1877727021989760:0@lo:400:kworker.0 00000100:00100000:0.0:1790740290.155829:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5df0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1877727021990272:0@lo:400:kworker.0 00000100:00100000:3.0:1790740290.155989:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877727021989504:0@lo:400:kworker.0 00000100:00100000:3.0:1790740290.156020:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740290.156083:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5df1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021990016:0@lo:400:kworker.0 00000100:00100000:3.0:1790740290.156105:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740290.156122:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5df3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021990528:0@lo:400:kworker.0 00000100:00100000:3.0:1790740290.156140:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740290.156156:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1790740290.156161:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021989376:0@lo:400:kworker.0 00000100:00100000:3.0:1790740290.156180:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740290.156206:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5df1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1877727021989888:0@lo:400:kworker.0 00000100:00100000:3.0:1790740290.156227:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740290.156240:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5df0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1877727021990400:0@lo:400:kworker.0 00000100:00100000:3.0:1790740290.156259:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740290.156280:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021990016 00000100:00100000:3.0:1790740290.156284:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021990016 00000100:00100000:3.0:1790740290.156309:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021990528 00000100:00100000:3.0:1790740290.156312:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021990528 00000100:00100000:3.0:1790740290.156330:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790740290.156390:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021990016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740290.156431:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021990016:12345-0@lo:400:kworker.0 Request processed in 95us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740290.156437:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790740290.156450:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1790740290.156456:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021990528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740290.156481:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021990528:12345-0@lo:400:kworker.0 Request processed in 25us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740290.156486:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1790740290.156502:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021989376 00000100:00100000:3.0:1790740290.156505:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021989376 00000100:00100000:3.0:1790740290.156524:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1790740290.156529:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021989376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740290.156558:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021989376:12345-0@lo:400:kworker.0 Request processed in 29us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740290.156564:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1790740290.156588:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021989376:0@lo:400:kworker.0 00010000:00080000:3.0:1790740290.156610:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcb5df1f80 x1877727021990016/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740290.156619:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5df1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021990016:0@lo:400:kworker.0 00010000:00080000:3.0:1790740290.156628:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcb5df3480 x1877727021990528/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740290.156636:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5df3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021990528:0@lo:400:kworker.0 00000100:00100000:2.0:1790740290.158086:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021989504 00000100:00100000:2.0:1790740290.158098:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021989504 00000100:00100000:2.0:1790740290.158133:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021989888 00000100:00100000:2.0:1790740290.158136:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021989888 00000100:00100000:2.0:1790740290.158152:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021990400 00000100:00100000:2.0:1790740290.158155:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021990400 00000100:00100000:2.0:1790740290.158172:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1790740290.158179:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877727021989504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740290.158258:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877727021989504:12345-0@lo:400:kworker.0 Request processed in 79us (2236us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740290.158264:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1790740290.158279:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1790740290.158285:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1877727021989888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740290.158311:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1877727021989888:12345-0@lo:400:kworker.0 Request processed in 27us (2083us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740290.158317:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1790740290.158328:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1790740290.158334:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1877727021990400:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1790740290.158621:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcb5df1180 x1877727021989888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740290.158635:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5df1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1877727021989888:0@lo:400:kworker.0 00000100:00100000:3.0:1790740290.158647:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877727021989504:0@lo:400:kworker.0 00000100:00080000:3.0:1790740290.158701:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790740290.158706:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790740290.158709:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790740290.158711:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790740290.158801:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1877727021990400:12345-0@lo:400:kworker.0 Request processed in 467us (2540us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740290.158808:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00010000:00080000:3.0:1790740290.159759:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcb5df0700 x1877727021990400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740290.159772:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5df0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1877727021990400:0@lo:400:kworker.0 00000100:00100000:2.0:1790740290.161982:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790740290.162001:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83c50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727021990656:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790740290.162090:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740290.162127:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021990656 00000100:00100000:2.0:1790740290.162134:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021990656 00000100:00100000:2.0:1790740290.162173:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1790740290.162188:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83c51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727021990656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790740290.162212:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790740290.162255:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83c51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727021990656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740290.162261:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:2.0:1790740290.162299:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83c50380 x1877727021990656/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740306 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740290.162318:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83c50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727021990656:0@lo:13:osp-pre-1-1.0 00000020:00000004:0.0:1790740290.313798:0:12819:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790740290.314287:0:12819:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790740291.052498:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740291.178235:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021990784:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790740291.178328:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740291.178420:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021990784 00000100:00100000:2.0:1790740291.178429:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021990784 00000100:00100000:2.0:1790740291.178474:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1790740291.178483:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727021990784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790740291.178515:0:6540:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790740291.178573:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727021990784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740291.178582:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1790740291.178673:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021990784:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1790740292.074608:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1790740292.460462:0:12917:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790740292.460783:0:12917:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790740293.101873:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740293.228458:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790740293.228493:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021990912:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790740293.228595:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740293.228734:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021990912 00000100:00100000:1.0:1790740293.228745:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021990912 00000100:00100000:1.0:1790740293.228814:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1790740293.228825:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb813b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021990912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790740293.228877:0:7846:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1790740293.228938:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb813b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021990912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740293.228947:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1790740293.229137:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021990912:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790740293.738495:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790740293.738527:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83c50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021991040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790740293.738628:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740293.738714:0:10118:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021991040 00000100:00100000:2.0:1790740293.738723:0:10118:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021991040 00000100:00100000:2.0:1790740293.738788:0:10118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1790740293.738800:0:10118:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5f6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021991040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790740293.738839:0:10118:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790740293.738888:0:10118:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5f6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021991040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740293.738922:0:10118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:2.0:1790740293.738959:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790740293.739009:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83c50380 x1877727021991040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740309 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740293.739061:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83c50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021991040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790740293.739512:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790740293.739526:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727021991168:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790740293.739567:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740293.739608:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021991168 00000100:00100000:1.0:1790740293.739613:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021991168 00000100:00100000:1.0:1790740293.739650:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1790740293.739657:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727021991168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790740293.739672:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790740293.739703:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727021991168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740293.739710:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:1.0:1790740293.739725:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790740293.739742:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcbd5fed80 x1877727021991168/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740309 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740293.739755:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727021991168:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1790740294.123584:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740295.082569:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740295.082621:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740295.082651:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740295.082672:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740295.082709:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740295.082764:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000938240 00000100:00100000:0.0:1790740295.082776:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000938240 00000100:00100000:0.0:1790740295.082849:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000938496 00000100:00100000:0.0:1790740295.082852:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000938496 00000100:00100000:0.0:1790740295.082868:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000938112 00000100:00100000:0.0:1790740295.082870:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000938112 00000100:00100000:0.0:1790740295.082883:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000938368 00000100:00100000:0.0:1790740295.082885:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000938368 00000100:00100000:0.0:1790740295.082902:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 180 00000100:00100000:0.0:1790740295.082913:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb8139c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+5:2405:x1877727000938240:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1790740295.083067:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb8139c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+5:2405:x1877727000938240:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 118us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740295.083075:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 180 00000100:00100000:2.0:1790740295.083081:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 181 00000100:00100000:2.0:1790740295.083091:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb8139880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2405:x1877727000938496:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1790740295.083094:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 182 00000100:00100000:0.0:1790740295.083100:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb813aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+6:2405:x1877727000938112:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1790740295.083123:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb8139880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2405:x1877727000938496:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 34us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740295.083123:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb813aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+6:2405:x1877727000938112:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 22us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740295.083130:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 182 00000100:00100000:1.0:1790740295.083189:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000937984 00000100:00100000:1.0:1790740295.083201:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000937984 00000100:00100000:1.0:1790740295.083238:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 313 00000100:00100000:1.0:1790740295.083244:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:2405:x1877727000937984:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1790740295.083274:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:2405:x1877727000937984:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 30us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740295.083280:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 313 00000100:00080000:1.0:1790740295.083491:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790740295.083497:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790740295.088195:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 181 00000100:00100000:1.0:1790740295.088898:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 183 00000100:00100000:1.0:1790740295.088925:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2405:x1877727000938368:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1790740295.089622:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2405:x1877727000938368:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 709us (6907us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740295.089646:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 183 00010000:00010000:1.0:1790740295.146359:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740295.274323:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790740295.274356:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021991296:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790740295.274473:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740295.274581:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021991296 00000100:00100000:2.0:1790740295.274591:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021991296 00000100:00100000:2.0:1790740295.274664:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790740295.274678:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5f6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021991296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790740295.274718:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790740295.274772:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5f6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021991296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740295.274781:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:2.0:1790740295.274832:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcb5f6ce00 x1877727021991296/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740311 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740295.274854:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021991296:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790740295.275119:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790740295.275130:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5df0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021991424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790740295.275167:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740295.275453:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3641:1877727021991552:0@lo:400:kworker.0 00000100:00100000:0.0:1790740295.275492:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740295.275521:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021992064:0@lo:400:kworker.0 00000100:00100000:0.0:1790740295.275558:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740295.275579:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021992576:0@lo:400:kworker.0 00000100:00100000:0.0:1790740295.275617:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740295.275653:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021991552 00000100:00100000:0.0:1790740295.275659:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021991552 00000100:00100000:0.0:1790740295.275698:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1790740295.275707:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3641:x1877727021991552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740295.275749:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3641:x1877727021991552:12345-0@lo:400:kworker.0 Request processed in 44us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740295.275757:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1790740295.275791:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021992064 00000100:00100000:0.0:1790740295.275795:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021992064 00000100:00100000:0.0:1790740295.275822:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1790740295.275828:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021992064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740295.275874:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021992064:12345-0@lo:400:kworker.0 Request processed in 35us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740295.275881:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1790740295.275900:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021992576 00000100:00100000:0.0:1790740295.275904:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021992576 00000100:00100000:0.0:1790740295.275933:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1790740295.275940:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021992576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740295.276326:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021992576:12345-0@lo:400:kworker.0 Request processed in 385us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740295.276334:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1790740295.276397:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3641:1877727021991552:0@lo:400:kworker.0 00000100:00100000:0.0:1790740295.276409:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021992064:0@lo:400:kworker.0 00010000:00080000:0.0:1790740295.276422:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcb5f6ca80 x1877727021992576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740295.276447:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021992576:0@lo:400:kworker.0 00000100:00100000:0.0:1790740295.276495:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727021991680:0@lo:400:kworker.0 00000100:00100000:0.0:1790740295.276527:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740295.276615:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877727021992192:0@lo:400:kworker.0 00000100:00100000:0.0:1790740295.276638:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740295.276655:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1877727021992704:0@lo:400:kworker.0 00000100:00100000:0.0:1790740295.276676:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740295.276695:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1790740295.276701:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021991808:0@lo:400:kworker.0 00000100:00100000:0.0:1790740295.276724:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740295.276742:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1877727021992320:0@lo:400:kworker.0 00000100:00100000:0.0:1790740295.276764:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740295.276780:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83c50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1877727021992832:0@lo:400:kworker.0 00000100:00100000:0.0:1790740295.276802:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740295.276825:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021991808 00000100:00100000:0.0:1790740295.276830:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021991808 00000100:00100000:0.0:1790740295.276857:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1790740295.277111:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021991808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740295.277161:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021991808:12345-0@lo:400:kworker.0 Request processed in 298us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740295.277168:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1790740295.277199:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021991808:0@lo:400:kworker.0 00000100:00100000:0.0:1790740295.277219:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021991680 00000100:00100000:0.0:1790740295.277232:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021991680 00000100:00100000:0.0:1790740295.277252:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021992192 00000100:00100000:0.0:1790740295.277255:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021992192 00000100:00100000:0.0:1790740295.277269:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021992704 00000100:00100000:0.0:1790740295.277272:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021992704 00000100:00100000:0.0:1790740295.277282:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021992320 00000100:00100000:0.0:1790740295.277284:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021992320 00000100:00100000:0.0:1790740295.277295:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021992832 00000100:00100000:0.0:1790740295.277297:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021992832 00000100:00100000:0.0:1790740295.277312:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1790740295.277318:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727021991680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740295.277357:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727021991680:12345-0@lo:400:kworker.0 Request processed in 39us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740295.277363:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1790740295.277458:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877727021991936:0@lo:400:kworker.0 00000100:00100000:2.0:1790740295.277499:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740295.277515:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021992448:0@lo:400:kworker.0 00000100:00100000:2.0:1790740295.277553:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740295.277591:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021992448 00000100:00100000:2.0:1790740295.277595:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021992448 00000100:00100000:2.0:1790740295.277626:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1790740295.277634:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021992448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740295.277671:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021992448:12345-0@lo:400:kworker.0 Request processed in 38us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740295.277677:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:2.0:1790740295.277708:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcb5f6e300 x1877727021992448/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740295.277719:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021992448:0@lo:400:kworker.0 00000100:00100000:2.0:1790740295.277757:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021991936 00000100:00100000:2.0:1790740295.277761:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021991936 00000100:00100000:2.0:1790740295.277779:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1790740295.277785:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877727021992192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740295.277819:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877727021992192:12345-0@lo:400:kworker.0 Request processed in 33us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740295.277825:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1790740295.277837:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1790740295.277843:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5f6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877727021992704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740295.278122:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5f6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877727021992704:12345-0@lo:400:kworker.0 Request processed in 278us (1444us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740295.278143:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1790740295.278159:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1790740295.278165:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877727021992320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740295.278198:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877727021992320:12345-0@lo:400:kworker.0 Request processed in 34us (1433us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740295.278204:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1790740295.278216:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1790740295.278221:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ee9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877727021992832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740295.278250:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ee9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877727021992832:12345-0@lo:400:kworker.0 Request processed in 29us (1447us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740295.278256:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1790740295.278267:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1790740295.278274:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877727021991936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740295.278308:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877727021991936:12345-0@lo:400:kworker.0 Request processed in 35us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740295.278314:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1790740295.278343:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877727021991936:0@lo:400:kworker.0 00000100:00100000:1.0:1790740295.278533:0:10118:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021991424 00000100:00100000:1.0:1790740295.278549:0:10118:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021991424 00000100:00100000:1.0:1790740295.278591:0:10118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1790740295.278599:0:10118:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021991424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790740295.278618:0:10118:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:2.0:1790740295.278667:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcb5f6ed80 x1877727021992320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740295.278680:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1877727021992320:0@lo:400:kworker.0 00000100:00080000:3.0:1790740295.278764:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790740295.278770:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790740295.278782:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790740295.278784:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790740295.282255:0:10118:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021991424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3644us (7073us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740295.282275:0:10118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:0.0:1790740295.282939:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcb5df0700 x1877727021991424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740311 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740295.282988:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5df0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021991424:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1790740295.286582:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83c50380 x1877727021992832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740295.286607:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83c50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1877727021992832:0@lo:400:kworker.0 00000100:00100000:2.0:1790740295.286657:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727021991680:0@lo:400:kworker.0 00000100:00100000:2.0:1790740295.286671:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877727021992192:0@lo:400:kworker.0 00000100:00100000:2.0:1790740295.286684:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1877727021992704:0@lo:400:kworker.0 00000001:00100000:2.0:1790740295.795822:0:8446:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4188ca3f-be2e-4a39-97db-9401a3b70751 00000020:00000080:2.0:1790740295.795836:0:8446:0:(genops.c:885:class_export_put()) final put ffff98db83e38000/4188ca3f-be2e-4a39-97db-9401a3b70751 00000020:00000080:3.0:1790740295.796394:0:11805:0:(genops.c:844:class_export_destroy()) destroying export ffff98db83e38000/4188ca3f-be2e-4a39-97db-9401a3b70751 for lustre-OST0000 00000020:00000080:3.0:1790740295.796669:0:11805:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98db83e3a800 for lustre-OST0000 00000001:00100000:1.0:1790740295.801414:0:9531:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4188ca3f-be2e-4a39-97db-9401a3b70751 00000020:00000080:1.0:1790740295.801424:0:9531:0:(genops.c:885:class_export_put()) final put ffff98dcbfc4d000/4188ca3f-be2e-4a39-97db-9401a3b70751 00000020:00000080:1.0:1790740295.801483:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98dcbfc4d000/4188ca3f-be2e-4a39-97db-9401a3b70751 for lustre-OST0001 00000020:00000080:1.0:1790740295.801530:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98dcbfc49000 for lustre-OST0001 00010000:00010000:1.0:1790740296.171664:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790740296.274475:0:13061:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1790740296.298649:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5df0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021992960:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790740296.298722:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740296.298797:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021992960 00000100:00100000:0.0:1790740296.298805:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021992960 00000100:00100000:0.0:1790740296.298994:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1790740296.299004:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5f6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021992960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790740296.299062:0:7846:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1790740296.299184:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5f6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021992960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 180us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740296.300182:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5df0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021992960:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790740296.301324:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00010000:00010000:3.0:1790740297.195396:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740298.218529:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740298.353049:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790740298.353074:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021993088:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790740298.353160:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740298.353522:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021993088 00000100:00100000:2.0:1790740298.353532:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021993088 00000100:00100000:2.0:1790740298.353582:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1790740298.353591:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021993088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790740298.353628:0:6541:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1790740298.356751:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021993088:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790740298.359634:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021993088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 6034us (6465us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740298.359651:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1790740298.861014:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021993216:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790740298.861122:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740298.861192:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021993216 00000100:00100000:2.0:1790740298.861200:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021993216 00000100:00100000:2.0:1790740298.861261:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790740298.861272:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021993216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790740298.861302:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790740298.861349:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021993216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740298.861356:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:2.0:1790740298.861425:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83e1c380 x1877727021993216/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740314 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740298.861443:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021993216:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790740298.861557:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021993344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790740298.861589:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790740298.861623:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790740298.861636:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021993344 00000100:00100000:3.0:1790740298.861639:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021993344 00000100:00100000:3.0:1790740298.861671:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1790740298.861678:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727021993344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790740298.861690:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790740298.861722:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727021993344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740298.861729:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1790740298.861746:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790740298.861762:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcbd551500 x1877727021993344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740314 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740298.861773:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727021993344:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790740299.242438:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790740299.840578:0:13209:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff6a24c910 20000000:00000080:1.0:1790740299.840606:0:13209:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98db83c8e000 uarg=0000000000000000 20000000:01000000:1.0:1790740299.840666:0:13209:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1790740299.840675:0:13209:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1790740299.840681:0:13209:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1790740299.841308:0:13210:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1790740299.841569:0:13209:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1790740299.859457:0:13209:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1790740299.859491:0:13209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98dcbfc45400/0xb25dda4f4e92dc45 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740299.859512:0:13209:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dcaf061a00/0xb25dda4f4e92dbdc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92dbd5 expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740299.859520:0:13209:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dc80030400/0xb25dda4f4e92dbea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92dbe3 expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740299.859528:0:13209:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dcaf060800/0xb25dda4f4e92dbf8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92dbf1 expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740299.859534:0:13209:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dc80031c00/0xb25dda4f4e92dc06 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92dbff expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740299.859545:0:13209:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dc80030000/0xb25dda4f4e92dc0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23b73 expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740299.859551:0:13209:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dcc2174600/0xb25dda4f4e92dc22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23bb2 expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740299.859578:0:13209:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98dcbfc45400/0xb25dda4f4e92dc45 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740299.859619:0:13209:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dcc2174600/0xb25dda4f4e92dc22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23bb2 expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740299.859635:0:13209:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98dcc2174600/0xb25dda4f4e92dc22 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23bb2 expref: 12 pid: 6529 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740299.859649:0:13209:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5f9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13209:1877727021993472:192.168.204.3@tcp:104: 00010000:00010000:1.0:1790740299.859756:0:13209:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dc80030000/0xb25dda4f4e92dc0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23b73 expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740299.859764:0:13209:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98dc80030000/0xb25dda4f4e92dc0d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23b73 expref: 12 pid: 6528 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740299.859772:0:13209:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5fb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13209:1877727021993600:192.168.204.3@tcp:104: 00010000:00010000:1.0:1790740299.859796:0:13209:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dc80031c00/0xb25dda4f4e92dc06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92dbff expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740299.859803:0:13209:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98dc80031c00/0xb25dda4f4e92dc06 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92dbff expref: 23 pid: 6528 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740299.859812:0:13209:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5f9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13209:1877727021993728:0@lo:104: 00000100:00100000:1.0:1790740299.859849:0:13209:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790740299.859892:0:13209:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dcaf060800/0xb25dda4f4e92dbf8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92dbf1 expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740299.859978:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021993728 00000100:00100000:3.0:1790740299.859987:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021993728 00000100:00100000:3.0:1790740299.860071:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790740299.860089:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+3:13209:x1877727021993728:12345-0@lo:104: 00010000:00010000:3.0:1790740299.860105:0:6518:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff98dc80031800/0xb25dda4f4e92dbff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92dc06 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740299.860175:0:6518:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790740299.860181:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+3:13209:x1877727021993728:12345-0@lo:104: Request processed in 97us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740299.860188:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:2.0:1790740299.860478:0:10357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790740299.860493:0:10357:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dc80031800/0xb25dda4f4e92dbff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92dc06 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740299.860506:0:10357:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dc80031800 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:2.0:1790740299.860511:0:10357:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dc80031800/0xb25dda4f4e92dbff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92dc06 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740299.860522:0:10357:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dc80031800/0xb25dda4f4e92dbff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92dc06 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790740299.860530:0:10357:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dc80031800/0xb25dda4f4e92dbff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92dc06 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740299.860538:0:10357:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790740299.860595:0:10357:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dc80031800/0xb25dda4f4e92dbff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92dc06 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740299.860603:0:10357:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790740299.860639:0:10357:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dc80031800/0xb25dda4f4e92dbff lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92dc06 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740299.860648:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dc80031800/0xb25dda4f4e92dbff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92dc06 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740299.860667:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740299.860692:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740299.860694:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740299.860821:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727021993984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790740299.860902:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740299.862527:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021993984 00000100:00100000:2.0:1790740299.862546:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021993984 00010000:00010000:2.0:1790740299.862615:0:6522:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dc80031c00/0xb25dda4f4e92dc06 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92dbff expref: 24 pid: 6528 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740299.862662:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790740299.862682:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd551500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3640:x1877727021993984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790740299.862702:0:6522:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740299.862708:0:6522:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dc80031c00/0xb25dda4f4e92dc06 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92dbff expref: 24 pid: 6528 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740299.865269:0:13209:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98dcaf060800/0xb25dda4f4e92dbf8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92dbf1 expref: 24 pid: 6528 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740299.865300:0:13209:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5f9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13209:1877727021993856:0@lo:104: 00000100:00100000:1.0:1790740299.865402:0:13209:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790740299.865920:0:6522:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dc80031c00/0xb25dda4f4e92dc06 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92dbff expref: 24 pid: 6528 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740299.865935:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00010000:00010000:2.0:1790740299.865970:0:6522:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740299.865982:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740299.866013:0:9550:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000938752 00000100:00100000:0.0:1790740299.866021:0:9550:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000938752 00010000:00010000:0.0:1790740299.866074:0:9550:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dc80030000/0xb25dda4f4e92dc0d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23b73 expref: 13 pid: 6528 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740299.866104:0:9550:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000938624 00000100:00100000:0.0:1790740299.866107:0:9550:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000938624 00010000:00010000:0.0:1790740299.866121:0:9550:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dcc2174600/0xb25dda4f4e92dc22 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23bb2 expref: 14 pid: 6529 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740299.866145:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 41 00000100:00100000:0.0:1790740299.866154:0:9550:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:160ca934-a0b3-4cb3-b255-c8d008823f6f+14:2402:x1877727000938752:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790740299.866168:0:9550:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740299.866174:0:9550:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dc80030000/0xb25dda4f4e92dc0d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23b73 expref: 14 pid: 6528 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740299.866184:0:9550:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dc80030000/0xb25dda4f4e92dc0d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23b73 expref: 14 pid: 6528 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740299.866202:0:9550:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740299.866248:0:9550:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:160ca934-a0b3-4cb3-b255-c8d008823f6f+14:2402:x1877727000938752:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 92us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740299.866255:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 41 00000100:00100000:0.0:1790740299.866273:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 42 00000100:00100000:0.0:1790740299.866279:0:9550:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5f6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:2402:x1877727000938624:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790740299.866286:0:9550:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740299.866290:0:9550:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dcc2174600/0xb25dda4f4e92dc22 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23bb2 expref: 13 pid: 6529 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740299.866312:0:9550:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dcc2174600/0xb25dda4f4e92dc22 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23bb2 expref: 13 pid: 6529 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740299.866321:0:9550:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740299.866339:0:9550:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5f6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:2402:x1877727000938624:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 61us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740299.866345:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 42 00000100:00100000:2.0:1790740299.867076:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd551500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3640:x1877727021993984:12345-0@lo:103:ldlm_bl.0 Request processed in 4399us (6168us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740299.867091:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790740299.867280:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727021993984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790740299.869592:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021993856 00000100:00100000:3.0:1790740299.869613:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021993856 00000100:00100000:3.0:1790740299.869713:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790740299.869727:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+3:13209:x1877727021993856:12345-0@lo:104: 00010000:00010000:3.0:1790740299.869753:0:6518:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff98dc81489c00/0xb25dda4f4e92dbf1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92dbf8 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740299.869909:0:6518:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790740299.869916:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+3:13209:x1877727021993856:12345-0@lo:104: Request processed in 192us (4514us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740299.869923:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:0.0:1790740299.870083:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790740299.870093:0:6524:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dc81489c00/0xb25dda4f4e92dbf1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92dbf8 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740299.870102:0:6524:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dc81489c00 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:0.0:1790740299.870106:0:6524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dc81489c00/0xb25dda4f4e92dbf1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92dbf8 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740299.870117:0:6524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dc81489c00/0xb25dda4f4e92dbf1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92dbf8 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790740299.870126:0:6524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dc81489c00/0xb25dda4f4e92dbf1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92dbf8 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740299.870133:0:6524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790740299.870185:0:6524:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dc81489c00/0xb25dda4f4e92dbf1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92dbf8 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740299.870192:0:6524:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790740299.870217:0:6524:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dc81489c00/0xb25dda4f4e92dbf1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92dbf8 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740299.870245:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dc81489c00/0xb25dda4f4e92dbf1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92dbf8 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740299.870261:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740299.870264:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740299.870265:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740299.870276:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3641:1877727021994112:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790740299.870394:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740299.870614:0:9550:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021994112 00000100:00100000:0.0:1790740299.870621:0:9550:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021994112 00010000:00010000:0.0:1790740299.870649:0:9550:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dcaf060800/0xb25dda4f4e92dbf8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92dbf1 expref: 24 pid: 6528 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740299.870687:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790740299.870696:0:9550:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd551180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3641:x1877727021994112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790740299.870712:0:9550:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740299.870718:0:9550:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dcaf060800/0xb25dda4f4e92dbf8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92dbf1 expref: 24 pid: 6528 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740299.870732:0:9550:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dcaf060800/0xb25dda4f4e92dbf8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92dbf1 expref: 24 pid: 6528 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740299.870756:0:9550:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740299.870804:0:9550:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd551180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3641:x1877727021994112:12345-0@lo:103:ldlm_bl.0 Request processed in 110us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740299.870811:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790740299.871089:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3641:1877727021994112:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790740299.876835:0:13209:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dc80030400/0xb25dda4f4e92dbea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92dbe3 expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740299.876872:0:13209:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98dc80030400/0xb25dda4f4e92dbea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92dbe3 expref: 23 pid: 6530 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740299.876908:0:13209:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13209:1877727021994240:0@lo:104: 00000100:00100000:0.0:1790740299.876979:0:13209:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790740299.877090:0:13209:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dcaf061a00/0xb25dda4f4e92dbdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92dbd5 expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740299.877100:0:13209:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98dcaf061a00/0xb25dda4f4e92dbdc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92dbd5 expref: 23 pid: 6530 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740299.877120:0:13209:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13209:1877727021994368:0@lo:104: 00000100:00100000:0.0:1790740299.877144:0:13209:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740299.877170:0:13209:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db8444acc0 going to sleep for 11 seconds 00010000:00010000:0.0:1790740299.877203:0:13209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcc2174600/0xb25dda4f4e92dc22 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23bb2 expref: 12 pid: 6529 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740299.877211:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021994240 00000100:00100000:0.0:1790740299.877223:0:13209:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5f9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13209:1877727021993472:192.168.204.3@tcp:104: 00000100:00100000:2.0:1790740299.877227:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021994240 00010000:00010000:0.0:1790740299.877241:0:13209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dc80030000/0xb25dda4f4e92dc0d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23b73 expref: 11 pid: 6528 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740299.877254:0:13209:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5fb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13209:1877727021993600:192.168.204.3@tcp:104: 00010000:00010000:0.0:1790740299.877265:0:13209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dc80031c00/0xb25dda4f4e92dc06 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92dbff expref: 23 pid: 6528 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740299.877275:0:13209:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5f9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13209:1877727021993728:0@lo:104: 00010000:00010000:0.0:1790740299.877288:0:13209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcaf060800/0xb25dda4f4e92dbf8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92dbf1 expref: 22 pid: 6528 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740299.877293:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021994368 00000100:00100000:2.0:1790740299.877299:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021994368 00000100:00100000:0.0:1790740299.877299:0:13209:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5f9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13209:1877727021993856:0@lo:104: 00000100:00100000:2.0:1790740299.877334:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790740299.877347:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5f6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+4:13209:x1877727021994240:12345-0@lo:104: 00010000:00010000:2.0:1790740299.877369:0:6518:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff98dcaf060e00/0xb25dda4f4e92dbe3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92dbea expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740299.877512:0:6518:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1790740299.877523:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790740299.877534:0:6523:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dcaf060e00/0xb25dda4f4e92dbe3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92dbea expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740299.877545:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5f6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+4:13209:x1877727021994240:12345-0@lo:104: Request processed in 197us (561us total) trans 0 rc 0/0 00010000:00010000:1.0:1790740299.877551:0:6523:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf060e00 already unused, calling callback (ffffffffc1355c20) 00000100:00100000:2.0:1790740299.877559:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 10000000:00010000:1.0:1790740299.877560:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dcaf060e00/0xb25dda4f4e92dbe3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92dbea expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740299.877579:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dcaf060e00/0xb25dda4f4e92dbe3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92dbea expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790740299.877588:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dcaf060e00/0xb25dda4f4e92dbe3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92dbea expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740299.877589:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790740299.877601:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+3:13209:x1877727021994368:12345-0@lo:104: 10000000:01000000:1.0:1790740299.877606:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790740299.877614:0:6518:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff98dc81488600/0xb25dda4f4e92dbd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92dbdc expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740299.877656:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dcaf060e00/0xb25dda4f4e92dbe3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92dbea expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740299.877663:0:6518:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1790740299.877668:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1790740299.877671:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+3:13209:x1877727021994368:12345-0@lo:104: Request processed in 72us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740299.877690:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1790740299.877701:0:6523:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dcaf060e00/0xb25dda4f4e92dbe3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92dbea expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740299.877711:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dcaf060e00/0xb25dda4f4e92dbe3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92dbea expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740299.877728:0:10357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790740299.877736:0:10357:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dc81488600/0xb25dda4f4e92dbd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92dbdc expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740299.877741:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740299.877749:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740299.877750:0:10357:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dc81488600 already unused, calling callback (ffffffffc1355c20) 00010000:00010000:1.0:1790740299.877755:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:2.0:1790740299.877758:0:10357:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dc81488600/0xb25dda4f4e92dbd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92dbdc expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740299.877769:0:10357:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dc81488600/0xb25dda4f4e92dbd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92dbdc expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740299.877777:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727021994496:0@lo:103:ldlm_bl.0 10000000:00010000:2.0:1790740299.877782:0:10357:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dc81488600/0xb25dda4f4e92dbd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92dbdc expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740299.877791:0:10357:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1790740299.877823:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790740299.877828:0:10357:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dc81488600/0xb25dda4f4e92dbd5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92dbdc expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740299.877850:0:10357:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790740299.877873:0:10357:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dc81488600/0xb25dda4f4e92dbd5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92dbdc expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740299.877878:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1790740299.877882:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dc81488600/0xb25dda4f4e92dbd5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92dbdc expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740299.877890:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727021994624:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790740299.877910:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740299.877915:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740299.877917:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740299.877925:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740299.877965:0:6520:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021994496 00000100:00100000:1.0:1790740299.877972:0:6520:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021994496 00010000:00010000:1.0:1790740299.877998:0:6520:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dc80030400/0xb25dda4f4e92dbea lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92dbe3 expref: 22 pid: 6530 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740299.878054:0:6520:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021994624 00000100:00100000:1.0:1790740299.878057:0:6520:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021994624 00010000:00010000:1.0:1790740299.878068:0:6520:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dcaf061a00/0xb25dda4f4e92dbdc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92dbd5 expref: 23 pid: 6530 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740299.878089:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790740299.878097:0:6520:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:3638:x1877727021994496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790740299.878117:0:6520:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740299.878122:0:6520:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dc80030400/0xb25dda4f4e92dbea lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92dbe3 expref: 23 pid: 6530 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740299.878135:0:6520:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dc80030400/0xb25dda4f4e92dbea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92dbe3 expref: 23 pid: 6530 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740299.878156:0:6520:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790740299.878204:0:13209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dc80030400/0xb25dda4f4e92dbea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92dbe3 expref: 23 pid: 6530 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740299.878221:0:13209:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13209:1877727021994240:0@lo:104: 00000100:00100000:2.0:1790740299.878380:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790740299.878402:0:10416:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc86ac3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+22:3638:x1877727021994624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790740299.878419:0:10416:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740299.878425:0:10416:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dcaf061a00/0xb25dda4f4e92dbdc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92dbd5 expref: 22 pid: 6530 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740299.878436:0:10416:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dcaf061a00/0xb25dda4f4e92dbdc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92dbd5 expref: 22 pid: 6530 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740299.878466:0:10416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98dcbfc45400/0xb25dda4f4e92dc45 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740299.878475:0:10416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcbfc45400/0xb25dda4f4e92dc45 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740299.878494:0:10416:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98dcbfc45400/0xb25dda4f4e92dc45 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740299.878502:0:10416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98dcbfc45400/0xb25dda4f4e92dc45 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740299.878517:0:10416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98dcbfc45400/0xb25dda4f4e92dc45 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740299.878535:0:10416:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98dcbfc45400/0xb25dda4f4e92dc45 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740299.878541:0:10416:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc45400 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:2.0:1790740299.878545:0:10416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98dcbfc45400/0xb25dda4f4e92dc45 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740299.878553:0:10416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98dcbfc45400/0xb25dda4f4e92dc45 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740299.878562:0:10416:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98dcbfc45400/0xb25dda4f4e92dc45 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740299.878580:0:10416:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790740299.879807:0:13209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcaf061a00/0xb25dda4f4e92dbdc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92dbd5 expref: 22 pid: 6530 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740299.879829:0:13209:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13209:1877727021994368:0@lo:104: 00010000:00010000:0.0:1790740299.879894:0:13209:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98dcbfc45400/0xb25dda4f4e92dc45 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740299.879908:0:13209:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98dcbfc45400/0xb25dda4f4e92dc45 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740299.879986:0:13209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98dcbfc45400/0xb25dda4f4e92dc45 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740299.879993:0:13209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcbfc45400/0xb25dda4f4e92dc45 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740299.881469:0:10416:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc86ac3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:3638:x1877727021994624:12345-0@lo:103:ldlm_bl.0 Request processed in 3056us (3530us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740299.881510:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790740299.881547:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727021994624:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790740299.884471:0:6520:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+20:3638:x1877727021994496:12345-0@lo:103:ldlm_bl.0 Request processed in 6364us (6637us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740299.884488:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790740299.884813:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727021994496:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790740300.189951:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740300.189987:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740300.190019:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740300.190068:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740300.190102:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740300.190138:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000939136 00000100:00100000:0.0:1790740300.190149:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000939136 00000100:00100000:0.0:1790740300.190204:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000939392 00000100:00100000:0.0:1790740300.190207:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000939392 00000100:00100000:0.0:1790740300.190221:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000939008 00000100:00100000:0.0:1790740300.190239:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000939008 00000100:00100000:0.0:1790740300.190255:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000939264 00000100:00100000:0.0:1790740300.190258:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000939264 00000100:00100000:0.0:1790740300.190273:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 190 00000100:00100000:0.0:1790740300.190283:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5f6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+5:2403:x1877727000939136:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1790740300.190365:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5f6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+5:2403:x1877727000939136:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 84us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740300.190373:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 190 00000100:00100000:0.0:1790740300.190390:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 191 00000100:00100000:0.0:1790740300.190396:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5f6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2403:x1877727000939392:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1790740300.190424:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5f6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2403:x1877727000939392:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 28us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740300.190431:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 191 00000100:00100000:0.0:1790740300.190443:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 192 00000100:00100000:0.0:1790740300.190448:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+6:2403:x1877727000939008:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1790740300.190472:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+6:2403:x1877727000939008:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 24us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740300.190477:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 192 00000100:00100000:1.0:1790740300.190537:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000938880 00000100:00100000:1.0:1790740300.190541:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000938880 00000100:00100000:1.0:1790740300.190573:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 315 00000100:00100000:1.0:1790740300.190580:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+11:2403:x1877727000938880:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1790740300.190604:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+11:2403:x1877727000938880:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 26us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740300.190610:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 315 00000100:00100000:3.0:1790740300.190706:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 193 00000100:00100000:3.0:1790740300.190716:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5f6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2403:x1877727000939264:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740300.190757:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5f6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2403:x1877727000939264:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 44us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740300.190763:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 193 00000100:00080000:3.0:1790740300.191462:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790740300.191468:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1790740300.266365:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740300.394437:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021994752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790740300.394532:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740300.394979:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021995008:0@lo:400:kworker.0 00000100:00100000:0.0:1790740300.395018:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740300.395061:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb81b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1877727021995520:0@lo:400:kworker.0 00000100:00100000:0.0:1790740300.395086:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740300.395111:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb81b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1877727021996032:0@lo:400:kworker.0 00000100:00100000:0.0:1790740300.395131:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740300.395171:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877727021994880:0@lo:400:kworker.0 00000100:00100000:0.0:1790740300.395172:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1790740300.395182:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877727021995136:0@lo:400:kworker.0 00000100:00100000:3.0:1790740300.395218:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740300.395234:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021995008 00000100:00100000:0.0:1790740300.395256:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021995008 00000100:00100000:3.0:1790740300.395266:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb81b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1877727021995392:0@lo:400:kworker.0 00000100:00100000:3.0:1790740300.395298:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740300.395321:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1790740300.395323:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb81b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1877727021995904:0@lo:400:kworker.0 00000100:00100000:0.0:1790740300.395334:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaefd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021995008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740300.395348:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740300.395370:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1790740300.395378:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb81b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021995264:0@lo:400:kworker.0 00000100:00100000:0.0:1790740300.395396:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaefd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021995008:12345-0@lo:400:kworker.0 Request processed in 64us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740300.395405:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1790740300.395413:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740300.395431:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb81b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021995776:0@lo:400:kworker.0 00000100:00100000:3.0:1790740300.395456:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740300.395492:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021994752 00000100:00100000:3.0:1790740300.395497:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021994752 00000100:00100000:3.0:1790740300.395543:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1790740300.395551:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021994752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790740300.395572:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790740300.395611:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021994752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740300.395618:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1790740300.395637:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021995776 00000100:00100000:3.0:1790740300.395640:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021995776 00000100:00100000:3.0:1790740300.395665:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790740300.395673:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd553100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021995776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740300.395704:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd553100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021995776:12345-0@lo:400:kworker.0 Request processed in 32us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740300.395710:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790740300.395734:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021995520 00000100:00100000:3.0:1790740300.395737:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021995520 00000100:00100000:3.0:1790740300.395757:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021996032 00000100:00100000:3.0:1790740300.395759:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021996032 00000100:00100000:3.0:1790740300.395772:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021994880 00000100:00100000:3.0:1790740300.395775:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021994880 00000100:00100000:3.0:1790740300.395784:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021995392 00000100:00100000:3.0:1790740300.395786:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021995392 00000100:00100000:3.0:1790740300.395808:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021995904 00000100:00100000:3.0:1790740300.395811:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021995904 00000100:00100000:3.0:1790740300.395826:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1790740300.395832:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaefd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877727021995520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740300.395883:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaefd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877727021995520:12345-0@lo:400:kworker.0 Request processed in 51us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740300.395889:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1790740300.395901:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1790740300.395906:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaefdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877727021996032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740300.395939:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021995264 00000100:00100000:0.0:1790740300.395945:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021995264 00000100:00100000:3.0:1790740300.395950:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaefdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877727021996032:12345-0@lo:400:kworker.0 Request processed in 42us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740300.395968:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1790740300.395976:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021995264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740300.396010:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021995264:12345-0@lo:400:kworker.0 Request processed in 35us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740300.396016:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1790740300.396062:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1790740300.396070:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877727021994880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740300.396115:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877727021994880:12345-0@lo:400:kworker.0 Request processed in 47us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740300.396122:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1790740300.396136:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1790740300.396142:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1877727021995392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740300.396169:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1877727021995392:12345-0@lo:400:kworker.0 Request processed in 27us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740300.396174:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1790740300.396194:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1790740300.396201:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1877727021995904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740300.396230:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1877727021995904:12345-0@lo:400:kworker.0 Request processed in 30us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740300.396236:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1790740300.396356:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb81b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021995264:0@lo:400:kworker.0 00010000:00080000:1.0:1790740300.396371:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcb81b5880 x1877727021995776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740300.396382:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb81b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021995776:0@lo:400:kworker.0 00000100:00100000:1.0:1790740300.396393:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877727021994880:0@lo:400:kworker.0 00000100:00100000:1.0:1790740300.396401:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb81b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1877727021995392:0@lo:400:kworker.0 00000100:00100000:1.0:1790740300.396410:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb81b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1877727021995904:0@lo:400:kworker.0 00000100:00100000:1.0:1790740300.396430:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790740300.396437:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021996288:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790740300.396466:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740300.396497:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021996288 00000100:00100000:1.0:1790740300.396502:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021996288 00000100:00100000:1.0:1790740300.396614:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1790740300.396627:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021996288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790740300.396650:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790740300.396685:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727021996288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740300.396691:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:1.0:1790740300.396717:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcbd5f8e00 x1877727021996288/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740316 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740300.396733:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727021996288:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1790740300.397346:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83cc4000 x1877727021994752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740316 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740300.397363:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021994752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790740300.397407:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740300.397438:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb81b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021995648:0@lo:400:kworker.0 00000100:00100000:2.0:1790740300.397481:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740300.397500:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021996160:0@lo:400:kworker.0 00000100:00100000:2.0:1790740300.397521:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740300.397560:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021995008:0@lo:400:kworker.0 00010000:00080000:2.0:1790740300.397573:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcb81b6680 x1877727021995520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740300.397582:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb81b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1877727021995520:0@lo:400:kworker.0 00010000:00080000:2.0:1790740300.397593:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcb81b7b80 x1877727021996032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740300.397603:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb81b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1877727021996032:0@lo:400:kworker.0 00000100:00100000:2.0:1790740300.397629:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021995648 00000100:00100000:2.0:1790740300.397634:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021995648 00000100:00100000:2.0:1790740300.397671:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021996160 00000100:00100000:2.0:1790740300.397675:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021996160 00000100:00100000:2.0:1790740300.397695:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1790740300.397702:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021995648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740300.397758:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021995648:12345-0@lo:400:kworker.0 Request processed in 56us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740300.397765:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1790740300.397781:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1790740300.397788:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021996160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740300.397816:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021996160:12345-0@lo:400:kworker.0 Request processed in 29us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740300.397823:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1790740300.397870:0:6536:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1790740300.397879:0:6536:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_004' 00010000:00080000:2.0:1790740300.397986:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcb81b6d80 x1877727021995648/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740300.397996:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb81b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021995648:0@lo:400:kworker.0 00010000:00080000:2.0:1790740300.398005:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcaefdb100 x1877727021996160/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740300.398014:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021996160:0@lo:400:kworker.0 00000100:00100000:2.0:1790740300.398055:0:7760:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1790740300.398062:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021995136 00000100:00100000:2.0:1790740300.398065:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021995136 00000100:00080000:0.0:1790740300.398435:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790740300.398442:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790740300.398445:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790740300.398447:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790740300.402118:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1790740300.403007:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1790740300.403026:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877727021995136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740300.403168:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877727021995136:12345-0@lo:400:kworker.0 Request processed in 152us (5759us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740300.403176:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1790740300.403375:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877727021995136:0@lo:400:kworker.0 00000100:00100000:2.0:1790740301.016808:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740301.016972:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000939520 00000100:00100000:1.0:1790740301.016993:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000939520 00000100:00100000:1.0:1790740301.017117:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 316 00000100:00100000:1.0:1790740301.017136:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+11:6199:x1877727000939520:12345-192.168.204.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790740301.017163:0:6529:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740301.017204:0:6529:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcbfc44400/0xb25dda4f4e92dc4c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23be3 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740301.017246:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcbfc44400/0xb25dda4f4e92dc4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23be3 expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740301.017261:0:6529:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcbfc44400/0xb25dda4f4e92dc4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23be3 expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740301.017287:0:6529:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcbfc44400, rc 0) 00000100:00100000:1.0:1790740301.017385:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+12:6199:x1877727000939520:12345-192.168.204.3@tcp:101:ll_cfg_requeue.0 Request processed in 251us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740301.017393:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 316 00000100:00100000:1.0:1790740301.021688:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740301.021883:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000939648 00000100:00100000:2.0:1790740301.021897:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000939648 00000100:00100000:2.0:1790740301.021974:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 317 00000100:00100000:2.0:1790740301.021985:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+12:6199:x1877727000939648:12345-192.168.204.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790740301.022232:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+12:6199:x1877727000939648:12345-192.168.204.3@tcp:501:ll_cfg_requeue.0 Request processed in 248us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740301.022241:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 317 00000100:00100000:1.0:1790740301.024155:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740301.024289:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000939776 00000100:00100000:3.0:1790740301.024301:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000939776 00000100:00100000:3.0:1790740301.024356:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 318 00000100:00100000:3.0:1790740301.024365:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+12:6199:x1877727000939776:12345-192.168.204.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790740301.024529:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+12:6199:x1877727000939776:12345-192.168.204.3@tcp:503:ll_cfg_requeue.0 Request processed in 164us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740301.024538:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 318 00000100:00100000:3.0:1790740301.036014:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740301.042705:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000939904 00000100:00100000:2.0:1790740301.042727:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000939904 00000100:00100000:2.0:1790740301.044156:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 319 00000100:00100000:2.0:1790740301.044178:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+12:6199:x1877727000939904:12345-192.168.204.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790740301.044205:0:6530:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740301.044229:0:6530:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98db83f33800/0xb25dda4f4e92dc53 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23bea expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740301.044283:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98db83f33800/0xb25dda4f4e92dc53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23bea expref: 13 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740301.044296:0:6530:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98db83f33800/0xb25dda4f4e92dc53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23bea expref: 13 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740301.044306:0:6530:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f33800, rc 0) 00000100:00100000:2.0:1790740301.044393:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:6199:x1877727000939904:12345-192.168.204.3@tcp:101:ll_cfg_requeue.0 Request processed in 224us (8396us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740301.044402:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 319 00000100:00100000:3.0:1790740301.049490:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740301.049790:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000940032 00000100:00100000:2.0:1790740301.049804:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000940032 00000100:00100000:2.0:1790740301.049890:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 320 00000100:00100000:2.0:1790740301.049902:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:6199:x1877727000940032:12345-192.168.204.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790740301.050320:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:6199:x1877727000940032:12345-192.168.204.3@tcp:501:ll_cfg_requeue.0 Request processed in 419us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740301.050329:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 320 00000100:00100000:3.0:1790740301.052836:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740301.053109:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000940160 00000100:00100000:1.0:1790740301.053122:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000940160 00000100:00100000:1.0:1790740301.053199:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 321 00000100:00100000:1.0:1790740301.053212:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:6199:x1877727000940160:12345-192.168.204.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790740301.053567:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:6199:x1877727000940160:12345-192.168.204.3@tcp:503:ll_cfg_requeue.0 Request processed in 357us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740301.053577:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 321 10000000:01000000:3.0:1790740301.099305:0:6532:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790740301.099315:0:6532:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98dcb5f0a000 from 7 10000000:01000000:3.0:1790740301.099322:0:6532:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790740301.099381:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8c00/0xb25dda4f4e92dc5a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740301.099393:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8c00/0xb25dda4f4e92dc5a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740301.099404:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8c00/0xb25dda4f4e92dc5a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740301.099432:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f98380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021996416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790740301.099504:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740301.101486:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db8224ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1790740301.101567:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021996416 00000100:00100000:1.0:1790740301.101580:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021996416 00000100:00100000:1.0:1790740301.101788:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1790740301.101800:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+20:6532:x1877727021996416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790740301.101818:0:6529:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740301.101850:0:6529:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcbfc44600/0xb25dda4f4e92dc61 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92dc5a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740301.101881:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcbfc44600/0xb25dda4f4e92dc61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92dc5a expref: 21 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740301.101893:0:6529:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcbfc44600/0xb25dda4f4e92dc61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92dc5a expref: 21 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740301.101903:0:6529:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcbfc44600, rc 0) 00000100:00100000:1.0:1790740301.101974:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:6532:x1877727021996416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (2470us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740301.101983:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1790740301.102113:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f98380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021996416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790740301.102159:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8c00/0xb25dda4f4e92dc5a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92dc61 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740301.102186:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8c00/0xb25dda4f4e92dc5a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92dc61 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740301.102299:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021996544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790740301.102359:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740301.102401:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc88738180 going to sleep for 11 seconds 00000100:00100000:3.0:1790740301.102467:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021996544 00000100:00100000:3.0:1790740301.102474:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021996544 00000100:00100000:3.0:1790740301.102525:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1790740301.102534:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99055c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:6532:x1877727021996544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790740301.102692:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99055c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:6532:x1877727021996544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 159us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740301.102700:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1790740301.102767:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021996544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790740301.102798:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021996672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790740301.102853:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740301.102878:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc88738180 going to sleep for 11 seconds 00000100:00100000:3.0:1790740301.102916:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021996672 00000100:00100000:3.0:1790740301.102920:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021996672 00000100:00100000:3.0:1790740301.102949:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1790740301.102956:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99057c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:6532:x1877727021996672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790740301.103072:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99057c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:6532:x1877727021996672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740301.103079:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1790740301.103169:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021996672:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1790740301.104247:0:13249:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1790740301.104563:0:6532:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1790740301.104596:0:6532:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790740301.104610:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8c00/0xb25dda4f4e92dc5a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92dc61 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740301.104624:0:6532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8c00/0xb25dda4f4e92dc5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92dc61 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740301.104637:0:6532:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790740301.104641:0:6532:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98dcaedda800 from 7 10000000:01000000:3.0:1790740301.104644:0:6532:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790740301.104691:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8a00/0xb25dda4f4e92dc68 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740301.104700:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8a00/0xb25dda4f4e92dc68 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740301.104725:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8a00/0xb25dda4f4e92dc68 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740301.104754:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f98000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021996800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790740301.104825:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740301.104880:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc85f9c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790740301.105018:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021996800 00000100:00100000:1.0:1790740301.105027:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021996800 00000100:00100000:1.0:1790740301.105119:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1790740301.105129:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99057850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:6532:x1877727021996800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790740301.105154:0:6529:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740301.105170:0:6529:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcbfc45000/0xb25dda4f4e92dc6f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92dc68 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740301.105200:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcbfc45000/0xb25dda4f4e92dc6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92dc68 expref: 22 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740301.105212:0:6529:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcbfc45000/0xb25dda4f4e92dc6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92dc68 expref: 22 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740301.105222:0:6529:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcbfc45000, rc 0) 00000100:00100000:1.0:1790740301.105266:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99057850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+22:6532:x1877727021996800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740301.105272:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1790740301.108378:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f98000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021996800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790740301.108422:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8a00/0xb25dda4f4e92dc68 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92dc6f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740301.108438:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8a00/0xb25dda4f4e92dc68 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92dc6f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740301.108554:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f98000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021996928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790740301.108639:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740301.108703:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc85f9c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740301.108802:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021996928 00000100:00100000:2.0:1790740301.108810:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021996928 00000100:00100000:2.0:1790740301.108890:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1790740301.108902:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99054c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+22:6532:x1877727021996928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790740301.109085:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99054c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+22:6532:x1877727021996928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 185us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740301.109094:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1790740301.109188:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f98000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021996928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790740301.109220:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f98000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021997056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790740301.109263:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740301.109286:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc85f9c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740301.109396:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021997056 00000100:00100000:2.0:1790740301.109401:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021997056 00000100:00100000:2.0:1790740301.109430:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1790740301.109437:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99055450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+22:6532:x1877727021997056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790740301.109521:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99055450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+22:6532:x1877727021997056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740301.109536:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1790740301.109689:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f98000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021997056:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790740301.110596:0:13250:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1790740301.111060:0:6532:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1790740301.111091:0:6532:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790740301.111106:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8a00/0xb25dda4f4e92dc68 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92dc6f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740301.111119:0:6532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8a00/0xb25dda4f4e92dc68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92dc6f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740301.111132:0:6532:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790740301.111135:0:6532:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98dca0cb4800 from 7 10000000:01000000:2.0:1790740301.111139:0:6532:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790740301.111195:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92dc76 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740301.111205:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92dc76 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740301.111217:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92dc76 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740301.111244:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021997184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790740301.111316:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740301.111358:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc82d346c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790740301.111512:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021997184 00000100:00100000:3.0:1790740301.111522:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021997184 00000100:00100000:3.0:1790740301.111589:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1790740301.111599:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99056850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+22:6532:x1877727021997184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790740301.111615:0:6529:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740301.111631:0:6529:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcb5dc9800/0xb25dda4f4e92dc7d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92dc76 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740301.111661:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcb5dc9800/0xb25dda4f4e92dc7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92dc76 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740301.111674:0:6529:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcb5dc9800/0xb25dda4f4e92dc7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92dc76 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740301.111684:0:6529:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc9800, rc 0) 00000100:00100000:3.0:1790740301.111730:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99056850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:6532:x1877727021997184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740301.111738:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1790740301.111835:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021997184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790740301.111867:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92dc76 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92dc7d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740301.111877:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92dc76 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92dc7d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740301.111955:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021997312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790740301.111986:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740301.112016:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db8444a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790740301.112138:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021997312 00000100:00100000:3.0:1790740301.112210:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021997312 00000100:00100000:3.0:1790740301.113273:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1790740301.113289:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99054450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:6532:x1877727021997312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790740301.113484:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99054450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:6532:x1877727021997312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 200us (1496us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740301.113491:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1790740301.114440:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021997312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790740301.114514:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefda300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021997440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790740301.114609:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740301.116196:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83ce43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790740301.116443:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021997440 00000100:00100000:1.0:1790740301.116455:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021997440 00000100:00100000:1.0:1790740301.116532:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1790740301.116542:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99057450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:6532:x1877727021997440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790740301.116746:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99057450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:6532:x1877727021997440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 204us (2136us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740301.116755:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1790740301.118313:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefda300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021997440:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790740301.119814:0:13251:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1790740301.127290:0:6532:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1790740301.127358:0:6532:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790740301.127375:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92dc76 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92dc7d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740301.127393:0:6532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92dc76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92dc7d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740301.127407:0:6532:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790740301.127411:0:6532:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98dc82d23800 from 7 10000000:01000000:1.0:1790740301.127414:0:6532:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790740301.127474:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcbfc44200/0xb25dda4f4e92dc84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740301.127483:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dcbfc44200/0xb25dda4f4e92dc84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740301.127496:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dcbfc44200/0xb25dda4f4e92dc84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740301.127529:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021997568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790740301.127627:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740301.127753:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db8444ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1790740301.132203:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021997568 00000100:00100000:3.0:1790740301.132226:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021997568 00000100:00100000:3.0:1790740301.132296:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1790740301.132308:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99056c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:6532:x1877727021997568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790740301.132333:0:6529:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740301.132366:0:6529:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcb5dc9400/0xb25dda4f4e92dc8b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92dc84 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740301.132405:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcb5dc9400/0xb25dda4f4e92dc8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92dc84 expref: 24 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740301.132419:0:6529:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcb5dc9400/0xb25dda4f4e92dc8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92dc84 expref: 24 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740301.132430:0:6529:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc9400, rc 0) 00000100:00100000:3.0:1790740301.132543:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99056c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:6532:x1877727021997568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 237us (4916us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740301.132550:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1790740301.132645:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021997568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790740301.132669:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dcbfc44200/0xb25dda4f4e92dc84 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92dc8b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740301.132679:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dcbfc44200/0xb25dda4f4e92dc84 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92dc8b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740301.132781:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f98000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021997696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790740301.132820:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740301.132865:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021997696 00000100:00100000:3.0:1790740301.132870:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021997696 00000100:00100000:3.0:1790740301.132896:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1790740301.132903:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99057050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:6532:x1877727021997696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790740301.133073:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99057050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:6532:x1877727021997696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 170us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740301.133094:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1790740301.133133:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82cfa600 going to sleep for 11 seconds 00000100:00100000:3.0:1790740301.133145:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f98000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021997696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790740301.133176:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f98000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021997824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790740301.133219:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740301.133234:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82cfa600 going to sleep for 11 seconds 00000100:00100000:3.0:1790740301.133248:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021997824 00000100:00100000:3.0:1790740301.133252:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021997824 00000100:00100000:3.0:1790740301.133275:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1790740301.133282:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99055050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:6532:x1877727021997824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790740301.133376:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99055050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:6532:x1877727021997824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740301.133383:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1790740301.133428:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f98000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727021997824:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790740301.136926:0:13254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1790740301.137590:0:6532:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1790740301.137632:0:6532:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790740301.137650:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcbfc44200/0xb25dda4f4e92dc84 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92dc8b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740301.137666:0:6532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dcbfc44200/0xb25dda4f4e92dc84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92dc8b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740301.293889:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740301.418488:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790740301.418529:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021997952:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790740301.418640:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740301.418733:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021997952 00000100:00100000:1.0:1790740301.418744:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021997952 00000100:00100000:1.0:1790740301.418804:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1790740301.418813:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021997952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790740301.418874:0:7846:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790740301.418927:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021997952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740301.418935:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1790740301.418988:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021997952:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1790740302.320412:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740303.342404:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740303.467353:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82f98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021998080:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790740303.467463:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740303.467662:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021998080 00000100:00100000:3.0:1790740303.467671:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021998080 00000100:00100000:3.0:1790740303.467727:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1790740303.467746:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaefda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021998080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790740303.467786:0:6541:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1790740303.467977:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82f98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021998080:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790740303.468095:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaefda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021998080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740303.468105:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000001:02000400:0.0:1790740303.731535:0:13408:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg403-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1790740303.978277:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021998336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790740303.978362:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740303.978470:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727021998208:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790740303.978505:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740303.978555:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021998336 00000100:00100000:1.0:1790740303.978563:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021998336 00000100:00100000:1.0:1790740303.978613:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021998208 00000100:00100000:1.0:1790740303.978617:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021998208 00000100:00100000:1.0:1790740303.978635:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1790740303.978643:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82f98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021998336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790740303.978672:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1790740303.980835:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790740303.981817:0:10118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1790740303.981846:0:10118:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727021998208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790740303.981876:0:10118:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790740303.982012:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82f98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727021998336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3366us (3647us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740303.982022:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:0.0:1790740303.982069:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83e1df80 x1877727021998208/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740319 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740303.982091:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727021998208:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790740303.982214:0:10118:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727021998208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 168us (3490us total) trans 0 rc 0/0 00010000:00080000:3.0:1790740303.982215:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83e1ea00 x1877727021998336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740319 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740303.982221:0:10118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1790740303.982231:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727021998336:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790740304.362354:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740305.313430:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740305.313505:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740305.313538:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740305.313559:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000940288 00000100:00100000:3.0:1790740305.313567:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740305.313582:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000940288 00000100:00100000:3.0:1790740305.313592:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740305.313618:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000940544 00000100:00100000:3.0:1790740305.313623:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000940544 00000100:00100000:0.0:1790740305.313646:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 334 00000100:00100000:0.0:1790740305.313659:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99056450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:2404:x1877727000940288:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740305.313674:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000940800 00000100:00100000:3.0:1790740305.313678:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000940800 00000100:00100000:3.0:1790740305.313695:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000940416 00000100:00100000:3.0:1790740305.313698:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000940416 00000100:00100000:3.0:1790740305.313712:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000940672 00000100:00100000:3.0:1790740305.313715:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000940672 00000100:00100000:3.0:1790740305.313732:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 200 00000100:00100000:0.0:1790740305.313739:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99056450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:2404:x1877727000940288:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 82us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740305.313743:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82f98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+5:2404:x1877727000940544:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1790740305.313753:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 334 00000100:00100000:3.0:1790740305.313805:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82f98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+5:2404:x1877727000940544:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 64us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740305.313808:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 201 00000100:00100000:0.0:1790740305.313819:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82f98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2404:x1877727000940800:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740305.313833:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 200 00000100:00100000:3.0:1790740305.313850:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 202 00000100:00100000:3.0:1790740305.313857:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+6:2404:x1877727000940416:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1790740305.315001:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82f98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2404:x1877727000940800:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 1177us (1455us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740305.315018:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 201 00000100:00100000:0.0:1790740305.315062:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 203 00000100:00100000:0.0:1790740305.315075:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2404:x1877727000940672:12345-192.168.204.3@tcp:400:kworker.0 00000100:00080000:2.0:1790740305.315189:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790740305.315195:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790740305.316909:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+6:2404:x1877727000940416:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 3043us (3332us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740305.316923:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 202 00000100:00100000:1.0:1790740305.317397:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2404:x1877727000940672:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 2325us (3802us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740305.317407:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 203 00010000:00010000:3.0:1790740305.386438:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740305.514207:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3641:1877727021998464:0@lo:400:kworker.0 00000100:00100000:2.0:1790740305.514293:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740305.514318:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877727021998848:0@lo:400:kworker.0 00000100:00100000:0.0:1790740305.514358:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740305.514368:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021998976:0@lo:400:kworker.0 00000100:00100000:0.0:1790740305.514385:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98535180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021999360:0@lo:400:kworker.0 00000100:00100000:2.0:1790740305.514401:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740305.514421:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740305.514427:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98537100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021999488:0@lo:400:kworker.0 00000100:00100000:0.0:1790740305.514447:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98536a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021999872:0@lo:400:kworker.0 00000100:00100000:2.0:1790740305.514455:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740305.514479:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98535500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022000000:0@lo:400:kworker.0 00000100:00100000:0.0:1790740305.514481:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740305.514513:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740305.514523:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727021998592:0@lo:400:kworker.0 00000100:00100000:2.0:1790740305.514553:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021998464 00000100:00100000:0.0:1790740305.514557:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740305.514561:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021998464 00000100:00100000:0.0:1790740305.514581:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877727021999104:0@lo:400:kworker.0 00000100:00100000:0.0:1790740305.514607:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740305.514617:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1790740305.514629:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99056050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3641:x1877727021998464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740305.514642:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98537800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1877727021999616:0@lo:400:kworker.0 00000100:00100000:0.0:1790740305.514677:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740305.514690:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99056050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3641:x1877727021998464:12345-0@lo:400:kworker.0 Request processed in 62us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740305.514698:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1790740305.514704:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1790740305.514713:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021998720:0@lo:400:kworker.0 00000100:00100000:2.0:1790740305.514736:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021998848 00000100:00100000:2.0:1790740305.514741:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021998848 00000100:00100000:0.0:1790740305.514742:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740305.514777:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1877727021999232:0@lo:400:kworker.0 00000100:00100000:2.0:1790740305.514783:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021998592 00000100:00100000:2.0:1790740305.514788:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021998592 00000100:00100000:0.0:1790740305.514803:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740305.514808:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021999104 00000100:00100000:2.0:1790740305.514812:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021999104 00000100:00100000:0.0:1790740305.514817:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98536300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1877727021999744:0@lo:400:kworker.0 00000100:00100000:2.0:1790740305.514843:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021999616 00000100:00100000:0.0:1790740305.514847:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740305.514854:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021999616 00000100:00100000:2.0:1790740305.514876:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021999232 00000100:00100000:2.0:1790740305.514879:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021999232 00000100:00100000:0.0:1790740305.514892:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021999744 00000100:00100000:0.0:1790740305.514897:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021999744 00000100:00100000:2.0:1790740305.514899:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1790740305.514909:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc98535880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877727021998848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740305.514931:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1790740305.514940:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ce2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727021998592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740305.514957:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc98535880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877727021998848:12345-0@lo:400:kworker.0 Request processed in 49us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740305.514964:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1790740305.514977:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1790740305.514984:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ce1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877727021999104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740305.515016:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ce1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877727021999104:12345-0@lo:400:kworker.0 Request processed in 33us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740305.515022:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1790740305.515063:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1790740305.515069:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ce0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877727021999616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740305.515101:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ce0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877727021999616:12345-0@lo:400:kworker.0 Request processed in 32us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740305.515107:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1790740305.515127:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ce2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727021998592:12345-0@lo:400:kworker.0 Request processed in 187us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740305.515136:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1790740305.515150:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1790740305.515157:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ce0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877727021999232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740305.515248:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ce0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877727021999232:12345-0@lo:400:kworker.0 Request processed in 91us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740305.515254:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1790740305.515267:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1790740305.515273:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84462680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877727021999744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740305.515303:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84462680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877727021999744:12345-0@lo:400:kworker.0 Request processed in 30us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740305.515318:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1790740305.515337:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021998976 00000100:00100000:0.0:1790740305.515341:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021998976 00000100:00100000:0.0:1790740305.515363:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021998720 00000100:00100000:0.0:1790740305.515366:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021998720 00000100:00100000:0.0:1790740305.515379:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1790740305.515385:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021998976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740305.515424:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021998976:12345-0@lo:400:kworker.0 Request processed in 39us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740305.515431:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1790740305.515444:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1790740305.515451:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ce0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021998720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740305.515482:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ce0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727021998720:12345-0@lo:400:kworker.0 Request processed in 31us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740305.515488:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1790740305.516244:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021999360 00000100:00100000:2.0:1790740305.516251:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021999360 00000100:00100000:2.0:1790740305.516274:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021999488 00000100:00100000:2.0:1790740305.516277:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021999488 00000100:00100000:2.0:1790740305.516287:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727021999872 00000100:00100000:2.0:1790740305.516290:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727021999872 00000100:00100000:2.0:1790740305.516299:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022000000 00000100:00100000:2.0:1790740305.516301:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022000000 00000100:00100000:2.0:1790740305.516386:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790740305.516394:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ce2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021999360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740305.516450:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ce2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021999360:12345-0@lo:400:kworker.0 Request processed in 57us (2030us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740305.516457:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790740305.516470:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1790740305.516476:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021999488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740305.516501:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727021999488:12345-0@lo:400:kworker.0 Request processed in 27us (2047us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740305.516506:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1790740305.516514:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790740305.516519:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ce0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021999872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740305.516539:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ce0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727021999872:12345-0@lo:400:kworker.0 Request processed in 21us (2062us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740305.516544:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790740305.516553:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790740305.516558:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022000000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740305.516578:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022000000:12345-0@lo:400:kworker.0 Request processed in 21us (2068us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740305.516583:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1790740305.516622:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790740305.516625:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790740305.516628:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790740305.516630:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790740305.516682:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790740305.516774:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877727021998848:0@lo:400:kworker.0 00010000:00080000:2.0:1790740305.516791:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dc98535180 x1877727021999360/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740305.516815:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98535180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021999360:0@lo:400:kworker.0 00010000:00080000:2.0:1790740305.516833:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dc98536a00 x1877727021999872/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740305.516843:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98536a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727021999872:0@lo:400:kworker.0 00000100:00100000:2.0:1790740305.516893:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021998976:0@lo:400:kworker.0 00010000:00080000:2.0:1790740305.516907:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dc98537100 x1877727021999488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740305.516917:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98537100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727021999488:0@lo:400:kworker.0 00010000:00080000:2.0:1790740305.516931:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dc98535500 x1877727022000000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740305.516939:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98535500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022000000:0@lo:400:kworker.0 00000100:00100000:2.0:1790740305.516954:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3641:1877727021998464:0@lo:400:kworker.0 00000100:00100000:2.0:1790740305.516989:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727021998720:0@lo:400:kworker.0 00010000:00080000:2.0:1790740305.517001:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcaefdb100 x1877727021999232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740305.517010:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1877727021999232:0@lo:400:kworker.0 00000100:00100000:0.0:1790740305.517627:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022000256:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790740305.517690:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740305.517724:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022000128:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790740305.517746:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740305.517793:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022000256 00000100:00100000:0.0:1790740305.517800:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022000256 00000100:00100000:0.0:1790740305.517857:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022000128 00000100:00100000:0.0:1790740305.517861:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022000128 00000100:00100000:0.0:1790740305.517879:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1790740305.517886:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022000256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790740305.517921:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:2.0:1790740305.517944:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dc98536300 x1877727021999744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740305.517959:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98536300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1877727021999744:0@lo:400:kworker.0 00000100:00100000:2.0:1790740305.517979:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727021998592:0@lo:400:kworker.0 00000100:00100000:2.0:1790740305.518000:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877727021999104:0@lo:400:kworker.0 00000100:00100000:2.0:1790740305.518011:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98537800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1877727021999616:0@lo:400:kworker.0 00000100:00100000:2.0:1790740305.518058:0:10118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1790740305.518068:0:10118:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022000128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790740305.518078:0:10118:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790740305.518110:0:10118:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022000128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740305.518117:0:10118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1790740305.518167:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022000256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 279us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740305.518174:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:0.0:1790740305.518221:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcbd5fad80 x1877727022000256/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740321 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740305.518236:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022000256:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1790740305.518246:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83e1c380 x1877727022000128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740321 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740305.518258:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022000128:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790740306.410534:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740306.540671:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790740306.540696:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022000384:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790740306.540778:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740306.546891:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022000384 00000100:00100000:0.0:1790740306.546908:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022000384 00000100:00100000:0.0:1790740306.546997:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1790740306.547008:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022000384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790740306.547291:0:7846:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1790740306.547954:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022000384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 945us (7172us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740306.547963:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1790740306.554312:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022000384:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1790740307.436188:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740308.460060:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740308.586206:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790740308.586233:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022000512:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790740308.586309:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740308.586376:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022000512 00000100:00100000:2.0:1790740308.586394:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022000512 00000100:00100000:2.0:1790740308.586482:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1790740308.586495:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84460a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022000512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790740308.586546:0:6540:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1790740308.594375:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84460a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022000512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 7867us (8049us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740308.594396:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1790740308.594431:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022000512:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790740309.099518:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790740309.099545:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022000640:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790740309.105110:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790740309.105140:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022000768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790740309.107084:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740309.107162:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740309.107210:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022000768 00000100:00100000:2.0:1790740309.107220:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022000768 00000100:00100000:0.0:1790740309.107234:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022000640 00000100:00100000:0.0:1790740309.107241:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022000640 00000100:00100000:2.0:1790740309.107820:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1790740309.107833:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022000640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790740309.107886:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790740309.107968:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1790740309.107980:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc98537800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022000768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790740309.107994:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790740309.108279:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022000640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 448us (1118us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740309.108287:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:2.0:1790740309.108313:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790740309.108331:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc98537800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022000768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 352us (1253us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740309.108340:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:2.0:1790740309.108351:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83e1c380 x1877727022000768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740325 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740309.108373:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022000768:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1790740309.108390:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db84461f80 x1877727022000640/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740325 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740309.108406:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022000640:0@lo:13:osp-pre-0-1.0 00000001:02000400:3.0:1790740309.170483:0:13557:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 23:51:48 (1790740308) === 00000100:00100000:3.0:1790740309.396552:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740309.396615:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740309.396729:0:6544:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000941056 00000100:00100000:2.0:1790740309.396743:0:6544:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000941056 00000100:00100000:2.0:1790740309.396828:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 2 00000100:00100000:2.0:1790740309.396842:0:6544:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7bed19f2-4c98-4684-89e7-a6871565665d+6:10504:x1877727000941056:12345-192.168.204.3@tcp:700:mkdir.0 00000100:00100000:2.0:1790740309.396953:0:6544:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7bed19f2-4c98-4684-89e7-a6871565665d+6:10504:x1877727000941056:12345-192.168.204.3@tcp:700:mkdir.0 Request processed in 115us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740309.396962:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 2 00000100:00100000:1.0:1790740309.397077:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000940928 00000100:00100000:1.0:1790740309.397109:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000940928 00000100:00100000:1.0:1790740309.397143:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 22 00000100:00100000:1.0:1790740309.397151:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+6:2404:x1877727000940928:12345-192.168.204.3@tcp:41:mkdir.0 00000004:00000024:1.0:1790740309.397188:0:6535:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1790740309.397253:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+6:2404:x1877727000940928:12345-192.168.204.3@tcp:41:mkdir.0 Request processed in 104us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740309.397260:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 22 00000100:00080000:3.0:1790740309.397377:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790740309.402444:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740309.402517:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000941312 00000100:00100000:2.0:1790740309.402532:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000941312 00000100:00100000:2.0:1790740309.402612:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 23 00000100:00100000:2.0:1790740309.402623:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+6:10504:x1877727000941312:12345-192.168.204.3@tcp:36:mkdir.0 00010000:00010000:2.0:1790740309.402710:0:7760:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740309.408561:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061400/0xb25dda4f4e92db34 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23b5e expref: 6 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.408599:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98db82949200) 00010000:00010000:2.0:1790740309.408658:0:7760:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790740309.408811:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92dc92 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.408830:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92dc92 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.408841:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92dc92 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.408877:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92dc99 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.408888:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92dc99 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.408906:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92dc99 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.411864:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32600/0xb25dda4f4e92dca0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.411891:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32600/0xb25dda4f4e92dca0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.411903:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32600/0xb25dda4f4e92dca0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790740309.411921:0:7760:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000000df9fd66 reply state 0000000073b10086 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32600/0xb25dda4f4e92dca0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.411933:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32600/0xb25dda4f4e92dca0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.411941:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98dcaf04b000) 00010000:00010000:2.0:1790740309.411952:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790740309.411957:0:7760:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1790740309.411964:0:7760:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1790740309.411973:0:7760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92dc92 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.411980:0:7760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92dc92 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.411988:0:7760:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92dc92 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.411996:0:7760:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f32200 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740309.412001:0:7760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92dc92 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.412008:0:7760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92dc92 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.412020:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98dcaf04b300) 00010000:00010000:2.0:1790740309.412022:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740309.412027:0:7760:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92dc92 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.412068:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92dc92 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790740309.412086:0:7760:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000000df9fd66 reply state 0000000073b10086 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92dc99 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.412095:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92dc99 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.412113:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98dcaf04bd00) 00010000:00010000:2.0:1790740309.412115:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790740309.412117:0:7760:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1790740309.412218:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+7:10504:x1877727000941312:12345-192.168.204.3@tcp:36:mkdir.0 Request processed in 9592us (9779us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1790740309.412228:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 23 00000100:00100000:3.0:1790740309.438531:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740309.439554:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000941440 00000100:00100000:2.0:1790740309.439568:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000941440 00000100:00100000:2.0:1790740309.439640:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 24 00000100:00100000:2.0:1790740309.439653:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+7:10505:x1877727000941440:12345-192.168.204.3@tcp:101:chmod.0 00010000:00010000:2.0:1790740309.439674:0:13222:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740309.439712:0:13222:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92dca7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23bf1 expref: -99 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.439788:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92dcae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.439801:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92dcae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.439812:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92dcae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740309.439853:0:13222:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790740309.439857:0:13222:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790740309.439891:0:13222:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92dcae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.439915:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92dca7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23bf1 expref: 9 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.439949:0:13222:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92dcae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23bf1 expref: 8 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.439958:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98dcaf04b300) 00010000:00010000:2.0:1790740309.439961:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790740309.439965:0:13222:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f33e00, rc 0) 00000100:00100000:2.0:1790740309.440093:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+8:10505:x1877727000941440:12345-192.168.204.3@tcp:101:chmod.0 Request processed in 442us (1571us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740309.440100:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 24 00000100:00100000:3.0:1790740309.455285:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740309.462832:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000941696 00000100:00100000:2.0:1790740309.462853:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000941696 00000100:00100000:2.0:1790740309.462937:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 25 00000100:00100000:2.0:1790740309.462947:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+8:10505:x1877727000941696:12345-192.168.204.3@tcp:36:chmod.0 00010000:00010000:2.0:1790740309.463222:0:6536:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740309.463252:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92dcae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23bf1 expref: 8 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.463271:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98dcaf04b300) 00010000:00010000:2.0:1790740309.463283:0:6536:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790740309.463309:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92dcb5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.463323:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92dcb5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.463334:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92dcb5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790740309.463544:0:6536:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002478856b reply state 00000000cc9c9ee8 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92dcb5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.463558:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92dcb5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.463565:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98dcaf04bf00) 00010000:00010000:2.0:1790740309.463568:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1790740309.463571:0:6536:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1790740309.463578:0:6536:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1790740309.463794:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+9:10505:x1877727000941696:12345-192.168.204.3@tcp:36:chmod.0 Request processed in 847us (8518us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1790740309.463802:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 25 00010000:00010000:2.0:1790740309.482320:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740309.504494:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740309.504604:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000941824 00000100:00100000:2.0:1790740309.504613:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000941824 00000100:00100000:2.0:1790740309.504687:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 26 00000100:00100000:2.0:1790740309.504697:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84461f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+9:10506:x1877727000941824:12345-192.168.204.3@tcp:101:chown.0 00010000:00010000:2.0:1790740309.504723:0:7760:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740309.504744:0:7760:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92dcbc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23bf8 expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.504807:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92dcc3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.504821:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92dcc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.504831:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92dcc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740309.504887:0:7760:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790740309.504890:0:7760:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790740309.504926:0:7760:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92dcc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.504950:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92dcbc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23bf8 expref: 11 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.504968:0:7760:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92dcc3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23bf8 expref: 10 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.504977:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98dcaf04bf00) 00010000:00010000:2.0:1790740309.504980:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790740309.504984:0:7760:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f32400, rc 0) 00000100:00100000:2.0:1790740309.505113:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84461f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+10:10506:x1877727000941824:12345-192.168.204.3@tcp:101:chown.0 Request processed in 417us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740309.505120:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 26 00000100:00100000:3.0:1790740309.511530:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740309.511976:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000941952 00000100:00100000:2.0:1790740309.512005:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000941952 00000100:00100000:2.0:1790740309.512307:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 27 00000100:00100000:2.0:1790740309.512319:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+10:10506:x1877727000941952:12345-192.168.204.3@tcp:101:chown.0 00010000:00010000:2.0:1790740309.512342:0:13222:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740309.512362:0:13222:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92dcca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23bff expref: -99 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.512431:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92dcd1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.512465:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92dcd1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.512476:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92dcd1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.512488:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33400/0xb25dda4f4e92dcd8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.512494:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33400/0xb25dda4f4e92dcd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.512500:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33400/0xb25dda4f4e92dcd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.512577:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33c00/0xb25dda4f4e92dcdf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.512584:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33c00/0xb25dda4f4e92dcdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.512590:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33c00/0xb25dda4f4e92dcdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740309.512633:0:13222:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790740309.512636:0:13222:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790740309.512656:0:13222:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33c00/0xb25dda4f4e92dcdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.512668:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92dcd1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.512698:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92dcd1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.512705:0:13222:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92dcd1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.512712:0:13222:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f32000 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740309.513166:0:13222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92dcd1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.513175:0:13222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92dcd1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.513192:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98dcaf04bf00) 00010000:00010000:2.0:1790740309.513195:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740309.513202:0:13222:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92dcd1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.513207:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92dcd1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.513223:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33400/0xb25dda4f4e92dcd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.513229:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33400/0xb25dda4f4e92dcd8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.513235:0:13222:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33400/0xb25dda4f4e92dcd8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.513240:0:13222:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f33400 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740309.513251:0:13222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33400/0xb25dda4f4e92dcd8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.513257:0:13222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33400/0xb25dda4f4e92dcd8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.513266:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98dcaf04bd00) 00010000:00010000:2.0:1790740309.513269:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740309.513272:0:13222:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33400/0xb25dda4f4e92dcd8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.513279:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33400/0xb25dda4f4e92dcd8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.513317:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92dcca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23bff expref: 12 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.513331:0:13222:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33c00/0xb25dda4f4e92dcdf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23bff expref: 11 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.513339:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98dcaf04b000) 00010000:00010000:2.0:1790740309.513342:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790740309.513344:0:13222:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f33c00, rc 0) 00000100:00100000:2.0:1790740309.513491:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+11:10506:x1877727000941952:12345-192.168.204.3@tcp:101:chown.0 Request processed in 1173us (1975us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740309.513499:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 27 00000100:00100000:3.0:1790740309.523720:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740309.523906:0:6546:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000942080 00000100:00100000:2.0:1790740309.523919:0:6546:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000942080 00000100:00100000:2.0:1790740309.524004:0:6546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 6 00000100:00100000:2.0:1790740309.524016:0:6546:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82c89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7bed19f2-4c98-4684-89e7-a6871565665d+11:10506:x1877727000942080:12345-192.168.204.3@tcp:900:chown.0 00000100:00100000:2.0:1790740309.524199:0:6546:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82c89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7bed19f2-4c98-4684-89e7-a6871565665d+11:10506:x1877727000942080:12345-192.168.204.3@tcp:900:chown.0 Request processed in 184us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740309.524217:0:6546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 6 00000100:00100000:0.0:1790740309.529783:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740309.530317:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000942336 00000100:00100000:2.0:1790740309.530332:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000942336 00000100:00100000:2.0:1790740309.530437:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 28 00000100:00100000:2.0:1790740309.530457:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+11:10506:x1877727000942336:12345-192.168.204.3@tcp:36:chown.0 00010000:00010000:2.0:1790740309.530533:0:6536:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740309.530570:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33c00/0xb25dda4f4e92dcdf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23bff expref: 11 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.530595:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98dcaf04b000) 00010000:00010000:2.0:1790740309.530600:0:6536:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790740309.530630:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92dce6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.530647:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92dce6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.530662:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92dce6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790740309.543303:0:6514:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:2.0:1790740309.543481:0:6536:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002bb8755b reply state 000000008348b9b7 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92dce6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.543516:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92dce6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.543527:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98dcaf04b000) 00010000:00010000:2.0:1790740309.543554:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1790740309.543560:0:6536:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1790740309.543576:0:6536:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1790740309.543721:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92dc99 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1790740309.543738:0:6536:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1790740309.543765:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+9:10506:x1877727000942336:12345-192.168.204.3@tcp:36:chown.0 Request processed in 13311us (13991us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1790740309.543776:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 28 00010000:00010000:3.0:1790740309.544872:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92dc99 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740309.544909:0:3624:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92dc99 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740309.544916:0:3624:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f33000 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740309.544921:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92dc99 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740309.544931:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92dc99 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740309.544950:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98dcaf04bd00) 00010000:00010000:3.0:1790740309.544953:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740309.544958:0:3624:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92dc99 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740309.544964:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92dc99 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740309.544987:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32600/0xb25dda4f4e92dca0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740309.544992:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32600/0xb25dda4f4e92dca0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740309.544998:0:3624:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32600/0xb25dda4f4e92dca0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740309.545004:0:3624:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f32600 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740309.545007:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32600/0xb25dda4f4e92dca0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740309.545022:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32600/0xb25dda4f4e92dca0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740309.545200:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98dcaf04b000) 00010000:00010000:3.0:1790740309.545204:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740309.545208:0:3624:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32600/0xb25dda4f4e92dca0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740309.545214:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32600/0xb25dda4f4e92dca0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740309.545232:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92dcb5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740309.545237:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92dcb5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740309.545242:0:3624:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92dcb5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740309.545247:0:3624:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f32200 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740309.545250:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92dcb5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740309.545256:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92dcb5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740309.545263:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98dcaf04bf00) 00010000:00010000:3.0:1790740309.545266:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790740309.545269:0:3624:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92dcb5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740309.545296:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92dcb5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740309.545318:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92dce6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740309.545328:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92dce6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740309.545335:0:3625:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92dce6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740309.545340:0:3625:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f33e00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740309.545343:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92dce6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740309.545349:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92dce6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740309.545359:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98dcaf04b000) 00010000:00010000:1.0:1790740309.545361:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790740309.545364:0:3625:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92dce6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740309.545370:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92dce6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740309.568933:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740309.569091:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000942464 00000100:00100000:1.0:1790740309.569101:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000942464 00000100:00100000:1.0:1790740309.569182:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 29 00000100:00100000:1.0:1790740309.569191:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82c8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+6:10507:x1877727000942464:12345-192.168.204.3@tcp:101:touch.500 00010000:00010000:1.0:1790740309.569216:0:6535:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740309.569238:0:6535:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92dced lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23c06 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790740309.572146:0:6535:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2855us 00010000:00010000:0.0:1790740309.585293:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061600/0xb25dda4f4e92dcf4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.585315:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061600/0xb25dda4f4e92dcf4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.585327:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061600/0xb25dda4f4e92dcf4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.585340:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92dcfb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.585347:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92dcfb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.585358:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92dcfb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.585471:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061200/0xb25dda4f4e92dd02 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.585479:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061200/0xb25dda4f4e92dd02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.585487:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061200/0xb25dda4f4e92dd02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790740309.585517:0:6535:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790740309.585521:0:6535:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790740309.585554:0:6535:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061200/0xb25dda4f4e92dd02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.585565:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061600/0xb25dda4f4e92dcf4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.585572:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061600/0xb25dda4f4e92dcf4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.585579:0:6535:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061600/0xb25dda4f4e92dcf4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.585586:0:6535:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf061600 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:0.0:1790740309.585590:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061600/0xb25dda4f4e92dcf4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.585597:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061600/0xb25dda4f4e92dcf4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.585613:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98dcaf04bf00) 00010000:00010000:0.0:1790740309.585616:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740309.585621:0:6535:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061600/0xb25dda4f4e92dcf4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.585627:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061600/0xb25dda4f4e92dcf4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.585638:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92dcfb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.585644:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92dcfb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.585650:0:6535:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92dcfb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.585655:0:6535:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf061800 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:0.0:1790740309.585657:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92dcfb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.585662:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92dcfb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.585668:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98db82949a00) 00010000:00010000:0.0:1790740309.585671:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740309.585673:0:6535:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92dcfb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.585693:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92dcfb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.585739:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92dced lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c06 expref: 8 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.585753:0:6535:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061200/0xb25dda4f4e92dd02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c06 expref: 7 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.585760:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98db82949b00) 00010000:00010000:0.0:1790740309.585762:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1790740309.585764:0:6535:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaf061200, rc 0) 00000100:00100000:0.0:1790740309.585838:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82c8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+7:10507:x1877727000942464:12345-192.168.204.3@tcp:101:touch.500 Request processed in 16647us (16928us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740309.585847:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 29 00000100:00100000:0.0:1790740309.588861:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740309.589010:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000942720 00000100:00100000:3.0:1790740309.589072:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000942720 00000100:00100000:3.0:1790740309.589161:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 30 00000100:00100000:3.0:1790740309.589178:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+7:10507:x1877727000942720:12345-192.168.204.3@tcp:101:touch.500 00010000:00010000:3.0:1790740309.589210:0:6537:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740309.589241:0:6537:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8000/0xb25dda4f4e92dd09 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23c0d expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740309.589669:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8400/0xb25dda4f4e92dd10 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740309.589701:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8400/0xb25dda4f4e92dd10 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740309.589716:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8400/0xb25dda4f4e92dd10 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740309.594346:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92dd17 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740309.594373:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92dd17 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740309.594386:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92dd17 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790740309.595178:0:6537:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:3.0:1790740309.595365:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92dd1e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740309.595378:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92dd1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740309.595387:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92dd1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740309.595423:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8400/0xb25dda4f4e92dd10 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740309.595430:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8400/0xb25dda4f4e92dd10 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740309.595437:0:6537:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8400/0xb25dda4f4e92dd10 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740309.595443:0:6537:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc8400 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740309.595447:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8400/0xb25dda4f4e92dd10 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740309.595454:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8400/0xb25dda4f4e92dd10 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740309.595466:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98db82949b00) 00010000:00010000:3.0:1790740309.595468:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740309.595473:0:6537:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8400/0xb25dda4f4e92dd10 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740309.595490:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8400/0xb25dda4f4e92dd10 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790740309.595505:0:6537:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000040d8db2c reply state 00000000591bc256 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92dd17 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740309.595515:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92dd17 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740309.595522:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x6a3bfed6 (ffff98dcaf04d200) 00010000:00010000:3.0:1790740309.595524:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790740309.595527:0:6537:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790740309.595567:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8000/0xb25dda4f4e92dd09 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c0d expref: 10 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740309.595582:0:6537:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92dd1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c0d expref: 9 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740309.595589:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff98dcaf04d700) 00010000:00010000:3.0:1790740309.595591:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790740309.595594:0:6537:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc8200, rc 0) 00000100:00100000:3.0:1790740309.598109:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+10:10507:x1877727000942720:12345-192.168.204.3@tcp:101:touch.500 Request processed in 8925us (9253us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1790740309.598124:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 30 00000100:00100000:0.0:1790740309.614473:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740309.615423:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000942976 00000100:00100000:1.0:1790740309.615436:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000942976 00000100:00100000:1.0:1790740309.615499:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 31 00000100:00100000:1.0:1790740309.615511:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+10:10507:x1877727000942976:12345-192.168.204.3@tcp:36:touch.500 00010000:00010000:1.0:1790740309.615568:0:6536:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740309.615839:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92dd1e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c0d expref: 10 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740309.615857:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff98dcaf04d700) 00010000:00010000:1.0:1790740309.615868:0:6536:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790740309.615922:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92dd2c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740309.615937:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92dd2c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740309.615947:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92dd2c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790740309.616937:0:6536:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d4ed8b40 reply state 000000009bdf49a2 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92dd2c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740309.616967:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92dd2c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740309.616975:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff98dc82d92e00) 00010000:00010000:1.0:1790740309.616978:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790740309.616981:0:6536:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790740309.617888:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+11:10507:x1877727000942976:12345-192.168.204.3@tcp:36:touch.500 Request processed in 2375us (3421us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1790740309.617899:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 31 00000100:00100000:2.0:1790740309.622403:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740309.622582:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000943104 00000100:00100000:0.0:1790740309.622596:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000943104 00000100:00100000:0.0:1790740309.622686:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 32 00000100:00100000:0.0:1790740309.622699:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc98536300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+11:10507:x1877727000943104:12345-192.168.204.3@tcp:101:touch.500 00010000:00010000:0.0:1790740309.622734:0:6535:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740309.622760:0:6535:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061600/0xb25dda4f4e92dd33 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23c14 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.622837:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061600/0xb25dda4f4e92dd33 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c14 expref: 12 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.622857:0:6535:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061600/0xb25dda4f4e92dd33 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c14 expref: 12 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.622902:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff98dc82d92e00) 00010000:00010000:0.0:1790740309.622905:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790740309.622910:0:6535:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaf061600, rc 0) 00000100:00100000:0.0:1790740309.622993:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc98536300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+12:10507:x1877727000943104:12345-192.168.204.3@tcp:101:touch.500 Request processed in 297us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740309.623001:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 32 00000100:00100000:0.0:1790740309.632202:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740309.632348:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000943232 00000100:00100000:2.0:1790740309.632364:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000943232 00000100:00100000:2.0:1790740309.632433:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 24 00000100:00100000:2.0:1790740309.632443:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82330380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2401:x1877727000943232:12345-192.168.204.3@tcp:8:touch.500 00010000:00080000:2.0:1790740309.632488:0:8453:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 7bed19f2-4c98-4684-89e7-a6871565665d@192.168.204.3@tcp t0 exp 0000000000000000 cur 380 last 0 00000020:00000080:2.0:1790740309.632532:0:8453:0:(genops.c:1384:class_connect()) connect: client 7bed19f2-4c98-4684-89e7-a6871565665d, cookie 0xb25dda4f4e92dd3a 00002000:00100000:2.0:1790740309.632549:0:8453:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7bed19f2-4c98-4684-89e7-a6871565665d/ffff98db83f0e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790740309.632563:0:8453:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790740309.632672:0:8453:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790740309.632721:0:8453:0:(import.c:65:import_set_state_nolock()) ffff98db83f0f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790740309.632819:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82330380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bed19f2-4c98-4684-89e7-a6871565665d+6:2401:x1877727000943232:12345-192.168.204.3@tcp:8:touch.500 Request processed in 376us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740309.632828:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 24 00000100:00100000:3.0:1790740309.635895:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740309.636009:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000943360 00000100:00100000:2.0:1790740309.636428:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000943360 00000100:00100000:2.0:1790740309.636544:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 25 00000100:00100000:2.0:1790740309.636556:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82c8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bed19f2-4c98-4684-89e7-a6871565665d+6:0:x1877727000943360:12345-192.168.204.3@tcp:2:touch.500 00000100:00080000:3.0:1790740309.638775:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1790740309.650833:0:8446:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:2.0:1790740309.650853:0:8446:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7bed19f2-4c98-4684-89e7-a6871565665d 00000100:00100000:0.0:1790740309.651202:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82c8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bed19f2-4c98-4684-89e7-a6871565665d+5:0:x1877727000943360:12345-192.168.204.3@tcp:2:touch.500 Request processed in 14637us (15308us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1790740309.651216:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 25 00000100:00100000:2.0:1790740309.655977:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740309.658776:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000943616 00000100:00100000:0.0:1790740309.658799:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000943616 00000100:00100000:0.0:1790740309.658881:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 2 00000100:00100000:0.0:1790740309.658893:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc98535500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+12:10507:x1877727000943616:12345-192.168.204.3@tcp:35:touch.500 00000100:00100000:2.0:1790740309.660238:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc98535500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+13:10507:x1877727000943616:12345-192.168.204.3@tcp:35:touch.500 Request processed in 1336us (4267us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1790740309.660254:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 2 00000100:00100000:3.0:1790740309.686913:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740309.687478:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000943744 00000100:00100000:2.0:1790740309.687494:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000943744 00000100:00100000:2.0:1790740309.687648:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 33 00000100:00100000:2.0:1790740309.687661:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82c88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+13:10508:x1877727000943744:12345-192.168.204.3@tcp:101:rm.0 00010000:00010000:2.0:1790740309.687705:0:6537:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740309.687735:0:6537:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33400/0xb25dda4f4e92dd41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23c1b expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.687847:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92dd48 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.687866:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92dd48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.687880:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92dd48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740309.687938:0:6537:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790740309.687942:0:6537:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790740309.687991:0:6537:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92dd48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.688051:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33400/0xb25dda4f4e92dd41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c1b expref: 15 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.688074:0:6537:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92dd48 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c1b expref: 14 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.688101:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98db82949b00) 00010000:00010000:2.0:1790740309.688104:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790740309.688108:0:6537:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f32000, rc 0) 00000100:00100000:2.0:1790740309.688195:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82c88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+14:10508:x1877727000943744:12345-192.168.204.3@tcp:101:rm.0 Request processed in 536us (1296us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740309.688203:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 33 00000100:00100000:3.0:1790740309.693443:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740309.693612:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000944000 00000100:00100000:1.0:1790740309.693626:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000944000 00000100:00100000:1.0:1790740309.693703:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 34 00000100:00100000:1.0:1790740309.693714:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82c88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+14:10508:x1877727000944000:12345-192.168.204.3@tcp:101:rm.0 00010000:00010000:1.0:1790740309.693741:0:6536:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740309.693767:0:6536:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92dd4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23c22 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740309.693916:0:6536:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1790740309.694269:0:6536:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92dd4f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c22 expref: 16 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740309.694289:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98dcaf04bf00) 00010000:00010000:1.0:1790740309.694293:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790740309.694299:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92dd4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c22 expref: 16 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740309.694317:0:6536:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcbfc45e00, rc 0) 00000100:00100000:1.0:1790740309.694400:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82c88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+15:10508:x1877727000944000:12345-192.168.204.3@tcp:101:rm.0 Request processed in 688us (972us total) trans 4294967305 rc 301/301 00000100:00100000:1.0:1790740309.694408:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 34 00000100:00100000:3.0:1790740309.709757:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740309.710119:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000944128 00000100:00100000:2.0:1790740309.710132:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000944128 00000100:00100000:2.0:1790740309.710217:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 3 00000100:00100000:2.0:1790740309.710230:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82c8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+15:10508:x1877727000944128:12345-192.168.204.3@tcp:37:rm.0 00000100:00100000:2.0:1790740309.718862:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82c8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+15:10508:x1877727000944128:12345-192.168.204.3@tcp:37:rm.0 Request processed in 8619us (9104us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740309.718880:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 3 00000100:00100000:3.0:1790740309.723918:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740309.732314:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000944384 00000100:00100000:1.0:1790740309.732347:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000944384 00000100:00100000:1.0:1790740309.732444:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 4 00000100:00100000:1.0:1790740309.732457:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c83050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+15:10508:x1877727000944384:12345-192.168.204.3@tcp:35:rm.0 00000100:00100000:1.0:1790740309.732760:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c83050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+16:10508:x1877727000944384:12345-192.168.204.3@tcp:35:rm.0 Request processed in 306us (8856us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1790740309.732768:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 4 00000100:00100000:3.0:1790740309.737983:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740309.738127:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000944640 00000100:00100000:2.0:1790740309.738140:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000944640 00000100:00100000:2.0:1790740309.738234:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 35 00000100:00100000:2.0:1790740309.738245:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+16:10508:x1877727000944640:12345-192.168.204.3@tcp:101:rm.0 00010000:00010000:2.0:1790740309.738279:0:7760:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740309.738306:0:7760:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33400/0xb25dda4f4e92dd5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23c29 expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.738455:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92dd64 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.738473:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92dd64 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.738505:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92dd64 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740309.738519:0:7760:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1790740309.738714:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33400/0xb25dda4f4e92dd5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c29 expref: 19 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.738737:0:7760:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92dd64 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c29 expref: 18 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.738747:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98db82949b00) 00010000:00010000:2.0:1790740309.738751:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790740309.738755:0:7760:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f33200, rc 0) 00000100:00100000:2.0:1790740309.738839:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+18:10508:x1877727000944640:12345-192.168.204.3@tcp:101:rm.0 Request processed in 595us (871us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1790740309.738848:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 35 00000100:00100000:3.0:1790740309.743298:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740309.743600:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000944768 00000100:00100000:2.0:1790740309.743612:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000944768 00000100:00100000:2.0:1790740309.745127:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 36 00000100:00100000:2.0:1790740309.745155:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82c89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+18:10508:x1877727000944768:12345-192.168.204.3@tcp:41:rm.0 00000004:00000024:2.0:1790740309.745257:0:6537:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:2.0:1790740309.745379:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82c89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+18:10508:x1877727000944768:12345-192.168.204.3@tcp:41:rm.0 Request processed in 238us (2094us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740309.745387:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 36 00000100:00100000:3.0:1790740309.751773:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740309.751866:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000944896 00000100:00100000:0.0:1790740309.751880:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000944896 00000100:00100000:0.0:1790740309.751963:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 37 00000100:00100000:0.0:1790740309.751974:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+18:10508:x1877727000944896:12345-192.168.204.3@tcp:101:rm.0 00010000:00010000:0.0:1790740309.752001:0:6535:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740309.752047:0:6535:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060e00/0xb25dda4f4e92dd72 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23c30 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.752151:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92dd79 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.752169:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92dd79 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.752199:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92dd79 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.752213:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92dd80 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.752221:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92dd80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.752228:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92dd80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.752358:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060800/0xb25dda4f4e92dd87 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.752368:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060800/0xb25dda4f4e92dd87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.752375:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060800/0xb25dda4f4e92dd87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790740309.752416:0:6535:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:0.0:1790740309.752421:0:6535:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790740309.752445:0:6535:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060800/0xb25dda4f4e92dd87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.752459:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060800/0xb25dda4f4e92dd87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.752469:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92dd79 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.752486:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92dd79 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.752493:0:6535:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92dd79 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.752500:0:6535:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf061c00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:0.0:1790740309.752505:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92dd79 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.752513:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92dd79 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.752528:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98db82949b00) 00010000:00010000:0.0:1790740309.752531:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740309.752537:0:6535:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92dd79 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.752543:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92dd79 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.752557:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92dd80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.752562:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92dd80 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.752568:0:6535:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92dd80 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.752577:0:6535:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf061a00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:0.0:1790740309.752585:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92dd80 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.752592:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92dd80 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.752599:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x6a3bfed6 (ffff98dcaf04d200) 00010000:00010000:0.0:1790740309.752601:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740309.752604:0:6535:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92dd80 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.752610:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92dd80 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.752638:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060e00/0xb25dda4f4e92dd72 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c30 expref: 20 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.752652:0:6535:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060800/0xb25dda4f4e92dd87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c30 expref: 19 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.752660:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff98dc82d92e00) 00010000:00010000:0.0:1790740309.752663:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790740309.752666:0:6535:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaf060800, rc 0) 00000100:00100000:0.0:1790740309.752760:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+19:10508:x1877727000944896:12345-192.168.204.3@tcp:101:rm.0 Request processed in 787us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740309.752769:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 37 00000100:00100000:3.0:1790740309.756915:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740309.756992:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000945152 00000100:00100000:1.0:1790740309.757010:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000945152 00000100:00100000:1.0:1790740309.757133:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 38 00000100:00100000:1.0:1790740309.757606:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82c88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+19:10508:x1877727000945152:12345-192.168.204.3@tcp:36:rm.0 00010000:00010000:1.0:1790740309.757695:0:13222:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1790740309.757729:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060800/0xb25dda4f4e92dd87 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c30 expref: 19 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740309.757762:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061600/0xb25dda4f4e92dd33 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c14 expref: 18 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740309.757777:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff98dc82d92e00) 00010000:00010000:1.0:1790740309.757790:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92dd48 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c1b expref: 17 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740309.757801:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98db82949b00) 00010000:00010000:1.0:1790740309.757822:0:13222:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790740309.757854:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92dd8e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740309.757873:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92dd8e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740309.757885:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92dd8e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740309.757897:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92dd95 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740309.757905:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92dd95 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740309.757911:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92dd95 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740309.758116:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44a00/0xb25dda4f4e92dd9c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740309.758127:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44a00/0xb25dda4f4e92dd9c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740309.758135:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44a00/0xb25dda4f4e92dd9c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790740309.759118:0:13222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1790740309.759133:0:13222:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 381045100531ns, next at 382045097566ns, rc = 0 00010000:00010000:0.0:1790740309.760171:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060e00/0xb25dda4f4e92dda3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.760196:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060e00/0xb25dda4f4e92dda3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.760226:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060e00/0xb25dda4f4e92dda3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.760236:0:13222:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060e00/0xb25dda4f4e92dda3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.760243:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060e00/0xb25dda4f4e92dda3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.760249:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060e00/0xb25dda4f4e92dda3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.760276:0:13222:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790740309.760305:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44a00/0xb25dda4f4e92dd9c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.760312:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44a00/0xb25dda4f4e92dd9c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.760318:0:13222:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44a00/0xb25dda4f4e92dd9c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.760468:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790740309.760476:0:6523:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060e00/0xb25dda4f4e92dda3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.760490:0:6523:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf060e00 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:2.0:1790740309.760494:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060e00/0xb25dda4f4e92dda3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.760503:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060e00/0xb25dda4f4e92dda3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.760517:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff98dc82d92e00) 00010000:00010000:2.0:1790740309.760520:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1790740309.760524:0:6523:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060e00/0xb25dda4f4e92dda3 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.760530:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060e00/0xb25dda4f4e92dda3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.760544:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740309.760545:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740309.760547:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740309.760576:0:13222:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc44a00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:0.0:1790740309.760580:0:13222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44a00/0xb25dda4f4e92dd9c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.760586:0:13222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44a00/0xb25dda4f4e92dd9c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.760594:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff98dc82d92e00) 00010000:00010000:0.0:1790740309.760596:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1790740309.760605:0:13222:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44a00/0xb25dda4f4e92dd9c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.760612:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44a00/0xb25dda4f4e92dd9c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.760629:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92dd8e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.760636:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92dd8e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.760642:0:13222:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92dd8e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.760648:0:13222:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc45e00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:0.0:1790740309.760650:0:13222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92dd8e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.760656:0:13222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92dd8e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.760664:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98db82949b00) 00010000:00010000:0.0:1790740309.760667:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740309.760670:0:13222:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92dd8e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.760686:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92dd8e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790740309.760700:0:13222:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000813fa3dd reply state 00000000c6c7e8d6 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92dd95 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.760724:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92dd95 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740309.760731:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x6a3bfed6 (ffff98dcaf04d200) 00010000:00010000:0.0:1790740309.760733:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790740309.760738:0:13222:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790740309.760856:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82c88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+18:10508:x1877727000945152:12345-192.168.204.3@tcp:36:rm.0 Request processed in 3709us (3943us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1790740309.760867:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 38 00000100:00100000:3.0:1790740309.764686:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740309.764799:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000945408 00000100:00100000:1.0:1790740309.764809:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000945408 00000100:00100000:1.0:1790740309.764869:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 5 00000100:00100000:1.0:1790740309.764894:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82c88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+18:10508:x1877727000945408:12345-192.168.204.3@tcp:35:rm.0 00000100:00100000:1.0:1790740309.765165:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82c88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+19:10508:x1877727000945408:12345-192.168.204.3@tcp:35:rm.0 Request processed in 273us (500us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1790740309.765173:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 5 00000100:00100000:3.0:1790740309.767687:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740309.767812:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000945664 00000100:00100000:2.0:1790740309.767831:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000945664 00000100:00100000:2.0:1790740309.767922:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 39 00000100:00100000:2.0:1790740309.767936:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82c8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+19:10508:x1877727000945664:12345-192.168.204.3@tcp:36:rm.0 00010000:00010000:2.0:1790740309.768021:0:6537:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1790740309.768093:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92dd64 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c29 expref: 19 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.768126:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061200/0xb25dda4f4e92dd02 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c06 expref: 18 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.768190:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98db82949b00) 00010000:00010000:2.0:1790740309.768223:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92dcc3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23bf8 expref: 17 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.768233:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98dcaf04bf00) 00010000:00010000:2.0:1790740309.768242:0:6537:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790740309.768274:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33400/0xb25dda4f4e92ddaa lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.768289:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33400/0xb25dda4f4e92ddaa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.768300:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33400/0xb25dda4f4e92ddaa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.768313:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32800/0xb25dda4f4e92ddb1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.768502:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32800/0xb25dda4f4e92ddb1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.768513:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32800/0xb25dda4f4e92ddb1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.768611:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92ddb8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.768620:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92ddb8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.768638:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92ddb8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740309.769071:0:6537:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1790740309.769091:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92ddb8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.769099:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92ddb8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.769107:0:6537:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92ddb8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.769114:0:6537:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f32e00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740309.769119:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92ddb8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.769128:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92ddb8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.769137:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98dcaf04bb00) 00010000:00010000:2.0:1790740309.769140:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1790740309.769145:0:6537:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92ddb8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.769151:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92ddb8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.769759:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33400/0xb25dda4f4e92ddaa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.769770:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33400/0xb25dda4f4e92ddaa lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.769790:0:6537:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33400/0xb25dda4f4e92ddaa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.769797:0:6537:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f33400 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740309.769801:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33400/0xb25dda4f4e92ddaa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.769808:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33400/0xb25dda4f4e92ddaa lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.769818:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98dcaf04b300) 00010000:00010000:2.0:1790740309.769821:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740309.769824:0:6537:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33400/0xb25dda4f4e92ddaa lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.769830:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33400/0xb25dda4f4e92ddaa lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790740309.769847:0:6537:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000008dfefa0 reply state 000000009fd5c87b transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32800/0xb25dda4f4e92ddb1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.769859:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32800/0xb25dda4f4e92ddb1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740309.769866:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98dcaf04bc00) 00010000:00010000:2.0:1790740309.769869:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790740309.769871:0:6537:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790740309.769968:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82c8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+18:10508:x1877727000945664:12345-192.168.204.3@tcp:36:rm.0 Request processed in 2034us (2299us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1790740309.769978:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 39 00000100:00100000:3.0:1790740310.436524:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740310.436621:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740310.436674:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740310.436716:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740310.436740:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740310.436767:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740310.436878:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000946048 00000100:00100000:1.0:1790740310.436892:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000946048 00000100:00100000:1.0:1790740310.436984:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000946304 00000100:00100000:1.0:1790740310.436989:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000946304 00000100:00100000:1.0:1790740310.437003:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000945920 00000100:00100000:1.0:1790740310.437005:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000945920 00000100:00100000:1.0:1790740310.437017:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000946432 00000100:00100000:1.0:1790740310.437231:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000946432 00000100:00100000:1.0:1790740310.437263:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 210 00000100:00100000:1.0:1790740310.437274:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfd02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+5:2403:x1877727000946048:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1790740310.437388:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfd02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+5:2403:x1877727000946048:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 115us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740310.437396:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 210 00000100:00100000:1.0:1790740310.437417:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 211 00000100:00100000:1.0:1790740310.437425:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfd02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2403:x1877727000946304:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1790740310.437450:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfd02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2403:x1877727000946304:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 27us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740310.437456:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 211 00000100:00100000:1.0:1790740310.437467:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 212 00000100:00100000:1.0:1790740310.437473:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfd02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+18:2403:x1877727000945920:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1790740310.437502:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfd02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+18:2403:x1877727000945920:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 29us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740310.437526:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 212 00000100:00100000:1.0:1790740310.437538:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 213 00000100:00100000:1.0:1790740310.437544:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfd03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2403:x1877727000946432:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1790740310.437568:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfd03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2403:x1877727000946432:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 25us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740310.437575:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 213 00000100:00080000:3.0:1790740310.437650:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790740310.437655:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790740310.438466:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000945792 00000100:00100000:2.0:1790740310.438476:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000945792 00000100:00100000:2.0:1790740310.438538:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 336 00000100:00100000:2.0:1790740310.438547:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99054050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:2403:x1877727000945792:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740310.438694:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000946176 00000100:00100000:3.0:1790740310.438699:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000946176 00000100:00100000:3.0:1790740310.438749:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 86 00000100:00100000:3.0:1790740310.438757:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfd03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bed19f2-4c98-4684-89e7-a6871565665d+5:2403:x1877727000946176:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740310.438817:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfd03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bed19f2-4c98-4684-89e7-a6871565665d+5:2403:x1877727000946176:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 60us (2074us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740310.438824:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 86 00000100:00100000:2.0:1790740310.439006:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99054050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:2403:x1877727000945792:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 354us (2394us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740310.439015:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 336 00010000:00010000:2.0:1790740310.506483:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740310.635899:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82330700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727022000896:0@lo:400:kworker.0 00000100:00100000:0.0:1790740310.636008:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740310.636125:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82332a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022001408:0@lo:400:kworker.0 00000100:00100000:0.0:1790740310.636158:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740310.636185:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022001920:0@lo:400:kworker.0 00000100:00100000:0.0:1790740310.636212:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740310.636230:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022002432:0@lo:400:kworker.0 00000100:00100000:0.0:1790740310.636252:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740310.636281:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1790740310.636287:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877727022001024:0@lo:400:kworker.0 00000100:00100000:0.0:1790740310.636316:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740310.636337:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82331f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1877727022001536:0@lo:400:kworker.0 00000100:00100000:0.0:1790740310.636358:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740310.636375:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1877727022002048:0@lo:400:kworker.0 00000100:00100000:0.0:1790740310.636396:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740310.636436:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82330e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877727022001280:0@lo:400:kworker.0 00000100:00100000:0.0:1790740310.636461:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740310.636478:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022001792:0@lo:400:kworker.0 00000100:00100000:0.0:1790740310.636499:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740310.636517:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022002304:0@lo:400:kworker.0 00000100:00100000:0.0:1790740310.636540:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740310.636560:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1790740310.636564:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022001152:0@lo:400:kworker.0 00000100:00100000:0.0:1790740310.636586:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740310.636609:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1877727022001664:0@lo:400:kworker.0 00000100:00100000:0.0:1790740310.636630:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740310.636646:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1877727022002176:0@lo:400:kworker.0 00000100:00100000:0.0:1790740310.636681:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740310.636725:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022001408 00000100:00100000:0.0:1790740310.636734:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022001408 00000100:00100000:0.0:1790740310.636787:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022001152 00000100:00100000:0.0:1790740310.636790:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022001152 00000100:00100000:0.0:1790740310.636809:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1790740310.636818:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84495c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727022001408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740310.636885:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84495c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727022001408:12345-0@lo:400:kworker.0 Request processed in 68us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740310.636893:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1790740310.636915:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1790740310.636920:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84495180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022001152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740310.636952:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84495180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022001152:12345-0@lo:400:kworker.0 Request processed in 31us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740310.636969:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1790740310.636987:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022001920 00000100:00100000:0.0:1790740310.636991:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022001920 00000100:00100000:0.0:1790740310.637007:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022002432 00000100:00100000:0.0:1790740310.637009:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022002432 00000100:00100000:0.0:1790740310.637058:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022001792 00000100:00100000:0.0:1790740310.637061:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022001792 00000100:00100000:0.0:1790740310.637073:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022002304 00000100:00100000:0.0:1790740310.637076:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022002304 00000100:00100000:0.0:1790740310.637090:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1790740310.637096:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84496a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727022001920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740310.637128:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84496a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727022001920:12345-0@lo:400:kworker.0 Request processed in 32us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740310.637134:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1790740310.637146:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790740310.637151:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84496300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727022002432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740310.637177:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84496300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727022002432:12345-0@lo:400:kworker.0 Request processed in 26us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740310.637182:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790740310.637192:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1790740310.637197:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022001792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740310.637217:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022001792:12345-0@lo:400:kworker.0 Request processed in 21us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740310.637223:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1790740310.637231:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1790740310.637236:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb6f3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022002304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740310.637281:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb6f3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022002304:12345-0@lo:400:kworker.0 Request processed in 45us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740310.637287:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1790740310.637509:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022001024 00000100:00100000:0.0:1790740310.637514:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022001024 00000100:00100000:0.0:1790740310.637535:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022001536 00000100:00100000:0.0:1790740310.637538:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022001536 00000100:00100000:0.0:1790740310.637553:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022002048 00000100:00100000:0.0:1790740310.637556:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022002048 00000100:00100000:0.0:1790740310.637567:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022001280 00000100:00100000:0.0:1790740310.637569:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022001280 00000100:00100000:0.0:1790740310.637576:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022001664 00000100:00100000:0.0:1790740310.637579:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022001664 00000100:00100000:0.0:1790740310.637590:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022002176 00000100:00100000:0.0:1790740310.637593:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022002176 00000100:00100000:0.0:1790740310.637606:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1790740310.637612:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84496680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877727022001024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740310.637648:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84496680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877727022001024:12345-0@lo:400:kworker.0 Request processed in 36us (1331us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740310.637654:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1790740310.637679:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1790740310.637685:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84497100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877727022001536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740310.637713:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84497100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877727022001536:12345-0@lo:400:kworker.0 Request processed in 29us (1354us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740310.637719:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1790740310.637729:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1790740310.637735:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84497800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877727022002048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740310.637763:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84497800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877727022002048:12345-0@lo:400:kworker.0 Request processed in 28us (1365us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740310.637776:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1790740310.637787:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1790740310.637792:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877727022001280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740310.637818:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877727022001280:12345-0@lo:400:kworker.0 Request processed in 27us (1357us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740310.637824:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1790740310.637832:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1790740310.637837:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877727022001664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740310.637858:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877727022001664:12345-0@lo:400:kworker.0 Request processed in 22us (1228us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740310.637864:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1790740310.637872:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1790740310.637877:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84495f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1877727022002176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740310.637898:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84495f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1877727022002176:12345-0@lo:400:kworker.0 Request processed in 21us (1216us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740310.637903:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00080000:0.0:1790740310.637948:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790740310.637953:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790740310.637956:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790740310.637993:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022001152:0@lo:400:kworker.0 00010000:00080000:0.0:1790740310.638008:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db82332d80 x1877727022001664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740310.638019:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1877727022001664:0@lo:400:kworker.0 00010000:00080000:0.0:1790740310.638028:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db84494700 x1877727022002176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740310.638071:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1877727022002176:0@lo:400:kworker.0 00000100:00100000:0.0:1790740310.638086:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82330e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877727022001280:0@lo:400:kworker.0 00010000:00080000:0.0:1790740310.638097:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db82330a80 x1877727022001792/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740310.638106:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022001792:0@lo:400:kworker.0 00010000:00080000:0.0:1790740310.638117:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db84494000 x1877727022002304/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740310.638125:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022002304:0@lo:400:kworker.0 00000100:00100000:0.0:1790740310.638171:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877727022001024:0@lo:400:kworker.0 00000100:00100000:0.0:1790740310.638183:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82331f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1877727022001536:0@lo:400:kworker.0 00000100:00100000:0.0:1790740310.638193:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1877727022002048:0@lo:400:kworker.0 00000100:00100000:0.0:1790740310.638206:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82332a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022001408:0@lo:400:kworker.0 00010000:00080000:0.0:1790740310.638217:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db84495880 x1877727022001920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740310.638226:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022001920:0@lo:400:kworker.0 00010000:00080000:0.0:1790740310.638237:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db84497480 x1877727022002432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740310.638245:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022002432:0@lo:400:kworker.0 00000100:00100000:2.0:1790740310.640391:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98537100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022002560:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790740310.640424:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022000896 00000100:00100000:3.0:1790740310.640436:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022000896 00000100:00100000:2.0:1790740310.640497:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740310.640501:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1790740310.640511:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99055850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3640:x1877727022000896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740310.640555:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022002560 00000100:00100000:2.0:1790740310.640559:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022002560 00000100:00100000:2.0:1790740310.640596:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1790740310.640602:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc98536a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022002560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790740310.640631:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790740310.640772:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790740310.640793:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022002688:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790740310.640831:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99055850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3640:x1877727022000896:12345-0@lo:400:kworker.0 Request processed in 322us (4824us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740310.640857:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1790740310.649467:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc98536a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022002560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8849us (8954us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740310.649490:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:2.0:1790740310.649609:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dc98537100 x1877727022002560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740326 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740310.649641:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98537100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022002560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790740310.649707:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82330700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727022000896:0@lo:400:kworker.0 00000100:00100000:0.0:1790740310.650672:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740310.657129:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022002688 00000100:00100000:2.0:1790740310.657155:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022002688 00000100:00100000:2.0:1790740310.657257:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790740310.657269:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84497480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022002688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790740310.657342:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790740310.657458:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84497480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022002688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 192us (6800us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740310.657467:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:0.0:1790740310.657705:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcbd5f8700 x1877727022002688/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740326 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740310.657731:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022002688:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1790740311.532185:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740311.659917:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfd03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022002816:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790740311.660016:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740311.660502:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022002816 00000100:00100000:1.0:1790740311.660515:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022002816 00000100:00100000:1.0:1790740311.660918:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1790740311.660933:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfd00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022002816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790740311.661062:0:7846:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790740311.661143:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfd00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022002816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 214us (1127us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740311.661154:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1790740311.661301:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfd03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022002816:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1790740312.557024:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740313.580498:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740313.711688:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022002944:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790740313.711786:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740313.713449:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022002944 00000100:00100000:0.0:1790740313.713467:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022002944 00000100:00100000:0.0:1790740313.713551:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1790740313.713564:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc98537100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022002944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790740313.713633:0:6540:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1790740313.713740:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc98537100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022002944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 179us (1953us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740313.713748:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1790740313.713818:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022002944:0@lo:41:osp-pre-0-1.0 00000001:02000400:3.0:1790740313.766407:0:13705:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000004:00080000:2.0:1790740314.218265:0:8611:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 385504230204ns, next at 386504226158ns, rc = 0 00000100:00100000:3.0:1790740314.218352:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98535180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022003072:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790740314.218449:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740314.218648:0:10118:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022003072 00000100:00100000:2.0:1790740314.218658:0:10118:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022003072 00000100:00100000:2.0:1790740314.218732:0:10118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790740314.218745:0:10118:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfd03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022003072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790740314.218781:0:10118:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790740314.218835:0:10118:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfd03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022003072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740314.218842:0:10118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:3.0:1790740314.218903:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790740314.218944:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dc98535180 x1877727022003072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740330 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740314.218968:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98535180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022003072:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790740314.219688:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98535180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022003200:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790740314.219733:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740314.219835:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022003200 00000100:00100000:2.0:1790740314.219841:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022003200 00000100:00100000:2.0:1790740314.219892:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1790740314.219900:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfd01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022003200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790740314.219917:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790740314.219952:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfd01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022003200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740314.219959:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:3.0:1790740314.220054:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790740314.220078:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dc98535180 x1877727022003200/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740330 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740314.220093:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98535180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022003200:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1790740314.603436:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790740314.747490:0:13753:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff2bda2cf0 20000000:00000080:0.0:1790740314.747514:0:13753:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98db83ead000 uarg=0000000000000000 20000000:01000000:0.0:1790740314.747576:0:13753:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1790740314.747597:0:13753:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1790740314.747604:0:13753:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1790740314.748765:0:13754:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1790740314.748900:0:13753:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1790740314.761465:0:13753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000004:00080000:1.0:1790740314.769499:0:6514:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000040:00080000:2.0:1790740314.769618:0:13753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1790740314.769686:0:13753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1790740314.769708:0:13753:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1790740314.769729:0:13753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98db83f32200/0xb25dda4f4e92ddbf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740314.769750:0:13753:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dcbfc44400/0xb25dda4f4e92dc4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23be3 expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740314.769759:0:13753:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98db83f33800/0xb25dda4f4e92dc53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23bea expref: 12 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740314.769768:0:13753:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dcbfc44600/0xb25dda4f4e92dc61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92dc5a expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740314.769775:0:13753:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dcbfc45000/0xb25dda4f4e92dc6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92dc68 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740314.769782:0:13753:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dcb5dc9800/0xb25dda4f4e92dc7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92dc76 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740314.769788:0:13753:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dcb5dc9400/0xb25dda4f4e92dc8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92dc84 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740314.769797:0:13753:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98db83f32200/0xb25dda4f4e92ddbf lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740314.769835:0:13753:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dcb5dc9400/0xb25dda4f4e92dc8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92dc84 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740314.769851:0:13753:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98dcb5dc9400/0xb25dda4f4e92dc8b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92dc84 expref: 23 pid: 6529 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740314.769878:0:13753:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98534380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13753:1877727022003328:0@lo:104: 00000100:00100000:2.0:1790740314.769945:0:13753:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740314.769997:0:6518:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1790740314.770011:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022003328 00000100:00100000:2.0:1790740314.770020:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022003328 00000100:00100000:3.0:1790740314.770142:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790740314.770143:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790740314.770157:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd50c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+3:13753:x1877727022003328:12345-0@lo:104: 00000100:00100000:3.0:1790740314.770169:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfd01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022003456:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1790740314.770171:0:6518:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff98dcbfc44200/0xb25dda4f4e92dc84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92dc8b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740314.770249:0:6518:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790740314.770257:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740314.770268:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd50c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+3:13753:x1877727022003328:12345-0@lo:104: Request processed in 106us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740314.770280:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:2.0:1790740314.770339:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790740314.770345:0:6523:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dcbfc44200/0xb25dda4f4e92dc84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92dc8b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740314.770354:0:6523:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc44200 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:2.0:1790740314.770358:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dcbfc44200/0xb25dda4f4e92dc84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92dc8b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740314.770369:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dcbfc44200/0xb25dda4f4e92dc84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92dc8b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790740314.770377:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dcbfc44200/0xb25dda4f4e92dc84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92dc8b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740314.770399:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790740314.770439:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dcbfc44200/0xb25dda4f4e92dc84 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92dc8b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740314.770460:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790740314.770487:0:6523:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dcbfc44200/0xb25dda4f4e92dc84 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92dc8b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740314.770495:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dcbfc44200/0xb25dda4f4e92dc84 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92dc8b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740314.770508:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740314.770510:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740314.770512:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740314.770546:0:13753:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dcb5dc9800/0xb25dda4f4e92dc7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92dc76 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740314.770555:0:13753:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98dcb5dc9800/0xb25dda4f4e92dc7d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92dc76 expref: 23 pid: 6529 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740314.770564:0:13753:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98535500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13753:1877727022003712:0@lo:104: 00000100:00100000:2.0:1790740314.770609:0:13753:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740314.770633:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022003712 00000100:00100000:2.0:1790740314.770638:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022003712 00000100:00100000:2.0:1790740314.770663:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790740314.770669:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc98535180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+3:13753:x1877727022003712:12345-0@lo:104: 00010000:00010000:2.0:1790740314.770677:0:6518:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92dc76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92dc7d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740314.770719:0:6518:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790740314.770725:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc98535180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+3:13753:x1877727022003712:12345-0@lo:104: Request processed in 56us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740314.770732:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790740314.770757:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98534e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727022003584:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790740314.770771:0:13753:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dcbfc45000/0xb25dda4f4e92dc6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92dc68 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740314.770783:0:13753:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98dcbfc45000/0xb25dda4f4e92dc6f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92dc68 expref: 23 pid: 6529 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740314.770795:0:13753:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13753:1877727022003840:0@lo:104: 00000100:00100000:3.0:1790740314.770805:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740314.770836:0:13753:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740314.770877:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022003840 00010000:00010000:3.0:1790740314.770882:0:10357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1790740314.770883:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022003840 00010000:00010000:3.0:1790740314.770893:0:10357:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92dc76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92dc7d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740314.770907:0:10357:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f33a00 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:3.0:1790740314.770911:0:10357:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92dc76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92dc7d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740314.770913:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790740314.770925:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+3:13753:x1877727022003840:12345-0@lo:104: 00010000:00010000:3.0:1790740314.770930:0:10357:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92dc76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92dc7d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740314.770935:0:6518:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8a00/0xb25dda4f4e92dc68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92dc6f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790740314.770946:0:10357:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92dc76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92dc7d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740314.770955:0:10357:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790740314.770988:0:6518:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1790740314.770995:0:10357:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92dc76 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92dc7d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740314.770996:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+3:13753:x1877727022003840:12345-0@lo:104: Request processed in 74us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740314.771019:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:3.0:1790740314.771020:0:10357:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790740314.771091:0:10357:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92dc76 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92dc7d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740314.771092:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790740314.771103:0:6524:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8a00/0xb25dda4f4e92dc68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92dc6f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740314.771105:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92dc76 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92dc7d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740314.771134:0:6524:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc8a00 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:2.0:1790740314.771148:0:6524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8a00/0xb25dda4f4e92dc68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92dc6f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740314.771152:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740314.771155:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740314.771161:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740314.771162:0:6524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8a00/0xb25dda4f4e92dc68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92dc6f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790740314.771171:0:6524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8a00/0xb25dda4f4e92dc68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92dc6f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740314.771177:0:6524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1790740314.771179:0:10416:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022003584 00010000:00010000:2.0:1790740314.771197:0:6524:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8a00/0xb25dda4f4e92dc68 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92dc6f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740314.771206:0:6524:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790740314.771220:0:6524:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8a00/0xb25dda4f4e92dc68 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92dc6f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740314.771227:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8a00/0xb25dda4f4e92dc68 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92dc6f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740314.771238:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740314.771239:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740314.771241:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740314.771265:0:13753:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dcbfc44600/0xb25dda4f4e92dc61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92dc5a expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740314.771272:0:13753:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98dcbfc44600/0xb25dda4f4e92dc61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92dc5a expref: 23 pid: 6529 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740314.771279:0:13753:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13753:1877727022004224:0@lo:104: 00000100:00100000:2.0:1790740314.771300:0:13753:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740314.771326:0:6518:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022004224 00000100:00100000:2.0:1790740314.771330:0:6518:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022004224 00000100:00100000:2.0:1790740314.771347:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790740314.771352:0:6518:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+3:13753:x1877727022004224:12345-0@lo:104: 00010000:00010000:2.0:1790740314.771359:0:6518:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8c00/0xb25dda4f4e92dc5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92dc61 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740314.771378:0:10416:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022003584 00010000:00010000:2.0:1790740314.771391:0:6518:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790740314.771398:0:6518:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+3:13753:x1877727022004224:12345-0@lo:104: Request processed in 46us (96us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740314.771407:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:3.0:1790740314.771422:0:10416:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dcb5dc9400/0xb25dda4f4e92dc8b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92dc84 expref: 24 pid: 6529 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740314.771427:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790740314.771437:0:6523:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8c00/0xb25dda4f4e92dc5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92dc61 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740314.771461:0:6523:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc8c00 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:2.0:1790740314.771467:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8c00/0xb25dda4f4e92dc5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92dc61 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740314.771475:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8c00/0xb25dda4f4e92dc5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92dc61 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790740314.771480:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8c00/0xb25dda4f4e92dc5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92dc61 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740314.771485:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790740314.771502:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8c00/0xb25dda4f4e92dc5a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92dc61 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740314.771503:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00010000:00010000:2.0:1790740314.771514:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1790740314.771520:0:10416:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfd00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3640:x1877727022003584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790740314.771539:0:6523:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8c00/0xb25dda4f4e92dc5a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92dc61 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740314.771542:0:10416:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740314.771553:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8c00/0xb25dda4f4e92dc5a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92dc61 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740314.771554:0:10416:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dcb5dc9400/0xb25dda4f4e92dc8b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92dc84 expref: 24 pid: 6529 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740314.771597:0:10416:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dcb5dc9400/0xb25dda4f4e92dc8b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92dc84 expref: 24 pid: 6529 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740314.771603:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740314.771606:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740314.771612:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740314.771623:0:10416:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790740314.771645:0:13753:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98db83f33800/0xb25dda4f4e92dc53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23bea expref: 12 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740314.771660:0:13753:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98db83f33800/0xb25dda4f4e92dc53 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23bea expref: 12 pid: 6530 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740314.771673:0:13753:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13753:1877727022004480:192.168.204.3@tcp:104: 00000100:00100000:3.0:1790740314.771686:0:10416:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfd00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3640:x1877727022003584:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740314.771696:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790740314.771728:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfd02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3641:1877727022003968:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790740314.771741:0:13753:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dcbfc44400/0xb25dda4f4e92dc4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23be3 expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740314.771753:0:13753:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98dcbfc44400/0xb25dda4f4e92dc4c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23be3 expref: 12 pid: 6529 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740314.771765:0:13753:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefd8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13753:1877727022004608:192.168.204.3@tcp:104: 00000100:00100000:3.0:1790740314.771775:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:1.0:1790740314.771860:0:6514:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:1.0:1790740314.771877:0:6514:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:0.0:1790740314.772201:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92dd17 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740314.772211:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92dd17 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740314.772217:0:3624:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92dd17 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740314.772231:0:3624:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc9c00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:0.0:1790740314.772235:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92dd17 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740314.772242:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92dd17 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740314.772257:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x6a3bfed6 (ffff98dcaf04d200) 00010000:00010000:0.0:1790740314.772261:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740314.772265:0:3624:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92dd17 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740314.772272:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92dd17 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740314.772287:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92dd2c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740314.772293:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92dd2c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740314.772299:0:3624:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92dd2c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740314.772304:0:3624:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc44000 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:0.0:1790740314.772307:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92dd2c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740314.772313:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92dd2c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740314.772331:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff98dc82d92e00) 00010000:00010000:0.0:1790740314.772333:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740314.772337:0:3624:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92dd2c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740314.772342:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92dd2c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740314.772359:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92dd95 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740314.772365:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92dd95 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740314.772371:0:3624:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92dd95 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740314.772376:0:3624:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc44c00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:0.0:1790740314.772379:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92dd95 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740314.772386:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92dd95 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740314.772392:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x6a3bfed6 (ffff98dcaf04d200) 00010000:00010000:0.0:1790740314.772395:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740314.772397:0:3624:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92dd95 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740314.772403:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92dd95 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740314.772425:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32800/0xb25dda4f4e92ddb1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740314.772433:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32800/0xb25dda4f4e92ddb1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740314.772439:0:3624:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32800/0xb25dda4f4e92ddb1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740314.772444:0:3624:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f32800 already unused, calling callback (ffffffffc19674f0) 00000100:00100000:2.0:1790740314.772527:0:13753:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83efff00 going to sleep for 11 seconds 00010000:00010000:2.0:1790740314.772557:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcb5dc9400/0xb25dda4f4e92dc8b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92dc84 expref: 23 pid: 6529 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740314.772567:0:13753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98534380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13753:1877727022003328:0@lo:104: 00000100:00100000:2.0:1790740314.772591:0:13753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98535500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13753:1877727022003712:0@lo:104: 00000100:00100000:2.0:1790740314.772612:0:13753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13753:1877727022003840:0@lo:104: 00000100:00100000:2.0:1790740314.772618:0:13753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13753:1877727022004224:0@lo:104: 00010000:00010000:0.0:1790740314.772658:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32800/0xb25dda4f4e92ddb1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740314.772666:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32800/0xb25dda4f4e92ddb1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740314.772676:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98dcaf04bc00) 00010000:00010000:0.0:1790740314.772679:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740314.772682:0:3624:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32800/0xb25dda4f4e92ddb1 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740314.772688:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32800/0xb25dda4f4e92ddb1 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740314.772719:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3639:1877727022004352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790740314.773302:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98534e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727022003584:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790740314.773331:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727022004096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790740314.774958:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740314.775191:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022003456 00000100:00100000:0.0:1790740314.775200:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022003456 00000100:00100000:0.0:1790740314.775252:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790740314.775262:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfd01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022003456:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1790740314.775307:0:8451:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:0.0:1790740314.775343:0:8451:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6abc8755, atime: 0x6abc8755, ctime: 0x6abc8755, blocks: 0x0 00010000:00010000:0.0:1790740314.775352:0:8451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000341a98d4/0xb25dda4f4e92ddc6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740314.775369:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=386s v=(0 0) 00010000:00010000:0.0:1790740314.775374:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740314.775381:0:8451:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000341a98d4/0xb25dda4f4e92ddc6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740314.775402:0:8451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000341a98d4/0xb25dda4f4e92ddc6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740314.775414:0:8451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000341a98d4/0xb25dda4f4e92ddc6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740314.775430:0:8451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000341a98d4/0xb25dda4f4e92ddc6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740314.775520:0:8451:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790740314.775687:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfd01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1877727022003456:12345-0@lo:6:osp-syn-0-0.0 Request processed in 426us (5432us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1790740314.775694:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790740314.775862:0:9550:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022003968 00000100:00100000:1.0:1790740314.775868:0:9550:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022003968 00000100:00100000:3.0:1790740314.775878:0:6520:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022004352 00010000:00010000:1.0:1790740314.775894:0:9550:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dcb5dc9800/0xb25dda4f4e92dc7d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92dc76 expref: 23 pid: 6529 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740314.775917:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790740314.775923:0:9550:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfd01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:3641:x1877727022003968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790740314.775940:0:9550:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740314.775946:0:9550:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dcb5dc9800/0xb25dda4f4e92dc7d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92dc76 expref: 23 pid: 6529 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740314.775950:0:6520:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022004352 00010000:00010000:1.0:1790740314.775960:0:9550:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dcb5dc9800/0xb25dda4f4e92dc7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92dc76 expref: 23 pid: 6529 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740314.775975:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcb5dc9800/0xb25dda4f4e92dc7d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92dc76 expref: 23 pid: 6529 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740314.775990:0:9550:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740314.776027:0:9550:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfd01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:3641:x1877727022003968:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (4260us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740314.776054:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:3.0:1790740314.776162:0:6520:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dcbfc44600/0xb25dda4f4e92dc61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92dc5a expref: 22 pid: 6529 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740314.776230:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740314.776285:0:6520:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022004096 00000100:00100000:3.0:1790740314.776291:0:6520:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022004096 00000004:00080000:2.0:1790740314.776300:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98dcbfd01500/2, rc 0, transno 4294967301 00010000:00010000:3.0:1790740314.776313:0:6520:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dcbfc45000/0xb25dda4f4e92dc6f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92dc68 expref: 23 pid: 6529 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740314.776314:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfd01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022003456:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1790740314.776361:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790740314.776370:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790740314.776375:0:6520:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84495880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:3639:x1877727022004352:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790740314.776387:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaefdad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:3638:x1877727022004096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790740314.776398:0:6521:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740314.776406:0:6521:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dcbfc45000/0xb25dda4f4e92dc6f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92dc68 expref: 23 pid: 6529 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740314.776409:0:6520:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740314.776422:0:6520:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dcbfc44600/0xb25dda4f4e92dc61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92dc5a expref: 23 pid: 6529 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740314.776425:0:6521:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dcbfc45000/0xb25dda4f4e92dc6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92dc68 expref: 23 pid: 6529 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740314.777089:0:10357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790740314.777098:0:10357:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000341a98d4/0xb25dda4f4e92ddc6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740314.777121:0:10357:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf060a00 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:1.0:1790740314.777125:0:10357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000341a98d4/0xb25dda4f4e92ddc6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740314.777136:0:10357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000341a98d4/0xb25dda4f4e92ddc6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740314.777155:0:10357:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000341a98d4/0xb25dda4f4e92ddc6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740314.777177:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000341a98d4/0xb25dda4f4e92ddc6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740314.777197:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740314.777199:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740314.777201:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740314.777917:0:6520:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dcbfc44600/0xb25dda4f4e92dc61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92dc5a expref: 23 pid: 6529 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740314.777947:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcbfc45000/0xb25dda4f4e92dc6f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92dc68 expref: 23 pid: 6529 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740314.777953:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcbfc44600/0xb25dda4f4e92dc61 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92dc5a expref: 23 pid: 6529 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740314.777972:0:6521:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790740314.777976:0:6520:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740314.778189:0:6520:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84495880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:3639:x1877727022004352:12345-0@lo:103:ldlm_bl.0 Request processed in 1815us (3231us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740314.778200:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790740314.778235:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3639:1877727022004352:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790740314.778283:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfd02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3641:1877727022003968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790740314.778327:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaefdad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+20:3638:x1877727022004096:12345-0@lo:103:ldlm_bl.0 Request processed in 1942us (2095us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740314.778337:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790740314.778405:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727022004096:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790740314.781927:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740314.782132:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740314.782323:0:13753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13753:1877727022004480:192.168.204.3@tcp:104: 00000100:00100000:2.0:1790740314.782338:0:13753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefd8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13753:1877727022004608:192.168.204.3@tcp:104: 00010000:00010000:2.0:1790740314.782398:0:13753:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98db83f32200/0xb25dda4f4e92ddbf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740314.785676:0:10416:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000946560 00000100:00100000:1.0:1790740314.785701:0:10416:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000946560 00010000:00010000:1.0:1790740314.785835:0:10416:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98db83f33800/0xb25dda4f4e92dc53 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23bea expref: 13 pid: 6530 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740314.785940:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000946688 00000100:00100000:0.0:1790740314.785947:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000946688 00000100:00100000:1.0:1790740314.786088:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 50 00000100:00100000:1.0:1790740314.786101:0:10416:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfd02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:160ca934-a0b3-4cb3-b255-c8d008823f6f+14:2402:x1877727000946560:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740314.786123:0:10416:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740314.786130:0:10416:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98db83f33800/0xb25dda4f4e92dc53 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23bea expref: 14 pid: 6530 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740314.786145:0:10416:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98db83f33800/0xb25dda4f4e92dc53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23bea expref: 14 pid: 6530 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740314.786168:0:10416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98db83f33800/0xb25dda4f4e92dc53 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23bea expref: 14 pid: 6530 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740314.786191:0:10416:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740314.786326:0:10416:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfd02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:2402:x1877727000946560:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 225us (4410us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740314.786344:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 50 00010000:00010000:0.0:1790740314.787735:0:6522:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dcbfc44400/0xb25dda4f4e92dc4c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23be3 expref: 12 pid: 6529 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740314.787786:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 51 00000100:00100000:0.0:1790740314.787801:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfd00a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:160ca934-a0b3-4cb3-b255-c8d008823f6f+12:2403:x1877727000946688:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790740314.787816:0:6522:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740314.787822:0:6522:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dcbfc44400/0xb25dda4f4e92dc4c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23be3 expref: 12 pid: 6529 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740314.787834:0:6522:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dcbfc44400/0xb25dda4f4e92dc4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23be3 expref: 12 pid: 6529 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740314.787851:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcbfc44400/0xb25dda4f4e92dc4c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23be3 expref: 12 pid: 6529 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740314.787869:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98db83f32200/0xb25dda4f4e92ddbf lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740314.787879:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98db83f32200/0xb25dda4f4e92ddbf lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740314.787901:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98db83f32200/0xb25dda4f4e92ddbf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740314.787910:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98db83f32200/0xb25dda4f4e92ddbf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740314.787918:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98db83f32200/0xb25dda4f4e92ddbf lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740314.787926:0:6522:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98db83f32200/0xb25dda4f4e92ddbf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740314.787950:0:6522:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f32200 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:0.0:1790740314.787955:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98db83f32200/0xb25dda4f4e92ddbf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740314.787965:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98db83f32200/0xb25dda4f4e92ddbf lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740314.787985:0:6522:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98db83f32200/0xb25dda4f4e92ddbf lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740314.787998:0:6522:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740314.788082:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfd00a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:160ca934-a0b3-4cb3-b255-c8d008823f6f+11:2403:x1877727000946688:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 288us (5950us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740314.788091:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 51 00010000:00010000:2.0:1790740314.788196:0:13753:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98db83f32200/0xb25dda4f4e92ddbf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740314.788207:0:13753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98db83f32200/0xb25dda4f4e92ddbf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740314.788214:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98db83f32200/0xb25dda4f4e92ddbf lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740315.547001:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740315.547061:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740315.547082:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740315.547108:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740315.547131:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740315.547155:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000946944 00000100:00100000:2.0:1790740315.547157:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000947456 00000100:00100000:3.0:1790740315.547164:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740315.547166:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000947456 00000100:00100000:1.0:1790740315.547166:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000946944 00000100:00100000:3.0:1790740315.547190:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000946816 00000100:00100000:3.0:1790740315.547196:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000946816 00000100:00100000:3.0:1790740315.547237:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 338 00000100:00100000:3.0:1790740315.547245:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99054850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+11:2402:x1877727000946816:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740315.547311:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99054850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+11:2402:x1877727000946816:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 66us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740315.547325:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 338 00000100:00100000:0.0:1790740315.551083:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000947072 00000100:00100000:3.0:1790740315.551085:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000947328 00000100:00100000:3.0:1790740315.551099:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000947328 00000100:00100000:0.0:1790740315.551100:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000947072 00000100:00100000:3.0:1790740315.551163:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 220 00000100:00100000:0.0:1790740315.551172:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 221 00000100:00100000:3.0:1790740315.551177:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfd03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2402:x1877727000947456:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1790740315.551186:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfd00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+5:2402:x1877727000946944:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740315.551259:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfd03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2402:x1877727000947456:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 87us (4175us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740315.551267:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 220 00000100:00100000:3.0:1790740315.551285:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 222 00000100:00100000:3.0:1790740315.551292:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfd03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2402:x1877727000947328:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1790740315.552807:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 223 00000100:00100000:2.0:1790740315.552827:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfd01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+5:2402:x1877727000947072:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1790740315.554452:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfd00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+5:2402:x1877727000946944:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 3258us (7451us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740315.554465:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 221 00000100:00100000:3.0:1790740315.555252:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfd03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2402:x1877727000947328:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 3955us (8084us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740315.555262:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 222 00000100:00080000:3.0:1790740315.555297:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790740315.555303:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790740315.556105:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000947200 00000100:00100000:3.0:1790740315.556116:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000947200 00000100:00100000:3.0:1790740315.556181:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 91 00000100:00100000:3.0:1790740315.556191:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfd00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bed19f2-4c98-4684-89e7-a6871565665d+5:2402:x1877727000947200:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740315.556250:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfd00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bed19f2-4c98-4684-89e7-a6871565665d+5:2402:x1877727000947200:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 61us (9189us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740315.556257:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 91 00000100:00080000:1.0:1790740315.557349:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790740315.557924:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfd01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+5:2402:x1877727000947072:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 5098us (10784us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740315.557937:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 223 00000020:00000080:3.0:1790740315.579169:0:13802:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc2b6c53d0 20000000:00000080:3.0:1790740315.579186:0:13802:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98dcbfc7a000 uarg=0000000000000000 20000000:01000000:3.0:1790740315.579225:0:13802:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1790740315.579235:0:13802:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1790740315.579240:0:13802:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:3.0:1790740315.579957:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:0.0:1790740315.580250:0:13802:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:0.0:1790740315.580327:0:13802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:0.0:1790740315.580356:0:13802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:0.0:1790740315.580371:0:13802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:0.0:1790740315.580382:0:13802:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1790740315.580404:0:13802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98dcaf060e00/0xb25dda4f4e92ddcd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740315.580429:0:13802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcaf060e00/0xb25dda4f4e92ddcd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740315.580439:0:13802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98dcaf060e00/0xb25dda4f4e92ddcd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740315.580446:0:13802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98dcaf060e00/0xb25dda4f4e92ddcd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740315.580452:0:13802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98dcaf060e00/0xb25dda4f4e92ddcd lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740315.580459:0:13802:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98dcaf060e00/0xb25dda4f4e92ddcd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740315.580465:0:13802:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf060e00 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:0.0:1790740315.580470:0:13802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98dcaf060e00/0xb25dda4f4e92ddcd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740315.580477:0:13802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98dcaf060e00/0xb25dda4f4e92ddcd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740315.580488:0:13802:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98dcaf060e00/0xb25dda4f4e92ddcd lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740315.580495:0:13802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98dcaf060e00/0xb25dda4f4e92ddcd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740315.580501:0:13802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcaf060e00/0xb25dda4f4e92ddcd lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740315.628644:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740315.754256:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022004992:0@lo:400:kworker.0 00000100:00100000:0.0:1790740315.754329:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740315.754384:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1877727022005504:0@lo:400:kworker.0 00000100:00100000:0.0:1790740315.754410:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740315.754433:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1877727022006016:0@lo:400:kworker.0 00000100:00100000:0.0:1790740315.754454:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740315.754480:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1790740315.754486:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877727022005120:0@lo:400:kworker.0 00000100:00100000:0.0:1790740315.754507:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740315.754521:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022005632:0@lo:400:kworker.0 00000100:00100000:0.0:1790740315.754543:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740315.754571:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84463b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022006144:0@lo:400:kworker.0 00000100:00100000:0.0:1790740315.754593:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740315.754625:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022004992 00000100:00100000:0.0:1790740315.754633:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022004992 00000100:00100000:0.0:1790740315.754678:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1790740315.754686:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022004992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740315.754740:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022004992:12345-0@lo:400:kworker.0 Request processed in 54us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740315.754748:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1790740315.754770:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022005504 00000100:00100000:0.0:1790740315.754774:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022005504 00000100:00100000:0.0:1790740315.754802:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022006016 00000100:00100000:0.0:1790740315.754805:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022006016 00000100:00100000:0.0:1790740315.754828:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022005120 00000100:00100000:0.0:1790740315.754844:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022005120 00000100:00100000:0.0:1790740315.754863:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1790740315.754869:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5f6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877727022005504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740315.754899:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5f6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877727022005504:12345-0@lo:400:kworker.0 Request processed in 31us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740315.754905:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1790740315.754915:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1790740315.754920:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877727022006016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740315.754943:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877727022006016:12345-0@lo:400:kworker.0 Request processed in 23us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740315.754948:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1790740315.754958:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1790740315.754964:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877727022005120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740315.754987:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877727022005120:12345-0@lo:400:kworker.0 Request processed in 24us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740315.754993:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1790740315.755019:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022005632 00000100:00100000:0.0:1790740315.755022:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022005632 00000100:00100000:0.0:1790740315.755061:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022006144 00000100:00100000:0.0:1790740315.755064:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022006144 00000100:00100000:0.0:1790740315.755084:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1790740315.755090:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022005632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740315.755120:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022005632:12345-0@lo:400:kworker.0 Request processed in 30us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740315.755126:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1790740315.755137:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1790740315.755142:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022006144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740315.755176:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022006144:12345-0@lo:400:kworker.0 Request processed in 34us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740315.755183:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1790740315.755230:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877727022005120:0@lo:400:kworker.0 00000100:00100000:0.0:1790740315.755241:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022005632:0@lo:400:kworker.0 00010000:00080000:0.0:1790740315.755251:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db84463b80 x1877727022006144/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740315.755261:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84463b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022006144:0@lo:400:kworker.0 00000100:00100000:0.0:1790740315.755270:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022004992:0@lo:400:kworker.0 00010000:00080000:0.0:1790740315.755279:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db84494e00 x1877727022005504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740315.755287:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1877727022005504:0@lo:400:kworker.0 00010000:00080000:0.0:1790740315.755297:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db84463800 x1877727022006016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740315.755304:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1877727022006016:0@lo:400:kworker.0 00000100:00080000:1.0:1790740315.755874:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790740315.755879:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790740315.758281:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727022004736:0@lo:400:kworker.0 00000100:00100000:3.0:1790740315.758356:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740315.758412:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84496300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022005248:0@lo:400:kworker.0 00000100:00100000:3.0:1790740315.758460:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740315.758469:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022004736 00000100:00100000:1.0:1790740315.758477:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022004736 00000100:00100000:3.0:1790740315.758485:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84462a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022005760:0@lo:400:kworker.0 00000100:00100000:3.0:1790740315.758509:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740315.758524:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022006272:0@lo:400:kworker.0 00000100:00100000:1.0:1790740315.758525:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1790740315.758533:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+20:3640:x1877727022004736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740315.758543:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740315.758573:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1790740315.758580:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877727022004864:0@lo:400:kworker.0 00000100:00100000:1.0:1790740315.758595:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+20:3640:x1877727022004736:12345-0@lo:400:kworker.0 Request processed in 63us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740315.758603:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1790740315.758604:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740315.758618:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1877727022005376:0@lo:400:kworker.0 00000100:00100000:3.0:1790740315.758636:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740315.758650:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84462300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1877727022005888:0@lo:400:kworker.0 00000100:00100000:3.0:1790740315.758670:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740315.758698:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022006400:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790740315.758720:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740315.758750:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727022004736:0@lo:400:kworker.0 00000100:00100000:1.0:1790740315.758767:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022004864 00000100:00100000:3.0:1790740315.758776:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022005376 00000100:00100000:3.0:1790740315.758780:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022005376 00000100:00100000:1.0:1790740315.758784:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022004864 00000100:00100000:3.0:1790740315.758807:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022005888 00000100:00100000:1.0:1790740315.758812:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1790740315.758816:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022005888 00000100:00100000:1.0:1790740315.758818:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaef88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877727022004864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740315.758833:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1790740315.758838:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaef8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877727022005376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740315.758853:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaef88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877727022004864:12345-0@lo:400:kworker.0 Request processed in 36us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740315.758859:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1790740315.758863:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaef8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877727022005376:12345-0@lo:400:kworker.0 Request processed in 26us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740315.758868:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1790740315.758871:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1790740315.758876:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaef89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877727022005888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740315.758883:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022005760 00000100:00100000:3.0:1790740315.758886:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022005760 00000100:00100000:1.0:1790740315.758901:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaef89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877727022005888:12345-0@lo:400:kworker.0 Request processed in 25us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740315.758903:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022006272 00000100:00100000:3.0:1790740315.758906:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022006272 00000100:00100000:1.0:1790740315.758907:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1790740315.758920:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1790740315.758926:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaef89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1877727022005760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740315.758957:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaef89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1877727022005760:12345-0@lo:400:kworker.0 Request processed in 31us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740315.758963:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1790740315.758973:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1790740315.758979:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaef89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727022006272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740315.759005:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaef89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727022006272:12345-0@lo:400:kworker.0 Request processed in 27us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740315.759010:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1790740315.759063:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022005248 00000100:00100000:3.0:1790740315.759067:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022005248 00000100:00100000:3.0:1790740315.759100:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1790740315.759107:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaef89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727022005248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740315.759155:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaef89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727022005248:12345-0@lo:400:kworker.0 Request processed in 49us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740315.759161:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1790740315.759192:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022006400 00000100:00100000:3.0:1790740315.759196:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022006400 00000100:00100000:3.0:1790740315.759226:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1790740315.759232:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaef88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022006400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790740315.759254:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790740315.759285:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaef88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022006400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740315.759291:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:3.0:1790740315.759306:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790740315.759311:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790740315.759331:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877727022004864:0@lo:400:kworker.0 00000100:00100000:3.0:1790740315.759341:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1877727022005376:0@lo:400:kworker.0 00000100:00100000:3.0:1790740315.759349:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84462300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1877727022005888:0@lo:400:kworker.0 00010000:00080000:3.0:1790740315.759361:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcbd5f9f80 x1877727022006400/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740331 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740315.759377:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022006400:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790740315.759387:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84496300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022005248:0@lo:400:kworker.0 00000100:00100000:3.0:1790740315.759395:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84462a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022005760:0@lo:400:kworker.0 00010000:00080000:3.0:1790740315.759404:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcb5f6e300 x1877727022006272/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740315.759412:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022006272:0@lo:400:kworker.0 00000100:00100000:1.0:1790740315.759840:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfc12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022006528:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790740315.759882:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740315.760135:0:10118:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022006528 00000100:00100000:0.0:1790740315.760141:0:10118:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022006528 00000100:00100000:0.0:1790740315.760177:0:10118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1790740315.760184:0:10118:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022006528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790740315.760195:0:10118:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790740315.760233:0:10118:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022006528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740315.760247:0:10118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:1.0:1790740315.761782:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcbfc12a00 x1877727022006528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740331 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740315.761804:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfc12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022006528:0@lo:13:osp-pre-1-0.0 10000000:01000000:2.0:1790740315.882192:0:6532:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790740315.882201:0:6532:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98dcb5f0a000 from 7 10000000:01000000:2.0:1790740315.882207:0:6532:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790740315.882256:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98db83f32600/0xb25dda4f4e92ddd4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740315.882268:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98db83f32600/0xb25dda4f4e92ddd4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740315.882279:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98db83f32600/0xb25dda4f4e92ddd4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740315.882305:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefd8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727022006656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790740315.882394:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740315.882478:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83eff9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790740315.884892:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022006656 00000100:00100000:3.0:1790740315.884908:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022006656 00000100:00100000:3.0:1790740315.884985:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1790740315.885011:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+20:6532:x1877727022006656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790740315.885080:0:6530:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740315.885102:0:6530:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcb5dc8000/0xb25dda4f4e92dddb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92ddd4 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740315.885133:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcb5dc8000/0xb25dda4f4e92dddb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92ddd4 expref: 21 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740315.885146:0:6530:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcb5dc8000/0xb25dda4f4e92dddb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92ddd4 expref: 21 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740315.885155:0:6530:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc8000, rc 0) 00000100:00100000:3.0:1790740315.885236:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:6532:x1877727022006656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 226us (2841us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740315.885243:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1790740315.885423:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefd8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727022006656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790740315.885443:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98db83f32600/0xb25dda4f4e92ddd4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92dddb expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740315.885452:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98db83f32600/0xb25dda4f4e92ddd4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92dddb expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740315.885530:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefd8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727022006784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790740315.885573:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740315.885605:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83eff9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790740315.885786:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022006784 00000100:00100000:3.0:1790740315.885791:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022006784 00000100:00100000:3.0:1790740315.885827:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1790740315.885835:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:6532:x1877727022006784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790740315.885941:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:6532:x1877727022006784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740315.885948:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1790740315.886386:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefd8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727022006784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790740315.886423:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfc12a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727022006912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790740315.886470:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740315.886504:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83ff4000 going to sleep for 11 seconds 00000100:00100000:1.0:1790740315.886572:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022006912 00000100:00100000:1.0:1790740315.886577:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022006912 00000100:00100000:1.0:1790740315.886617:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1790740315.886625:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:6532:x1877727022006912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790740315.886731:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:6532:x1877727022006912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 107us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740315.886738:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1790740315.887253:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfc12a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727022006912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790740315.888448:0:13815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfc12a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:13815:1877727022007040:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790740315.888521:0:13815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740315.888572:0:13815:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83ff4600 going to sleep for 11 seconds 00000100:00100000:1.0:1790740315.888644:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022007040 00000100:00100000:1.0:1790740315.888650:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022007040 00000100:00100000:1.0:1790740315.888694:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1790740315.888702:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:13815:x1877727022007040:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790740315.888826:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:13815:x1877727022007040:12345-0@lo:502:llog_process_th.0 Request processed in 125us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740315.888833:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1790740315.889198:0:13815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfc12a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:13815:1877727022007040:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790740315.889226:0:13815:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790740315.889236:0:13815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740315.889239:0:13815:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790740315.889245:0:13815:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98dcb5f0a000 00000020:00000080:0.0:1790740315.889248:0:13815:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790740315.889313:0:13815:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790740315.889318:0:13815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740315.889319:0:13815:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790740315.889321:0:13815:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790740315.889324:0:13815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740315.889325:0:13815:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1790740315.889329:0:13815:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98dcb5f0a000 00000020:00000080:0.0:1790740315.889331:0:13815:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1790740315.889368:0:13815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfc12a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:13815:1877727022007168:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790740315.889407:0:13815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740315.889446:0:13815:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83ff4600 going to sleep for 11 seconds 00000100:00100000:3.0:1790740315.889515:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022007168 00000100:00100000:3.0:1790740315.889521:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022007168 00000100:00100000:3.0:1790740315.889565:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1790740315.889573:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:13815:x1877727022007168:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790740315.889674:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:13815:x1877727022007168:12345-0@lo:502:llog_process_th.0 Request processed in 101us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740315.889686:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1790740315.889815:0:13815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfc12a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:13815:1877727022007168:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790740315.889835:0:13815:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790740315.889839:0:13815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740315.889840:0:13815:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1790740315.889844:0:13815:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1790740315.890019:0:6532:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1790740315.890080:0:6532:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790740315.890092:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98db83f32600/0xb25dda4f4e92ddd4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92dddb expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740315.890103:0:6532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98db83f32600/0xb25dda4f4e92ddd4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92dddb expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740315.890112:0:6532:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790740315.890114:0:6532:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98dcaedda800 from 7 10000000:01000000:2.0:1790740315.890116:0:6532:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790740315.890141:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92dde2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740315.890149:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92dde2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740315.890169:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92dde2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740315.890182:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefdb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727022007296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790740315.890214:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740315.890243:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83eff3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790740315.890297:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022007296 00000100:00100000:3.0:1790740315.890302:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022007296 00000100:00100000:3.0:1790740315.890334:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1790740315.890341:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:6532:x1877727022007296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790740315.890350:0:6528:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740315.890363:0:6528:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcb5dc8400/0xb25dda4f4e92dde9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92dde2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740315.890382:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcb5dc8400/0xb25dda4f4e92dde9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92dde2 expref: 22 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740315.890393:0:6528:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcb5dc8400/0xb25dda4f4e92dde9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92dde2 expref: 22 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740315.890401:0:6528:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc8400, rc 0) 00000100:00100000:3.0:1790740315.890432:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+22:6532:x1877727022007296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740315.890438:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1790740315.890795:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefdb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727022007296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790740315.890808:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92dde2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92dde9 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740315.890817:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92dde2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92dde9 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740315.890867:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfc12a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727022007424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790740315.890898:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740315.890923:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83ff4600 going to sleep for 11 seconds 00000100:00100000:3.0:1790740315.891337:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022007424 00000100:00100000:3.0:1790740315.891343:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022007424 00000100:00100000:3.0:1790740315.891381:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1790740315.891396:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+22:6532:x1877727022007424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790740315.891506:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+22:6532:x1877727022007424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740315.891514:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1790740315.892602:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfc12a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727022007424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790740315.892687:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfc12a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727022007552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790740315.892758:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740315.892975:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022007552 00000100:00100000:2.0:1790740315.892982:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022007552 00000100:00100000:2.0:1790740315.893053:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1790740315.893063:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+22:6532:x1877727022007552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790740315.893160:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+22:6532:x1877727022007552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740315.893167:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1790740315.893333:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83ff4600 going to sleep for 11 seconds 00000100:00100000:0.0:1790740315.893349:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfc12a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727022007552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790740315.897683:0:13817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefd8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:13817:1877727022007680:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790740315.897770:0:13817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740315.897817:0:13817:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83eff3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790740315.898063:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022007680 00000100:00100000:0.0:1790740315.898072:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022007680 00000100:00100000:0.0:1790740315.898115:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1790740315.898125:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+22:13817:x1877727022007680:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790740315.898261:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+22:13817:x1877727022007680:12345-0@lo:502:llog_process_th.0 Request processed in 137us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740315.898276:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1790740315.898444:0:13817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefd8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:13817:1877727022007680:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790740315.898473:0:13817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790740315.898484:0:13817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740315.898486:0:13817:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790740315.898494:0:13817:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98dcaedda800 00000020:00000080:2.0:1790740315.898497:0:13817:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790740315.898569:0:13817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790740315.898573:0:13817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740315.898574:0:13817:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790740315.898577:0:13817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790740315.898585:0:13817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740315.898586:0:13817:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1790740315.898591:0:13817:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98dcaedda800 00000020:00000080:2.0:1790740315.898593:0:13817:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1790740315.898642:0:13817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefd8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:13817:1877727022007808:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790740315.898688:0:13817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740315.899376:0:13817:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83eff3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790740315.901054:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022007808 00000100:00100000:3.0:1790740315.901076:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022007808 00000100:00100000:3.0:1790740315.901136:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1790740315.901146:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+22:13817:x1877727022007808:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790740315.901355:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+22:13817:x1877727022007808:12345-0@lo:502:llog_process_th.0 Request processed in 210us (2665us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740315.901363:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1790740315.901951:0:13817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefd8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:13817:1877727022007808:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790740315.901987:0:13817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790740315.901994:0:13817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740315.901997:0:13817:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1790740315.902003:0:13817:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1790740315.902753:0:6532:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1790740315.902794:0:6532:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790740315.902806:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92dde2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92dde9 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740315.902819:0:6532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92dde2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92dde9 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740315.902829:0:6532:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790740315.902832:0:6532:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98dca0cb4800 from 7 10000000:01000000:0.0:1790740315.902835:0:6532:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790740315.902887:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaf060e00/0xb25dda4f4e92ddf0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740315.902896:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dcaf060e00/0xb25dda4f4e92ddf0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740315.902905:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dcaf060e00/0xb25dda4f4e92ddf0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740315.902928:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfc12a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727022007936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790740315.902989:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740315.903061:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83ff4000 going to sleep for 11 seconds 00000100:00100000:2.0:1790740315.903658:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022007936 00000100:00100000:2.0:1790740315.903666:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022007936 00000100:00100000:2.0:1790740315.903717:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1790740315.903726:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+22:6532:x1877727022007936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790740315.903741:0:6529:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740315.903757:0:6529:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98db83f32800/0xb25dda4f4e92ddf7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92ddf0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740315.903783:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98db83f32800/0xb25dda4f4e92ddf7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92ddf0 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740315.903795:0:6529:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98db83f32800/0xb25dda4f4e92ddf7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92ddf0 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740315.903804:0:6529:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f32800, rc 0) 00000100:00100000:2.0:1790740315.903877:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:6532:x1877727022007936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740315.903894:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1790740315.904822:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfc12a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727022007936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790740315.904857:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dcaf060e00/0xb25dda4f4e92ddf0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ddf7 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740315.904869:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dcaf060e00/0xb25dda4f4e92ddf0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92ddf7 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740315.904949:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727022008064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790740315.904996:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740315.905057:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc84c11e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790740315.905317:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022008064 00000100:00100000:2.0:1790740315.905324:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022008064 00000100:00100000:2.0:1790740315.905363:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1790740315.905371:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:6532:x1877727022008064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790740315.905493:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:6532:x1877727022008064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740315.905501:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1790740315.906442:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727022008064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790740315.906492:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727022008192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790740315.906547:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740315.906599:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc84c11e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790740315.906651:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022008192 00000100:00100000:2.0:1790740315.906656:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022008192 00000100:00100000:2.0:1790740315.906702:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1790740315.906712:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:6532:x1877727022008192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790740315.907139:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:6532:x1877727022008192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 427us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740315.907148:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1790740315.907446:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727022008192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790740315.907771:0:13819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5fb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:13819:1877727022008320:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790740315.907818:0:13819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740315.907864:0:13819:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc86a183c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790740315.907960:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022008320 00000100:00100000:0.0:1790740315.907965:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022008320 00000100:00100000:0.0:1790740315.908005:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1790740315.908013:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:13819:x1877727022008320:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790740315.908145:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:13819:x1877727022008320:12345-0@lo:502:llog_process_th.0 Request processed in 132us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740315.908159:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1790740315.908318:0:13819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5fb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:13819:1877727022008320:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790740315.908343:0:13819:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790740315.908354:0:13819:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740315.908356:0:13819:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790740315.908364:0:13819:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98dca0cb4800 00000020:00000080:1.0:1790740315.908368:0:13819:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790740315.908483:0:13819:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790740315.908488:0:13819:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740315.908489:0:13819:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790740315.908493:0:13819:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790740315.908496:0:13819:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740315.908498:0:13819:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1790740315.908502:0:13819:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98dca0cb4800 00000020:00000080:1.0:1790740315.908505:0:13819:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790740315.909690:0:13819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5fb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:13819:1877727022008448:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790740315.909840:0:13819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740315.909888:0:13819:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc86a183c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740315.909907:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022008448 00000100:00100000:2.0:1790740315.909915:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022008448 00000100:00100000:2.0:1790740315.909971:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1790740315.909980:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc990c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:13819:x1877727022008448:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790740315.910117:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc990c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:13819:x1877727022008448:12345-0@lo:502:llog_process_th.0 Request processed in 137us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740315.910124:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1790740315.910174:0:13819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5fb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:13819:1877727022008448:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790740315.910282:0:13819:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790740315.910290:0:13819:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740315.910298:0:13819:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1790740315.910304:0:13819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1790740315.910469:0:6532:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1790740315.910497:0:6532:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790740315.910507:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaf060e00/0xb25dda4f4e92ddf0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ddf7 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740315.910517:0:6532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dcaf060e00/0xb25dda4f4e92ddf0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ddf7 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740315.910527:0:6532:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790740315.910529:0:6532:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98dc82d23800 from 7 10000000:01000000:0.0:1790740315.910532:0:6532:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790740315.910566:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaf060800/0xb25dda4f4e92ddfe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740315.910574:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dcaf060800/0xb25dda4f4e92ddfe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740315.910583:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dcaf060800/0xb25dda4f4e92ddfe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740315.910598:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfc12a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727022008576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790740315.910628:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740315.910779:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83ff46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740315.910887:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022008576 00000100:00100000:2.0:1790740315.910892:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022008576 00000100:00100000:2.0:1790740315.910962:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1790740315.910972:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:6532:x1877727022008576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790740315.910983:0:6528:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740315.910997:0:6528:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98db83f33c00/0xb25dda4f4e92de05 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92ddfe expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740315.911021:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98db83f33c00/0xb25dda4f4e92de05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92ddfe expref: 24 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740315.911054:0:6528:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98db83f33c00/0xb25dda4f4e92de05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92ddfe expref: 24 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740315.911064:0:6528:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f33c00, rc 0) 00000100:00100000:2.0:1790740315.911100:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:6532:x1877727022008576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740315.911107:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1790740315.911141:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfc12a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727022008576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790740315.911154:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dcaf060800/0xb25dda4f4e92ddfe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92de05 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740315.911163:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dcaf060800/0xb25dda4f4e92ddfe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92de05 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740315.911296:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefd8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727022008704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790740315.911336:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740315.911353:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83eff780 going to sleep for 11 seconds 00000100:00100000:2.0:1790740315.911365:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022008704 00000100:00100000:2.0:1790740315.911369:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022008704 00000100:00100000:2.0:1790740315.911388:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1790740315.911396:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:6532:x1877727022008704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790740315.911498:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:6532:x1877727022008704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 102us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740315.911506:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1790740315.911537:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefd8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727022008704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790740315.911579:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefd8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727022008832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790740315.911618:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740315.911632:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83eff780 going to sleep for 11 seconds 00000100:00100000:2.0:1790740315.911645:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022008832 00000100:00100000:2.0:1790740315.911649:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022008832 00000100:00100000:2.0:1790740315.911666:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1790740315.911671:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:6532:x1877727022008832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790740315.911742:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:6532:x1877727022008832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740315.911750:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1790740315.911785:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefd8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:6532:1877727022008832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790740315.912442:0:13820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5f9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:13820:1877727022008960:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790740315.912492:0:13820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740315.912569:0:13820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc86a186c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740315.912613:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022008960 00000100:00100000:2.0:1790740315.912618:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022008960 00000100:00100000:2.0:1790740315.912698:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1790740315.912708:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:13820:x1877727022008960:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790740315.912811:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:13820:x1877727022008960:12345-0@lo:502:llog_process_th.0 Request processed in 104us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740315.912818:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1790740315.912951:0:13820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5f9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:13820:1877727022008960:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790740315.912976:0:13820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790740315.912985:0:13820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740315.912987:0:13820:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790740315.912994:0:13820:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98dc82d23800 00000020:00000080:0.0:1790740315.913002:0:13820:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790740315.913081:0:13820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790740315.913408:0:13820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740315.913410:0:13820:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790740315.913415:0:13820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790740315.913420:0:13820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740315.913421:0:13820:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1790740315.913425:0:13820:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98dc82d23800 00000020:00000080:0.0:1790740315.913427:0:13820:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1790740315.913660:0:13820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfc12a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:13820:1877727022009088:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790740315.913710:0:13820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740315.913993:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022009088 00000100:00100000:1.0:1790740315.914000:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022009088 00000100:00100000:1.0:1790740315.914050:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1790740315.914058:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:13820:x1877727022009088:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790740315.914140:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:13820:x1877727022009088:12345-0@lo:502:llog_process_th.0 Request processed in 82us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740315.914148:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1790740315.915195:0:13820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83ff4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790740315.915300:0:13820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfc12a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:13820:1877727022009088:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790740315.915333:0:13820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000040:00080000:3.0:1790740315.915336:0:13821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:0.0:1790740315.915341:0:13820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740315.915344:0:13820:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1790740315.915349:0:13820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1790740315.916167:0:6532:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1790740315.916201:0:6532:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790740315.916216:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaf060800/0xb25dda4f4e92ddfe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92de05 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740315.916228:0:6532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dcaf060800/0xb25dda4f4e92ddfe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92de05 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790740315.931250:0:13823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1790740316.377009:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740316.377075:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000947584 00000100:00100000:1.0:1790740316.377084:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000947584 00000100:00100000:1.0:1790740316.377147:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 360 00000100:00100000:1.0:1790740316.377158:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+11:6199:x1877727000947584:12345-192.168.204.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790740316.377176:0:6530:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740316.377193:0:6530:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcbfc44a00/0xb25dda4f4e92de0c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23c37 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740316.377221:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcbfc44a00/0xb25dda4f4e92de0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c37 expref: 12 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740316.377232:0:6530:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcbfc44a00/0xb25dda4f4e92de0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c37 expref: 12 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740316.377241:0:6530:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcbfc44a00, rc 0) 00000100:00100000:1.0:1790740316.377301:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+12:6199:x1877727000947584:12345-192.168.204.3@tcp:101:ll_cfg_requeue.0 Request processed in 146us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740316.377320:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 360 00000100:00100000:3.0:1790740316.380991:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740316.381436:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000947712 00000100:00100000:0.0:1790740316.381451:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000947712 00000100:00100000:0.0:1790740316.381538:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 361 00000100:00100000:0.0:1790740316.381564:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+12:6199:x1877727000947712:12345-192.168.204.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790740316.381769:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+12:6199:x1877727000947712:12345-192.168.204.3@tcp:501:ll_cfg_requeue.0 Request processed in 217us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740316.381783:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 361 00000100:00100000:3.0:1790740316.391382:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740316.395513:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000947840 00000100:00100000:2.0:1790740316.395534:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000947840 00000100:00100000:2.0:1790740316.395652:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 362 00000100:00100000:2.0:1790740316.395670:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+12:6199:x1877727000947840:12345-192.168.204.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790740316.395925:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+12:6199:x1877727000947840:12345-192.168.204.3@tcp:503:ll_cfg_requeue.0 Request processed in 257us (4556us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740316.396261:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 362 00000100:00100000:3.0:1790740316.402580:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740316.402845:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000947968 00000100:00100000:1.0:1790740316.402860:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000947968 00000100:00100000:1.0:1790740316.402944:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 363 00000100:00100000:1.0:1790740316.402955:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+12:10793:x1877727000947968:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790740316.403154:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+12:10793:x1877727000947968:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 200us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740316.403162:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 363 00000100:00100000:3.0:1790740316.414882:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740316.415082:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000948096 00000100:00100000:2.0:1790740316.415104:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000948096 00000100:00100000:2.0:1790740316.415252:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 364 00000100:00100000:2.0:1790740316.415266:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+12:10793:x1877727000948096:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790740316.415493:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+12:10793:x1877727000948096:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 230us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740316.415511:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 364 00000100:00100000:3.0:1790740316.428169:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740316.428287:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000948224 00000100:00100000:0.0:1790740316.428302:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000948224 00000100:00100000:0.0:1790740316.428375:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 365 00000100:00100000:0.0:1790740316.428385:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+12:6199:x1877727000948224:12345-192.168.204.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790740316.428419:0:6529:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740316.428437:0:6529:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcaf061600/0xb25dda4f4e92de13 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23c3e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740316.428464:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcaf061600/0xb25dda4f4e92de13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c3e expref: 13 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740316.428474:0:6529:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcaf061600/0xb25dda4f4e92de13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c3e expref: 13 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740316.428483:0:6529:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaf061600, rc 0) 00000100:00100000:0.0:1790740316.428561:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:6199:x1877727000948224:12345-192.168.204.3@tcp:101:ll_cfg_requeue.0 Request processed in 164us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740316.428568:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 365 00000100:00100000:3.0:1790740316.431028:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740316.431206:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000948352 00000100:00100000:2.0:1790740316.431229:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000948352 00000100:00100000:2.0:1790740316.431382:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 366 00000100:00100000:2.0:1790740316.431395:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:6199:x1877727000948352:12345-192.168.204.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790740316.431623:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:6199:x1877727000948352:12345-192.168.204.3@tcp:501:ll_cfg_requeue.0 Request processed in 230us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740316.431631:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 366 00000100:00100000:3.0:1790740316.433414:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740316.442627:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000948480 00000100:00100000:2.0:1790740316.442651:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000948480 00000100:00100000:2.0:1790740316.444600:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 367 00000100:00100000:2.0:1790740316.444628:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:6199:x1877727000948480:12345-192.168.204.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790740316.444843:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:6199:x1877727000948480:12345-192.168.204.3@tcp:503:ll_cfg_requeue.0 Request processed in 228us (11438us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740316.444853:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 367 00000100:00100000:3.0:1790740316.449525:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740316.449671:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000948608 00000100:00100000:2.0:1790740316.449685:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000948608 00000100:00100000:2.0:1790740316.449758:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 368 00000100:00100000:2.0:1790740316.449769:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:10797:x1877727000948608:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790740316.449969:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:10797:x1877727000948608:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 201us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740316.449979:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 368 00000100:00100000:3.0:1790740316.453428:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740316.454726:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000948736 00000100:00100000:2.0:1790740316.454743:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000948736 00000100:00100000:2.0:1790740316.454820:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 369 00000100:00100000:2.0:1790740316.454829:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:10797:x1877727000948736:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790740316.455083:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:10797:x1877727000948736:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 253us (1675us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740316.455093:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 369 00010000:00010000:2.0:1790740316.650454:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740316.781208:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaef88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022009216:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790740316.781323:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740316.781598:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022009216 00000100:00100000:2.0:1790740316.781610:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022009216 00000100:00100000:2.0:1790740316.781676:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1790740316.781688:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022009216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790740316.781754:0:6540:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790740316.781832:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022009216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 142us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740316.781840:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1790740316.784146:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaef88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022009216:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1790740316.971410:0:13823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1790740316.972088:0:13821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790740317.674346:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740318.700411:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740318.826867:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790740318.826908:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfc12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022009344:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790740318.827066:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740318.828679:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022009344 00000100:00100000:3.0:1790740318.828696:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022009344 00000100:00100000:3.0:1790740318.828782:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1790740318.828806:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022009344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790740318.828848:0:6541:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1790740318.828947:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022009344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 141us (1882us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740318.828957:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1790740318.829064:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfc12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022009344:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790740319.338841:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaef88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022009472:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790740319.338952:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740319.339023:0:10118:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022009472 00000100:00100000:0.0:1790740319.339065:0:10118:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022009472 00000100:00100000:0.0:1790740319.339149:0:10118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1790740319.339162:0:10118:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1877727022009472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790740319.339195:0:10118:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1790740319.339256:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790740319.339944:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022009600:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790740319.339987:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740319.340078:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022009600 00000100:00100000:3.0:1790740319.340083:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022009600 00000100:00100000:0.0:1790740319.341340:0:10118:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1877727022009472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2176us (2382us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740319.341353:0:10118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1790740319.341388:0:10118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1790740319.341400:0:10118:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaef8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022009600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790740319.341421:0:10118:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790740319.341478:0:10118:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaef8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022009600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (1490us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740319.341512:0:10118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:2.0:1790740319.341578:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790740319.341671:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022009600:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790740319.341738:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaef88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022009472:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790740319.722491:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740320.663892:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740320.664010:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000948864 00000100:00100000:1.0:1790740320.664019:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000948864 00000100:00100000:1.0:1790740320.664112:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 370 00000100:00100000:1.0:1790740320.664122:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:2403:x1877727000948864:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1790740320.664200:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:2403:x1877727000948864:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 79us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740320.664222:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 370 00000100:00100000:3.0:1790740320.671931:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740320.672152:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000948992 00000100:00100000:0.0:1790740320.672163:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000948992 00000100:00100000:0.0:1790740320.672245:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 230 00000100:00100000:0.0:1790740320.672255:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaef89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+5:2403:x1877727000948992:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1790740320.672344:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaef89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+5:2403:x1877727000948992:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 90us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740320.672353:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 230 00000100:00080000:2.0:1790740320.672492:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790740320.676494:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740320.676544:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740320.676577:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740320.676718:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000949248 00000100:00100000:3.0:1790740320.676728:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000949248 00000100:00100000:3.0:1790740320.676792:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 96 00000100:00100000:3.0:1790740320.676800:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bed19f2-4c98-4684-89e7-a6871565665d+5:2402:x1877727000949248:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740320.676888:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bed19f2-4c98-4684-89e7-a6871565665d+5:2402:x1877727000949248:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 88us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740320.676909:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 96 00000100:00080000:3.0:1790740320.677061:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790740320.677362:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740320.679495:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000949120 00000100:00100000:2.0:1790740320.679513:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000949120 00000100:00100000:2.0:1790740320.679572:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000949376 00000100:00100000:2.0:1790740320.679576:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000949376 00000100:00100000:2.0:1790740320.679601:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000949504 00000100:00100000:2.0:1790740320.679604:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000949504 00000100:00100000:2.0:1790740320.679624:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 231 00000100:00100000:2.0:1790740320.679632:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84462a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+5:2403:x1877727000949120:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1790740320.679715:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84462a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+5:2403:x1877727000949120:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 84us (3170us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740320.679723:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 231 00000100:00100000:2.0:1790740320.679741:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 232 00000100:00100000:2.0:1790740320.679748:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84462300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2403:x1877727000949376:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1790740320.679774:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84462300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2403:x1877727000949376:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 28us (3197us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740320.679781:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 232 00000100:00080000:0.0:1790740320.680104:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790740320.680109:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790740320.680140:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 233 00000100:00100000:0.0:1790740320.680151:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84463800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2402:x1877727000949504:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1790740320.680184:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84463800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2402:x1877727000949504:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 37us (2823us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740320.680190:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 233 00010000:00010000:1.0:1790740320.746867:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740320.875297:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84463b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022009728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790740320.875373:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740320.876182:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84496300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727022009856:0@lo:400:kworker.0 00000100:00100000:2.0:1790740320.876230:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740320.876275:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790740320.876285:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022009984:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790740320.876316:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740320.876360:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022009728 00000100:00100000:2.0:1790740320.876370:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022009728 00000100:00100000:2.0:1790740320.876419:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022009984 00000100:00100000:2.0:1790740320.876423:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022009984 00000100:00100000:2.0:1790740320.876442:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1790740320.876449:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022009728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790740320.876490:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1790740320.876639:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790740320.876681:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1790740320.876698:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaefd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022009984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790740320.876724:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790740320.876801:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaefd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022009984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740320.876809:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:3.0:1790740320.876900:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcbd5f8000 x1877727022009984/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740336 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740320.876925:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022009984:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790740320.877285:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022009728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 833us (1908us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740320.877295:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1790740320.877322:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790740320.877837:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727022010112:0@lo:400:kworker.0 00000100:00100000:3.0:1790740320.877893:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740320.877927:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790740320.877934:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022010240:0@lo:400:kworker.0 00000100:00100000:3.0:1790740320.877961:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740320.878577:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022010240 00000100:00100000:3.0:1790740320.878587:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022010240 00000100:00100000:3.0:1790740320.878638:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1790740320.878646:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaef8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022010240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740320.878741:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaef8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022010240:12345-0@lo:400:kworker.0 Request processed in 94us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740320.878750:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1790740320.878834:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022010240:0@lo:400:kworker.0 00000100:00100000:3.0:1790740320.878882:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022010112 00000100:00100000:3.0:1790740320.878887:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022010112 00000100:00100000:3.0:1790740320.878932:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1790740320.878943:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaef8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727022010112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740320.878993:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaef8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727022010112:12345-0@lo:400:kworker.0 Request processed in 53us (1098us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740320.879002:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1790740320.879009:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877727022010624:0@lo:400:kworker.0 00000100:00100000:3.0:1790740320.879059:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022009856 00000100:00100000:3.0:1790740320.879066:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022009856 00000100:00100000:3.0:1790740320.879099:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1790740320.879117:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca1332050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3640:x1877727022009856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740320.880581:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740320.880643:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ee9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1877727022011136:0@lo:400:kworker.0 00000100:00100000:0.0:1790740320.880673:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740320.880720:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727022010112:0@lo:400:kworker.0 00000100:00100000:0.0:1790740320.880764:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1790740320.880771:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1877727022010752:0@lo:400:kworker.0 00000100:00100000:0.0:1790740320.880798:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740320.880828:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ee9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1877727022011264:0@lo:400:kworker.0 00000100:00100000:0.0:1790740320.880862:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740320.880981:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022010624 00000100:00100000:0.0:1790740320.880988:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022010624 00000100:00100000:0.0:1790740320.881056:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022011136 00000100:00100000:0.0:1790740320.881061:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022011136 00000100:00100000:0.0:1790740320.881083:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022010752 00000100:00100000:0.0:1790740320.881086:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022010752 00000100:00100000:0.0:1790740320.881101:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022011264 00000100:00100000:0.0:1790740320.881103:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022011264 00000100:00100000:0.0:1790740320.881123:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1790740320.881132:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ee9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877727022010624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740320.882955:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1790740320.882977:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877727022011136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740320.887174:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ee9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877727022010624:12345-0@lo:400:kworker.0 Request processed in 6033us (6589us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740320.887192:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1790740320.887233:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1790740320.887244:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877727022010752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740320.887293:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877727022010752:12345-0@lo:400:kworker.0 Request processed in 54us (6495us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740320.887298:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1790740320.887320:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1790740320.887326:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877727022011264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740320.887352:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877727022011264:12345-0@lo:400:kworker.0 Request processed in 26us (6489us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740320.887372:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00080000:0.0:1790740320.887397:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790740320.887402:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790740320.887433:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db84496d80 x1877727022010752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740320.887447:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1877727022010752:0@lo:400:kworker.0 00010000:00080000:0.0:1790740320.887457:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83ee9880 x1877727022011264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740320.887476:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ee9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1877727022011264:0@lo:400:kworker.0 00000100:00100000:0.0:1790740320.887488:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877727022010624:0@lo:400:kworker.0 00000100:00100000:0.0:1790740320.887527:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022010880:0@lo:400:kworker.0 00010000:00080000:1.0:1790740320.888092:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db84463b80 x1877727022009728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740336 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740320.888112:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84463b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022009728:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790740320.892020:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca1332050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3640:x1877727022009856:12345-0@lo:400:kworker.0 Request processed in 12888us (15773us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740320.892050:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1790740320.892646:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022010496:0@lo:400:kworker.0 00000100:00100000:3.0:1790740320.892728:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740320.892778:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022011008:0@lo:400:kworker.0 00000100:00100000:1.0:1790740320.892801:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022010496 00000100:00100000:3.0:1790740320.892813:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740320.892818:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022010496 00000100:00100000:3.0:1790740320.892865:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877727022010368:0@lo:400:kworker.0 00000100:00100000:1.0:1790740320.892909:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1790740320.892921:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaef8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022010496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740320.892951:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740320.893013:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022010368 00000100:00100000:3.0:1790740320.893021:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022010368 00000100:00100000:1.0:1790740320.893067:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaef8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022010496:12345-0@lo:400:kworker.0 Request processed in 113us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740320.893077:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1790740320.893585:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1790740320.893598:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaef8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877727022010368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740320.893811:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaef8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877727022010368:12345-0@lo:400:kworker.0 Request processed in 215us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740320.893820:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1790740320.893937:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022010496:0@lo:400:kworker.0 00000001:00080000:3.0:1790740320.894060:0:8446:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:3.0:1790740320.894087:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877727022010368:0@lo:400:kworker.0 00000100:00100000:1.0:1790740320.894477:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022011008 00000100:00100000:1.0:1790740320.894489:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022011008 00000100:00100000:1.0:1790740320.894559:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1790740320.894568:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaef8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022011008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740320.894659:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaef8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022011008:12345-0@lo:400:kworker.0 Request processed in 91us (1845us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740320.894667:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1790740320.894770:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1790740320.894777:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98dcbfd01500, transno 4294967301 00000100:00100000:3.0:1790740320.894791:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022011008:0@lo:400:kworker.0 00000100:00100000:2.0:1790740320.894828:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877727022011136:12345-0@lo:400:kworker.0 Request processed in 11861us (14152us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740320.894838:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1790740320.894878:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ee9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1877727022011136:0@lo:400:kworker.0 00000100:00100000:0.0:1790740320.894887:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740320.894929:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022010880 00000100:00100000:0.0:1790740320.894933:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022010880 00000100:00100000:0.0:1790740320.895023:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1790740320.895051:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022010880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740320.895607:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022010880:12345-0@lo:400:kworker.0 Request processed in 576us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740320.895614:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1790740320.896966:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022010880:0@lo:400:kworker.0 00000100:00100000:0.0:1790740320.897097:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84496300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727022009856:0@lo:400:kworker.0 00010000:00010000:2.0:1790740321.770659:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740321.901177:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790740321.901202:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaef8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022011392:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790740321.901277:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740321.901414:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022011392 00000100:00100000:2.0:1790740321.901423:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022011392 00000100:00100000:2.0:1790740321.901493:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1790740321.901503:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022011392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790740321.901623:0:7846:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790740321.901763:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022011392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 261us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740321.901772:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1790740321.901817:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaef8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022011392:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1790740322.796009:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740323.819794:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740323.946815:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ee9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022011520:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790740323.946889:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740323.946967:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022011520 00000100:00100000:1.0:1790740323.946976:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022011520 00000100:00100000:1.0:1790740323.947027:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1790740323.947054:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaefda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022011520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790740323.947088:0:6541:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1790740323.947147:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaefda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022011520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740323.947155:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1790740323.947223:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ee9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022011520:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790740324.458342:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022011648:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790740324.458437:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740324.458519:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022011648 00000100:00100000:0.0:1790740324.458529:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790740324.458533:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022011648 00000100:00100000:0.0:1790740324.458535:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaef88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022011776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790740324.458559:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740324.458581:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022011776 00000100:00100000:3.0:1790740324.458585:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022011776 00000100:00100000:3.0:1790740324.458602:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1790740324.458609:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ee9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022011648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790740324.458640:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1790740324.458751:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790740324.458798:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ee9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022011648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 189us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740324.460452:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022011648:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790740324.461659:0:10118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1790740324.461684:0:10118:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022011776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790740324.461710:0:10118:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790740324.461723:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1790740324.461795:0:10118:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022011776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (3234us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740324.461802:0:10118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1790740324.461886:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaef88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022011776:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790740324.842437:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740325.784580:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740325.784629:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740325.784670:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740325.784694:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740325.784705:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000949632 00000100:00100000:2.0:1790740325.784716:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000949632 00000100:00100000:3.0:1790740325.784723:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740325.784754:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740325.784771:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 372 00000100:00100000:2.0:1790740325.784780:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca1333c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:2404:x1877727000949632:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1790740325.784843:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca1333c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:2404:x1877727000949632:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 66us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740325.784850:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 372 00000100:00100000:3.0:1790740325.785132:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000949888 00000100:00100000:3.0:1790740325.785137:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000949888 00000100:00100000:0.0:1790740325.785210:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000950144 00000100:00100000:0.0:1790740325.785214:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000950144 00000100:00100000:2.0:1790740325.788541:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000949760 00000100:00100000:2.0:1790740325.788558:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000949760 00000100:00100000:1.0:1790740325.790971:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000950272 00000100:00100000:1.0:1790740325.790988:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000950272 00000100:00100000:0.0:1790740325.791270:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 240 00000100:00100000:0.0:1790740325.791283:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaef88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+5:2404:x1877727000949888:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1790740325.791296:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 241 00000100:00100000:2.0:1790740325.791311:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaef8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2404:x1877727000950144:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1790740325.791790:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaef8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2404:x1877727000950144:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 482us (7115us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740325.791791:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaef88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+5:2404:x1877727000949888:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 508us (7157us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740325.791807:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 241 00000100:00100000:0.0:1790740325.797352:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 240 00000100:00100000:2.0:1790740325.797378:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 242 00000100:00100000:2.0:1790740325.797412:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaef88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+5:2404:x1877727000949760:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1790740325.797656:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000950016 00000100:00100000:0.0:1790740325.797664:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000950016 00000100:00100000:0.0:1790740325.797714:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 99 00000100:00100000:0.0:1790740325.797722:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaef88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bed19f2-4c98-4684-89e7-a6871565665d+5:2404:x1877727000950016:12345-192.168.204.3@tcp:400:kworker.0 00000100:00080000:3.0:1790740325.798096:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790740325.798103:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790740325.798106:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790740325.798828:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaef88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+5:2404:x1877727000949760:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 1424us (14125us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740325.798828:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaef88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bed19f2-4c98-4684-89e7-a6871565665d+5:2404:x1877727000950016:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 1098us (14096us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740325.798843:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 242 00000100:00100000:1.0:1790740325.800003:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 243 00000100:00100000:1.0:1790740325.800019:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfd01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2404:x1877727000950272:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1790740325.800098:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfd01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2404:x1877727000950272:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 85us (15343us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740325.800105:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 243 00000100:00100000:0.0:1790740325.800270:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 99 00010000:00010000:2.0:1790740325.880572:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740325.994201:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5f6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022011904:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790740325.994298:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740325.994360:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790740325.994380:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84496300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022012032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790740325.994406:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740325.994436:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022011904 00000100:00100000:3.0:1790740325.994443:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022011904 00000100:00100000:3.0:1790740325.994492:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022012032 00000100:00100000:3.0:1790740325.994495:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022012032 00000100:00100000:3.0:1790740325.994785:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1790740325.994794:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfcedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022011904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790740325.994826:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790740325.994870:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfcedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022011904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740325.994879:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1790740325.997070:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1790740325.997096:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727022012032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790740325.997126:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790740325.997195:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727022012032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (2789us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740325.997202:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:3.0:1790740325.997243:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790740325.999156:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727022012160:0@lo:400:kworker.0 00000100:00100000:3.0:1790740325.999188:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877727022012544:0@lo:400:kworker.0 00000100:00100000:2.0:1790740325.999232:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740325.999238:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740325.999286:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5df0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022013056:0@lo:400:kworker.0 00000100:00100000:2.0:1790740325.999287:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98535500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022012672:0@lo:400:kworker.0 00000100:00100000:3.0:1790740325.999332:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740325.999336:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740325.999384:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5df1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022013184:0@lo:400:kworker.0 00000100:00100000:3.0:1790740325.999387:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1790740325.999398:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022012416:0@lo:400:kworker.0 00000100:00100000:3.0:1790740325.999432:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740325.999458:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98534e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1877727022012928:0@lo:400:kworker.0 00000100:00100000:3.0:1790740325.999484:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740325.999507:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83c50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1877727022013440:0@lo:400:kworker.0 00000100:00100000:3.0:1790740325.999534:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740325.999571:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022012160 00000100:00100000:3.0:1790740325.999591:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022012160 00000100:00100000:3.0:1790740325.999636:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1790740325.999646:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca1332850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3638:x1877727022012160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740325.999663:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740325.999699:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca1332850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3638:x1877727022012160:12345-0@lo:400:kworker.0 Request processed in 54us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740325.999707:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1790740325.999715:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727022012160:0@lo:400:kworker.0 00000100:00100000:2.0:1790740325.999733:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1790740325.999744:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727022012288:0@lo:400:kworker.0 00000100:00100000:2.0:1790740325.999778:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740325.999803:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98534380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877727022012800:0@lo:400:kworker.0 00000100:00100000:2.0:1790740325.999830:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740325.999853:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5df0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1877727022013312:0@lo:400:kworker.0 00000100:00100000:2.0:1790740325.999878:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740326.001005:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022012544 00000100:00100000:3.0:1790740326.001014:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022012544 00000100:00100000:3.0:1790740326.001125:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022012928 00000100:00100000:3.0:1790740326.001129:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022012928 00000100:00100000:3.0:1790740326.001158:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022013440 00000100:00100000:3.0:1790740326.001161:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022013440 00000100:00100000:3.0:1790740326.001177:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022012288 00000100:00100000:3.0:1790740326.001180:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022012288 00000100:00100000:3.0:1790740326.001192:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022012800 00000100:00100000:3.0:1790740326.001194:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022012800 00000100:00100000:3.0:1790740326.001206:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022013312 00000100:00100000:3.0:1790740326.001208:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022013312 00000100:00100000:3.0:1790740326.001226:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1790740326.001235:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfcee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877727022012544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740326.001267:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022013056 00000100:00100000:2.0:1790740326.001273:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022013056 00000100:00100000:3.0:1790740326.001305:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfcee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877727022012544:12345-0@lo:400:kworker.0 Request processed in 71us (2069us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740326.001306:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022013184 00000100:00100000:2.0:1790740326.001310:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022013184 00000100:00100000:3.0:1790740326.001317:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1790740326.001340:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1790740326.001344:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1790740326.001350:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfcef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1877727022012928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740326.001397:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfcef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1877727022012928:12345-0@lo:400:kworker.0 Request processed in 49us (1913us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740326.001403:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1790740326.001415:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1790740326.001429:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfcefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1877727022013440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740326.001459:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfcefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1877727022013440:12345-0@lo:400:kworker.0 Request processed in 32us (1927us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740326.001464:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1790740326.001476:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1790740326.001481:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83c50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727022012288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740326.001513:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83c50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727022012288:12345-0@lo:400:kworker.0 Request processed in 31us (1735us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740326.001518:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1790740326.001529:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1790740326.001535:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83c53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877727022012800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740326.001561:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83c53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877727022012800:12345-0@lo:400:kworker.0 Request processed in 27us (1733us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740326.001567:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1790740326.001577:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1790740326.001582:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83c51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877727022013312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740326.001611:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83c51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877727022013312:12345-0@lo:400:kworker.0 Request processed in 29us (1734us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740326.001616:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00010000:00080000:3.0:1790740326.001655:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dc98534e00 x1877727022012928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740341 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740326.001668:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98534e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1877727022012928:0@lo:400:kworker.0 00010000:00080000:3.0:1790740326.001680:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83c50a80 x1877727022013440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740341 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740326.001700:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83c50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1877727022013440:0@lo:400:kworker.0 00000100:00100000:3.0:1790740326.001713:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877727022012544:0@lo:400:kworker.0 00000100:00080000:3.0:1790740326.002585:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790740326.002592:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790740326.002594:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1790740326.002624:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db84496300 x1877727022012032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740341 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740326.002642:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84496300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022012032:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1790740326.002654:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcb5f6e300 x1877727022011904/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740341 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740326.002665:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5f6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022011904:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790740326.003615:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022012672 00000100:00100000:3.0:1790740326.003625:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022012672 00000100:00100000:3.0:1790740326.003676:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022012416 00000100:00100000:3.0:1790740326.003679:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022012416 00000100:00100000:3.0:1790740326.003695:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1790740326.003702:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83c53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022012672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740326.004684:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83c53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022012672:12345-0@lo:400:kworker.0 Request processed in 977us (5349us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740326.004693:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1790740326.004716:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1790740326.004724:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfcef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022012416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740326.004898:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfcef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022012416:12345-0@lo:400:kworker.0 Request processed in 176us (5468us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740326.004922:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1790740326.004979:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022012416:0@lo:400:kworker.0 00000100:00100000:2.0:1790740326.005308:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfcee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022013056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740326.005378:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfcee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022013056:12345-0@lo:400:kworker.0 Request processed in 4002us (6037us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740326.005387:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1790740326.005406:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1790740326.005422:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83c51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022013184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740326.005455:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83c51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022013184:12345-0@lo:400:kworker.0 Request processed in 42us (6042us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740326.005462:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1790740326.005524:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727022012288:0@lo:400:kworker.0 00000100:00100000:2.0:1790740326.005538:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98534380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877727022012800:0@lo:400:kworker.0 00000100:00100000:2.0:1790740326.005550:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5df0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1877727022013312:0@lo:400:kworker.0 00000100:00100000:2.0:1790740326.005561:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98535500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022012672:0@lo:400:kworker.0 00000100:00100000:2.0:1790740326.005571:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5df1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022013184:0@lo:400:kworker.0 00000100:00100000:3.0:1790740326.005915:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5df0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022013056:0@lo:400:kworker.0 00000040:00080000:2.0:1790740326.188543:0:13823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1790740326.189481:0:13821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790740326.893689:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740327.018330:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfcec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022013568:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790740327.018424:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740327.018534:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022013568 00000100:00100000:0.0:1790740327.018551:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022013568 00000100:00100000:0.0:1790740327.018655:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1790740327.018669:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfced180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022013568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790740327.018725:0:7846:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1790740327.018845:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfced180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022013568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 179us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740327.018853:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1790740327.019078:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfcec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022013568:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1790740327.917549:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740328.938364:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740329.066279:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022013696:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790740329.066371:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740329.067228:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022013696 00000100:00100000:1.0:1790740329.067238:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022013696 00000100:00100000:1.0:1790740329.067299:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1790740329.067318:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83c50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022013696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790740329.067359:0:6541:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1790740329.067428:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83c50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022013696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740329.067436:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1790740329.067678:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022013696:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790740329.578736:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfcec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022013824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790740329.578819:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740329.578942:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022013824 00000100:00100000:1.0:1790740329.578951:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022013824 00000100:00080000:2.0:1790740329.579001:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790740329.579022:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790740329.579022:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1790740329.579056:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022013824:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790740329.579070:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83c50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022013952:0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790740329.579088:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790740329.579126:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740329.579186:0:10118:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022013952 00000100:00100000:3.0:1790740329.579191:0:10118:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022013952 00000100:00100000:3.0:1790740329.579219:0:10118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1790740329.579226:0:10118:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022013952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790740329.579237:0:10118:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790740329.580221:0:10118:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022013952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 989us (1089us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740329.580232:0:10118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:3.0:1790740329.580272:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790740329.580425:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83c50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022013952:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790740329.580523:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfcec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022013824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790740329.580524:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022013824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1488us (1701us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740329.580537:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00010000:1.0:1790740329.962482:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740330.906207:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740330.906252:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740330.906297:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740330.906375:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000950400 00000100:00100000:1.0:1790740330.906385:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000950400 00000100:00100000:1.0:1790740330.906446:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 374 00000100:00100000:1.0:1790740330.906455:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:2404:x1877727000950400:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1790740330.906527:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:2404:x1877727000950400:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 73us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740330.906535:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 374 00000100:00100000:2.0:1790740330.906625:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000950656 00000100:00100000:2.0:1790740330.906630:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000950656 00000100:00100000:2.0:1790740330.906675:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000950528 00000100:00100000:2.0:1790740330.906679:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000950528 00000100:00100000:2.0:1790740330.906704:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 250 00000100:00100000:2.0:1790740330.906712:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84494a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+5:2404:x1877727000950656:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1790740330.906745:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84494a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+5:2404:x1877727000950656:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 35us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740330.906751:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 250 00000100:00100000:2.0:1790740330.906764:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 251 00000100:00100000:2.0:1790740330.906770:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84494e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+5:2404:x1877727000950528:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1790740330.906793:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84494e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+5:2404:x1877727000950528:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 24us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740330.906799:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 251 00000100:00080000:1.0:1790740330.906898:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790740330.906903:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790740330.931486:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740330.931534:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740330.931574:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740330.931675:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000950912 00000100:00100000:1.0:1790740330.931685:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000950912 00000100:00100000:1.0:1790740330.931765:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000951040 00000100:00100000:1.0:1790740330.931769:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000951040 00000100:00100000:1.0:1790740330.931799:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 252 00000100:00100000:1.0:1790740330.931809:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfcedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2405:x1877727000950912:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1790740330.931889:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfcedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2405:x1877727000950912:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 82us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740330.931896:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 252 00000100:00100000:1.0:1790740330.931928:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 253 00000100:00100000:1.0:1790740330.931934:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfcece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2405:x1877727000951040:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1790740330.931963:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfcece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2405:x1877727000951040:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 30us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740330.931969:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 253 00000100:00080000:3.0:1790740330.932445:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790740330.932451:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790740330.932517:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000950784 00000100:00100000:2.0:1790740330.932522:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000950784 00000100:00100000:2.0:1790740330.932579:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 27 00000100:00100000:2.0:1790740330.932588:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7bed19f2-4c98-4684-89e7-a6871565665d+5:2401:x1877727000950784:12345-192.168.204.3@tcp:9:kworker.0 00000020:00000080:2.0:1790740330.932609:0:9806:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92dd3a 00000100:00080000:2.0:1790740330.932619:0:9806:0:(import.c:65:import_set_state_nolock()) ffff98db83f0f800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790740330.932667:0:9806:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:2.0:1790740330.932868:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7bed19f2-4c98-4684-89e7-a6871565665d+2:2401:x1877727000950784:12345-192.168.204.3@tcp:9:kworker.0 Request processed in 281us (1392us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740330.932885:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 27 00010000:00010000:2.0:1790740330.932909:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790740330.932962:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790740330.986335:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740331.114561:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790740331.114582:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022014208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790740331.114649:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740331.114783:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790740331.114793:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022014080:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790740331.114821:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740331.114914:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022014208 00000100:00100000:0.0:1790740331.114922:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022014208 00000100:00100000:0.0:1790740331.114973:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022014080 00000100:00100000:0.0:1790740331.114976:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022014080 00000100:00100000:0.0:1790740331.114993:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1790740331.115000:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84496d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022014208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790740331.115053:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790740331.115099:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84496d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022014208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740331.115107:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1790740331.115125:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1790740331.115131:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022014080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790740331.115156:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790740331.115187:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022014080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740331.115193:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00080000:0.0:1790740331.115226:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db84494700 x1877727022014208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740347 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740331.115243:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022014208:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1790740331.115428:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1790740331.115447:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcbfceed80 x1877727022014080/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740347 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740331.115458:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022014080:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790740331.119984:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84496300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877727022014720:0@lo:400:kworker.0 00000100:00100000:3.0:1790740331.120089:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740331.120145:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc81324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022015232:0@lo:400:kworker.0 00000100:00100000:3.0:1790740331.120190:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740331.120221:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1790740331.120227:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727022014336:0@lo:400:kworker.0 00000100:00100000:3.0:1790740331.120257:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740331.120289:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc81325180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022014848:0@lo:400:kworker.0 00000100:00100000:3.0:1790740331.120312:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740331.120326:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc81326680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022015360:0@lo:400:kworker.0 00000100:00100000:3.0:1790740331.120345:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740331.120380:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022015232 00000100:00100000:3.0:1790740331.120388:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022015232 00000100:00100000:3.0:1790740331.120438:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022015360 00000100:00100000:3.0:1790740331.120441:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022015360 00000100:00100000:3.0:1790740331.120462:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1790740331.120472:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022015232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740331.120527:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022015232:12345-0@lo:400:kworker.0 Request processed in 56us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740331.120534:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1790740331.120550:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1790740331.120555:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfcec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022015360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740331.120583:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfcec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022015360:12345-0@lo:400:kworker.0 Request processed in 28us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740331.120589:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1790740331.120625:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc81326680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022015360:0@lo:400:kworker.0 00000100:00100000:3.0:1790740331.120636:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc81324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022015232:0@lo:400:kworker.0 00000100:00080000:1.0:1790740331.120730:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790740331.120743:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877727022014464:0@lo:400:kworker.0 00000100:00100000:1.0:1790740331.120773:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740331.120801:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc81325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1877727022014976:0@lo:400:kworker.0 00000100:00100000:1.0:1790740331.120821:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740331.120838:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc81324000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1877727022015488:0@lo:400:kworker.0 00000100:00100000:1.0:1790740331.120860:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740331.120877:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1790740331.120883:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022014592:0@lo:400:kworker.0 00000100:00100000:1.0:1790740331.120905:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740331.120923:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc81326d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1877727022015104:0@lo:400:kworker.0 00000100:00100000:1.0:1790740331.120943:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740331.120972:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc81326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1877727022015616:0@lo:400:kworker.0 00000100:00100000:1.0:1790740331.120994:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740331.121016:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022014848 00000100:00100000:1.0:1790740331.121020:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022014848 00000100:00100000:1.0:1790740331.121071:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022014592 00000100:00100000:1.0:1790740331.121075:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022014592 00000100:00100000:1.0:1790740331.121090:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1790740331.121097:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfcec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022014848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740331.121136:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfcec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022014848:12345-0@lo:400:kworker.0 Request processed in 40us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740331.121142:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1790740331.121156:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1790740331.121162:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022014592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740331.121193:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022014592:12345-0@lo:400:kworker.0 Request processed in 32us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740331.121199:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1790740331.121215:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022014720 00000100:00100000:1.0:1790740331.121219:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022014720 00000100:00100000:1.0:1790740331.121235:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022014464 00000100:00100000:1.0:1790740331.121238:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022014464 00000100:00100000:1.0:1790740331.121247:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022014976 00000100:00100000:1.0:1790740331.121249:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022014976 00000100:00100000:1.0:1790740331.121279:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022015488 00000100:00100000:1.0:1790740331.121283:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022015488 00000100:00100000:1.0:1790740331.121297:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022015104 00000100:00100000:1.0:1790740331.121299:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022015104 00000100:00100000:1.0:1790740331.121311:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022015616 00000100:00100000:1.0:1790740331.121313:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022015616 00000100:00100000:1.0:1790740331.121327:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1790740331.121333:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfced880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877727022014720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740331.121372:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfced880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877727022014720:12345-0@lo:400:kworker.0 Request processed in 40us (1283us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740331.121379:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1790740331.121391:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1790740331.121397:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877727022014464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740331.121425:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877727022014464:12345-0@lo:400:kworker.0 Request processed in 28us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740331.121431:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1790740331.121442:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1790740331.121447:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877727022014976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740331.121473:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877727022014976:12345-0@lo:400:kworker.0 Request processed in 26us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740331.121478:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1790740331.121489:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1790740331.121494:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84463b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877727022015488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740331.121519:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84463b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877727022015488:12345-0@lo:400:kworker.0 Request processed in 25us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740331.121525:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1790740331.121535:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1790740331.121540:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877727022015104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740331.121565:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877727022015104:12345-0@lo:400:kworker.0 Request processed in 26us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740331.121570:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1790740331.121580:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1790740331.121585:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877727022015616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740331.121618:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877727022015616:12345-0@lo:400:kworker.0 Request processed in 33us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740331.121625:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00080000:1.0:1790740331.121647:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790740331.121650:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790740331.121668:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022014592:0@lo:400:kworker.0 00010000:00080000:1.0:1790740331.121680:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dc81326d80 x1877727022015104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740331.121689:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc81326d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1877727022015104:0@lo:400:kworker.0 00010000:00080000:1.0:1790740331.121698:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dc81326300 x1877727022015616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740331.121705:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc81326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1877727022015616:0@lo:400:kworker.0 00000100:00100000:1.0:1790740331.121712:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877727022014464:0@lo:400:kworker.0 00000100:00100000:1.0:1790740331.121720:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc81325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1877727022014976:0@lo:400:kworker.0 00000100:00100000:1.0:1790740331.121728:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc81324000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1877727022015488:0@lo:400:kworker.0 00000100:00100000:2.0:1790740331.122152:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022014336 00000100:00100000:2.0:1790740331.122158:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022014336 00000100:00100000:2.0:1790740331.122205:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:2.0:1790740331.122213:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3638:x1877727022014336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740331.122257:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3638:x1877727022014336:12345-0@lo:400:kworker.0 Request processed in 46us (1999us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740331.122264:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1790740331.122820:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727022014336:0@lo:400:kworker.0 00000100:00100000:3.0:1790740331.122844:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc81325180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022014848:0@lo:400:kworker.0 00000100:00100000:3.0:1790740331.122854:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84496300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877727022014720:0@lo:400:kworker.0 00010000:00010000:1.0:1790740332.013415:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740332.138391:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790740332.138415:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfcef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022015744:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790740332.138485:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740332.138600:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022015744 00000100:00100000:3.0:1790740332.138608:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022015744 00000100:00100000:3.0:1790740332.138665:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1790740332.138674:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022015744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790740332.138708:0:6541:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1790740332.138759:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022015744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740332.138767:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1790740332.138857:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfcef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022015744:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1790740333.037753:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740334.059524:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740334.186703:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc81325180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022015872:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790740334.186778:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740334.186946:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022015872 00000100:00100000:3.0:1790740334.186965:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022015872 00000100:00100000:3.0:1790740334.187118:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1790740334.187131:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022015872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790740334.187182:0:7846:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1790740334.187295:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022015872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 167us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740334.187303:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1790740334.187408:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc81325180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022015872:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790740334.698602:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83c50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022016000:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790740334.698708:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc81324000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022016128:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790740334.698719:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740334.698744:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740334.698825:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022016000 00000100:00100000:0.0:1790740334.698844:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022016000 00000100:00100000:0.0:1790740334.698918:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022016128 00000100:00100000:0.0:1790740334.698922:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022016128 00000100:00100000:0.0:1790740334.698946:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1790740334.698957:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022016000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790740334.698998:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790740334.699079:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022016000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 123us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740334.699087:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1790740334.699106:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1790740334.699111:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfcef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022016128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790740334.699122:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790740334.699151:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfcef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022016128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740334.699157:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:1.0:1790740334.699375:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790740334.699425:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83c50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022016000:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790740334.705729:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc81324000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022016128:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790740335.085315:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740336.024582:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740336.024636:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740336.024677:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740336.024702:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740336.024768:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740336.024811:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000951424 00000100:00100000:3.0:1790740336.024823:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000951424 00000100:00100000:3.0:1790740336.024907:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000951680 00000100:00100000:3.0:1790740336.024911:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000951680 00000100:00100000:3.0:1790740336.024930:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000951296 00000100:00100000:3.0:1790740336.024933:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000951296 00000100:00100000:3.0:1790740336.024945:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000951552 00000100:00100000:3.0:1790740336.024947:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000951552 00000100:00100000:3.0:1790740336.024965:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 260 00000100:00100000:3.0:1790740336.024974:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfceed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+5:2403:x1877727000951424:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740336.025114:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfceed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+5:2403:x1877727000951424:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 141us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740336.025209:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 260 00000100:00100000:3.0:1790740336.025232:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 261 00000100:00100000:3.0:1790740336.025240:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfcec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2403:x1877727000951680:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740336.025270:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfcec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2403:x1877727000951680:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 31us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740336.025277:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 261 00000100:00100000:3.0:1790740336.025288:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 262 00000100:00100000:3.0:1790740336.025296:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5f6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+5:2403:x1877727000951296:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740336.025324:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5f6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+5:2403:x1877727000951296:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 29us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740336.025331:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 262 00000100:00100000:3.0:1790740336.025343:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 263 00000100:00100000:3.0:1790740336.025351:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc98535500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2403:x1877727000951552:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740336.025390:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc98535500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2403:x1877727000951552:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 41us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740336.025398:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 263 00000100:00100000:0.0:1790740336.025588:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000951168 00000100:00100000:0.0:1790740336.025594:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000951168 00000100:00080000:1.0:1790740336.025608:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790740336.025616:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790740336.025642:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 376 00000100:00100000:0.0:1790740336.025661:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:2403:x1877727000951168:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1790740336.025703:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:2403:x1877727000951168:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 45us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740336.025710:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 376 00010000:00010000:2.0:1790740336.107498:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740336.234464:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc81324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877727022016640:0@lo:400:kworker.0 00000100:00100000:0.0:1790740336.234568:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740336.234894:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83f11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022017152:0@lo:400:kworker.0 00000100:00100000:1.0:1790740336.234928:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc81325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727022016256:0@lo:400:kworker.0 00000100:00100000:0.0:1790740336.234937:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740336.234972:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb8138000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022017664:0@lo:400:kworker.0 00000100:00100000:1.0:1790740336.234986:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740336.235011:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740336.235025:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc81326680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022016768:0@lo:400:kworker.0 00000100:00100000:2.0:1790740336.235275:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc81326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877727022016384:0@lo:400:kworker.0 00000100:00100000:0.0:1790740336.236525:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1790740336.236548:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc81326d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022016512:0@lo:400:kworker.0 00000100:00100000:1.0:1790740336.236583:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740336.237438:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022017152 00000100:00100000:0.0:1790740336.237453:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022017152 00000100:00100000:2.0:1790740336.237494:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740336.237539:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc81324000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1877727022016896:0@lo:400:kworker.0 00000100:00100000:2.0:1790740336.237574:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740336.237612:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83f11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1877727022017408:0@lo:400:kworker.0 00000100:00100000:2.0:1790740336.237637:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740336.237654:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83c50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022017920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790740336.237696:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740336.237745:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022016640 00000100:00100000:2.0:1790740336.237749:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022016640 00000100:00100000:2.0:1790740336.237791:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022016384 00000100:00100000:2.0:1790740336.237793:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022016384 00000100:00100000:2.0:1790740336.237805:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022016896 00000100:00100000:2.0:1790740336.237807:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022016896 00000100:00100000:2.0:1790740336.237822:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022017408 00000100:00100000:2.0:1790740336.237824:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022017408 00000100:00100000:2.0:1790740336.237841:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1790740336.237850:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd550000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877727022016640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740336.237910:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd550000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877727022016640:12345-0@lo:400:kworker.0 Request processed in 60us (3341us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740336.237918:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1790740336.237937:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1790740336.237943:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaefd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877727022016384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740336.237985:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaefd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877727022016384:12345-0@lo:400:kworker.0 Request processed in 43us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740336.237992:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1790740336.238004:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1790740336.238010:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaefdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1877727022016896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740336.238059:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaefdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1877727022016896:12345-0@lo:400:kworker.0 Request processed in 29us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740336.238066:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1790740336.238098:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1790740336.238103:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaefd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1877727022017408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740336.238413:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022017664 00000100:00100000:0.0:1790740336.238419:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022017664 00000100:00100000:0.0:1790740336.238452:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1790740336.238465:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd552680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022017152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740336.238470:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaefd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1877727022017408:12345-0@lo:400:kworker.0 Request processed in 364us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740336.238479:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1790740336.238507:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022016768 00000100:00100000:2.0:1790740336.238512:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022016768 00000100:00100000:0.0:1790740336.238520:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd552680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022017152:12345-0@lo:400:kworker.0 Request processed in 60us (3584us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740336.238529:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1790740336.238548:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1790740336.238552:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1790740336.238558:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022017664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740336.238564:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022016768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740336.238605:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022017664:12345-0@lo:400:kworker.0 Request processed in 49us (3595us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740336.238617:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022016768:12345-0@lo:400:kworker.0 Request processed in 56us (2035us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740336.238631:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1790740336.238632:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1790740336.238666:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022017920 00000100:00100000:2.0:1790740336.238670:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022017920 00000100:00100000:2.0:1790740336.238710:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1790740336.238717:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaefdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022017920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790740336.238744:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790740336.238775:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaefdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022017920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (1079us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740336.238781:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1790740336.238835:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc81326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877727022016384:0@lo:400:kworker.0 00000100:00100000:2.0:1790740336.238845:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc81324000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1877727022016896:0@lo:400:kworker.0 00000100:00100000:2.0:1790740336.238854:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83f11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1877727022017408:0@lo:400:kworker.0 00010000:00080000:2.0:1790740336.238866:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83c50a80 x1877727022017920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740352 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740336.238897:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83c50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022017920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790740336.239098:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022016256 00000100:00100000:0.0:1790740336.239104:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022016256 00000100:00100000:0.0:1790740336.239140:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1790740336.239147:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3638:x1877727022016256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740336.239200:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3638:x1877727022016256:12345-0@lo:400:kworker.0 Request processed in 54us (4216us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740336.239207:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1790740336.239326:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022018048:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790740336.239365:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740336.239433:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022018048 00000100:00100000:2.0:1790740336.239439:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022018048 00000100:00100000:0.0:1790740336.239457:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740336.239469:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1790740336.239476:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd553100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022018048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790740336.239488:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790740336.239496:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc81325180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1877727022017024:0@lo:400:kworker.0 00000100:00100000:2.0:1790740336.239530:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd553100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022018048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740336.239537:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740336.239542:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1790740336.239564:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83f10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1877727022017536:0@lo:400:kworker.0 00000100:00100000:2.0:1790740336.239565:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022017024 00000100:00100000:2.0:1790740336.239570:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022017024 00000100:00100000:0.0:1790740336.239601:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740336.239603:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1790740336.239611:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ce0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1877727022017024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740336.239639:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc81324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877727022016640:0@lo:400:kworker.0 00000100:00100000:2.0:1790740336.239646:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ce0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1877727022017024:12345-0@lo:400:kworker.0 Request processed in 34us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740336.239653:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1790740336.239659:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83f11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022017152:0@lo:400:kworker.0 00000100:00100000:2.0:1790740336.239674:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022017536 00010000:00080000:0.0:1790740336.239675:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcb8138000 x1877727022017664/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740336.239679:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022017536 00000100:00100000:0.0:1790740336.239690:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb8138000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022017664:0@lo:400:kworker.0 00000100:00100000:2.0:1790740336.239712:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1790740336.239720:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82330700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1877727022017536:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1790740336.239737:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dc81325180 x1877727022017024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740336.239748:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc81325180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1877727022017024:0@lo:400:kworker.0 00000100:00100000:2.0:1790740336.239751:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82330700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1877727022017536:12345-0@lo:400:kworker.0 Request processed in 32us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740336.239759:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00010000:00080000:0.0:1790740336.239782:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83f10a80 x1877727022017536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740336.239792:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83f10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1877727022017536:0@lo:400:kworker.0 00010000:00080000:2.0:1790740336.239799:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcbd552a00 x1877727022018048/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740352 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740336.239826:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022018048:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1790740336.239842:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790740336.239850:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790740336.239854:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790740336.239857:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790740336.239947:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc81326680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022016768:0@lo:400:kworker.0 00000100:00100000:1.0:1790740336.240015:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83f12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022017280:0@lo:400:kworker.0 00000100:00100000:2.0:1790740336.240085:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022016512 00000100:00100000:2.0:1790740336.240090:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022016512 00000100:00100000:2.0:1790740336.240126:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1790740336.240133:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ce2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022016512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740336.240182:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ce2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022016512:12345-0@lo:400:kworker.0 Request processed in 49us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740336.240188:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1790740336.240211:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc81326d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022016512:0@lo:400:kworker.0 00000100:00100000:1.0:1790740336.240469:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740336.240529:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022017792:0@lo:400:kworker.0 00000100:00100000:1.0:1790740336.240551:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740336.240613:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc81325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727022016256:0@lo:400:kworker.0 00000100:00100000:2.0:1790740336.240645:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022017280 00000100:00100000:2.0:1790740336.240650:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022017280 00000100:00100000:2.0:1790740336.240694:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022017792 00000100:00100000:2.0:1790740336.240697:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022017792 00000100:00100000:2.0:1790740336.240723:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1790740336.240730:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84496300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022017280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740336.240773:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84496300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022017280:12345-0@lo:400:kworker.0 Request processed in 44us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740336.240780:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1790740336.240792:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1790740336.240797:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022017792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740336.240826:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022017792:12345-0@lo:400:kworker.0 Request processed in 28us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740336.240831:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:2.0:1790740336.240849:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790740336.241068:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83f12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022017280:0@lo:400:kworker.0 00010000:00080000:1.0:1790740336.241307:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcbd550700 x1877727022017792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740336.241318:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022017792:0@lo:400:kworker.0 00000040:00080000:2.0:1790740336.428005:0:13823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1790740336.433684:0:13821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:1.0:1790740336.762466:0:8446:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7bed19f2-4c98-4684-89e7-a6871565665d 00000020:00000080:1.0:1790740336.762479:0:8446:0:(genops.c:885:class_export_put()) final put ffff98db83f0e800/7bed19f2-4c98-4684-89e7-a6871565665d 00000020:00000080:0.0:1790740336.762551:0:11805:0:(genops.c:844:class_export_destroy()) destroying export ffff98db83f0e800/7bed19f2-4c98-4684-89e7-a6871565665d for lustre-OST0000 00000020:00000080:0.0:1790740336.763430:0:11805:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98db83f0f800 for lustre-OST0000 00010000:00010000:2.0:1790740337.130967:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740337.258334:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790740337.258367:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98534380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022018176:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790740337.258470:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740337.258639:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022018176 00000100:00100000:3.0:1790740337.258651:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022018176 00000100:00100000:3.0:1790740337.258736:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1790740337.258748:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84494380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727022018176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790740337.258798:0:6541:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1790740337.258866:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84494380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727022018176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740337.258874:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1790740337.259026:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc98534380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022018176:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1790740338.154590:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740339.178279:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740339.306359:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022018304:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790740339.306438:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740339.306520:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022018304 00000100:00100000:1.0:1790740339.306527:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022018304 00000100:00100000:1.0:1790740339.306651:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1790740339.306658:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84496a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022018304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790740339.306693:0:6540:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1790740339.306741:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84496a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022018304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740339.306748:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1790740339.306794:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022018304:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790740339.818319:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790740339.818348:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82332a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022018432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790740339.818438:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740339.818552:0:10118:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022018432 00000100:00100000:0.0:1790740339.818560:0:10118:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022018432 00000100:00100000:0.0:1790740339.818622:0:10118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1790740339.818632:0:10118:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022018432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790740339.818663:0:10118:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790740339.818716:0:10118:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022018432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740339.818723:0:10118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1790740339.818772:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82332a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022018432:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790740339.818843:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790740339.833501:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82332a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022018560:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790740339.833586:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740339.833715:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022018560 00000100:00100000:0.0:1790740339.833724:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022018560 00000100:00100000:0.0:1790740339.833795:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1790740339.833804:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022018560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790740339.833827:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790740339.833877:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022018560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740339.833900:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1790740339.833949:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82332a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022018560:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1790740339.833972:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790740340.202304:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740341.156518:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740341.156567:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740341.156604:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740341.156657:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740341.156683:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740341.156744:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000952064 00000100:00100000:0.0:1790740341.156756:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000952064 00000100:00100000:2.0:1790740341.156773:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000951808 00000100:00100000:2.0:1790740341.156781:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000951808 00000100:00100000:0.0:1790740341.156838:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000952320 00000100:00100000:0.0:1790740341.156843:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000952320 00000100:00100000:2.0:1790740341.156845:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 378 00000100:00100000:2.0:1790740341.156859:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:2405:x1877727000951808:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1790740341.156865:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000951936 00000100:00100000:0.0:1790740341.156869:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000951936 00000100:00100000:0.0:1790740341.156882:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000952192 00000100:00100000:0.0:1790740341.156885:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000952192 00000100:00100000:0.0:1790740341.156905:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 270 00000100:00100000:0.0:1790740341.156914:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc98534e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+5:2405:x1877727000952064:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1790740341.156934:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:2405:x1877727000951808:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 78us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740341.156942:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 378 00000100:00100000:0.0:1790740341.156955:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc98534e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+5:2405:x1877727000952064:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 40us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740341.156963:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 270 00000100:00100000:2.0:1790740341.156985:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 271 00000100:00100000:2.0:1790740341.157132:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc98534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2405:x1877727000952320:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1790740341.157169:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc98534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2405:x1877727000952320:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 177us (564us total) trans 0 rc 0/0 00000100:00080000:3.0:1790740341.157194:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790740341.157200:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790740341.159703:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 272 00000100:00100000:0.0:1790740341.159735:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc867d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+5:2405:x1877727000951936:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1790740341.159904:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc867d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+5:2405:x1877727000951936:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 186us (3244us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740341.159912:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 272 00000100:00100000:0.0:1790740341.159944:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 273 00000100:00100000:0.0:1790740341.159951:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc867d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2405:x1877727000952192:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1790740341.160183:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc867d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2405:x1877727000952192:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 231us (3497us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740341.160190:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 273 00000100:00100000:2.0:1790740341.170587:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 271 00010000:00010000:1.0:1790740341.233975:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740341.357244:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82332a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3641:1877727022018688:0@lo:400:kworker.0 00000100:00100000:1.0:1790740341.357328:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740341.357399:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82330e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022019200:0@lo:400:kworker.0 00000100:00100000:1.0:1790740341.357430:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740341.357451:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb8138000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022019712:0@lo:400:kworker.0 00000100:00100000:1.0:1790740341.357474:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740341.357493:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1790740341.357513:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877727022019072:0@lo:400:kworker.0 00000100:00100000:1.0:1790740341.357537:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740341.357553:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022019584:0@lo:400:kworker.0 00000100:00100000:1.0:1790740341.357571:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740341.357599:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790740341.357602:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022020096:0@lo:400:kworker.0 00000100:00100000:0.0:1790740341.357613:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022020224:0@lo:400:kworker.0 00000100:00100000:1.0:1790740341.357627:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740341.357654:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740341.357665:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022018688 00000100:00100000:1.0:1790740341.357673:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022018688 00000100:00100000:0.0:1790740341.357692:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82331f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727022018816:0@lo:400:kworker.0 00000100:00100000:1.0:1790740341.357723:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1790740341.357724:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740341.357737:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3641:x1877727022018688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740341.357749:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877727022019328:0@lo:400:kworker.0 00000100:00100000:0.0:1790740341.357773:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740341.357793:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82c8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1877727022019840:0@lo:400:kworker.0 00000100:00100000:1.0:1790740341.357802:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3641:x1877727022018688:12345-0@lo:400:kworker.0 Request processed in 66us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740341.357810:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1790740341.357819:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740341.357846:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1790740341.357848:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022019200 00000100:00100000:1.0:1790740341.357853:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022019200 00000100:00100000:0.0:1790740341.357854:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022018944:0@lo:400:kworker.0 00000100:00100000:1.0:1790740341.357884:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1790740341.357887:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740341.357896:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022019200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740341.357911:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1877727022019456:0@lo:400:kworker.0 00000100:00100000:1.0:1790740341.357944:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022019200:12345-0@lo:400:kworker.0 Request processed in 50us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740341.357948:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740341.357957:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1790740341.357972:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022018944 00000100:00100000:0.0:1790740341.357973:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1877727022019968:0@lo:400:kworker.0 00000100:00100000:1.0:1790740341.357977:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022018944 00000100:00100000:1.0:1790740341.357997:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1790740341.358004:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740341.358007:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022018944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740341.358055:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022019072 00000100:00100000:1.0:1790740341.358085:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022018944:12345-0@lo:400:kworker.0 Request processed in 68us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740341.358091:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1790740341.358111:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022019712 00000100:00100000:1.0:1790740341.358114:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022019712 00000100:00100000:1.0:1790740341.358141:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022019584 00000100:00100000:1.0:1790740341.358143:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022019584 00000100:00100000:1.0:1790740341.358156:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022020096 00000100:00100000:1.0:1790740341.358165:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022020096 00000100:00100000:1.0:1790740341.358181:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022020224 00000100:00100000:1.0:1790740341.358183:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022020224 00000100:00100000:1.0:1790740341.358197:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1790740341.358203:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022019712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740341.358236:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022019712:12345-0@lo:400:kworker.0 Request processed in 33us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740341.358241:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1790740341.358254:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1790740341.358259:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022019584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740341.358284:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022019584:12345-0@lo:400:kworker.0 Request processed in 26us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740341.358290:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1790740341.358299:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1790740341.358305:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022020096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740341.358329:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022020096:12345-0@lo:400:kworker.0 Request processed in 25us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740341.358333:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1790740341.358341:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1790740341.358346:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727022020224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740341.358375:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727022020224:12345-0@lo:400:kworker.0 Request processed in 29us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740341.358380:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1790740341.358397:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022018816 00000100:00100000:1.0:1790740341.358400:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022018816 00000100:00100000:1.0:1790740341.358417:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022019328 00000100:00100000:1.0:1790740341.358420:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022019328 00000100:00100000:1.0:1790740341.358442:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022019840 00000100:00100000:1.0:1790740341.358445:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022019840 00000100:00100000:1.0:1790740341.358455:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022019456 00000100:00100000:1.0:1790740341.358457:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022019456 00000100:00100000:1.0:1790740341.358466:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022019968 00000100:00100000:1.0:1790740341.358468:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022019968 00000100:00100000:1.0:1790740341.358482:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1790740341.358488:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727022018816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740341.358518:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727022018816:12345-0@lo:400:kworker.0 Request processed in 31us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740341.358524:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1790740341.358535:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1790740341.358541:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877727022019328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740341.358567:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877727022019328:12345-0@lo:400:kworker.0 Request processed in 27us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740341.358572:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1790740341.358582:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1790740341.358590:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877727022019840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740341.358593:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022019072 00000100:00100000:1.0:1790740341.358624:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877727022019840:12345-0@lo:400:kworker.0 Request processed in 36us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740341.358626:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1790740341.358637:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1790740341.358640:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877727022019456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740341.358655:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1790740341.358664:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877727022019968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740341.358686:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877727022019456:12345-0@lo:400:kworker.0 Request processed in 50us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740341.358695:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1790740341.358707:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877727022019968:12345-0@lo:400:kworker.0 Request processed in 43us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740341.358714:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1790740341.358721:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877727022019072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740341.358763:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877727022019072:12345-0@lo:400:kworker.0 Request processed in 43us (1225us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740341.359123:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877727022019072:0@lo:400:kworker.0 00000100:00100000:3.0:1790740341.359134:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022019584:0@lo:400:kworker.0 00010000:00080000:3.0:1790740341.359146:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db844cb480 x1877727022020096/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740341.359156:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022020096:0@lo:400:kworker.0 00000100:00100000:3.0:1790740341.359165:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82330e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022019200:0@lo:400:kworker.0 00000100:00100000:3.0:1790740341.359174:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb8138000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022019712:0@lo:400:kworker.0 00000100:00100000:3.0:1790740341.359190:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82332a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3641:1877727022018688:0@lo:400:kworker.0 00000100:00100000:1.0:1790740341.359360:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00080000:1.0:1790740341.359389:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790740341.359400:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790740341.359403:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790740341.359405:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790740341.359428:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db844c9c00 x1877727022020224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740341.359438:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022020224:0@lo:400:kworker.0 00000100:00100000:1.0:1790740341.359462:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022018944:0@lo:400:kworker.0 00010000:00080000:1.0:1790740341.359473:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db82333800 x1877727022019456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740341.359481:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1877727022019456:0@lo:400:kworker.0 00010000:00080000:1.0:1790740341.359491:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db844c8000 x1877727022019968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740341.359659:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1877727022019968:0@lo:400:kworker.0 00000100:00100000:1.0:1790740341.359676:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82331f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727022018816:0@lo:400:kworker.0 00000100:00100000:1.0:1790740341.359688:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877727022019328:0@lo:400:kworker.0 00000100:00100000:1.0:1790740341.359698:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82c8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1877727022019840:0@lo:400:kworker.0 00000100:00100000:0.0:1790740341.359721:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1790740341.360258:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790740341.360273:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022020352:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790740341.361179:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790740341.361183:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740341.361198:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc867d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022020480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790740341.361240:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740341.361326:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022020352 00000100:00100000:3.0:1790740341.361334:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022020352 00000100:00100000:3.0:1790740341.361391:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022020480 00000100:00100000:3.0:1790740341.361395:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022020480 00000100:00100000:3.0:1790740341.361411:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1790740341.361419:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022020352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790740341.361446:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790740341.361490:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022020352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740341.361508:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1790740341.361528:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1790740341.361534:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82c8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022020480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790740341.361544:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790740341.361572:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82c8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022020480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740341.361578:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00010000:00080000:3.0:1790740341.361611:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dc867d5500 x1877727022020480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740357 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740341.361626:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc867d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022020480:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1790740341.361737:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db844c9180 x1877727022020352/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740357 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740341.361750:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022020352:0@lo:13:osp-pre-1-1.0 00000001:02000400:0.0:1790740341.976838:0:14082:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 23:52:20 (1790740340) 00010000:00010000:2.0:1790740342.250526:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740342.378766:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc867d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022020608:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790740342.378860:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740342.378953:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022020608 00000100:00100000:1.0:1790740342.378963:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022020608 00000100:00100000:1.0:1790740342.379065:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1790740342.379075:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb81b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727022020608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790740342.379109:0:7846:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790740342.379159:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb81b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727022020608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740342.379166:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1790740342.379208:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc867d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022020608:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1790740343.274350:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740343.709198:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740343.709279:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000952448 00000100:00100000:0.0:1790740343.709297:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000952448 00000100:00100000:0.0:1790740343.709404:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 40 00000100:00080000:1.0:1790740343.709411:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790740343.709417:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc867d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+5:11085:x1877727000952448:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790740343.709438:0:13222:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740343.709462:0:13222:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92de1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23c45 expref: -99 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740343.709532:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061200/0xb25dda4f4e92de21 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740343.709545:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061200/0xb25dda4f4e92de21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740343.709557:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061200/0xb25dda4f4e92de21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790740343.709629:0:13222:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790740343.709633:0:13222:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790740343.709675:0:13222:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061200/0xb25dda4f4e92de21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740343.709699:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92de1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c45 expref: 7 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740343.709717:0:13222:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061200/0xb25dda4f4e92de21 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c45 expref: 6 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740343.709725:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98db82949200) 00010000:00010000:0.0:1790740343.709728:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790740343.709731:0:13222:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaf061200, rc 0) 00000100:00100000:0.0:1790740343.709806:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc867d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+6:11085:x1877727000952448:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 392us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740343.709814:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 40 00000100:00100000:0.0:1790740343.724338:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740343.724514:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000952576 00000100:00100000:1.0:1790740343.724525:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000952576 00000100:00100000:1.0:1790740343.727003:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 41 00000100:00100000:1.0:1790740343.727022:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+6:11086:x1877727000952576:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790740343.727078:0:7760:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740343.727104:0:7760:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92de28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23c4c expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740343.727178:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92de2f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740343.727205:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92de2f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740343.727219:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92de2f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740343.727235:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44200/0xb25dda4f4e92de36 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740343.727262:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44200/0xb25dda4f4e92de36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740343.727270:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44200/0xb25dda4f4e92de36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740343.727336:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44600/0xb25dda4f4e92de3d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740343.727345:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44600/0xb25dda4f4e92de3d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740343.727352:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44600/0xb25dda4f4e92de3d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740343.727476:0:7760:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1790740343.727480:0:7760:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790740343.727502:0:7760:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44600/0xb25dda4f4e92de3d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740343.727515:0:7760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92de2f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740343.727522:0:7760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92de2f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740343.727530:0:7760:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92de2f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740343.727536:0:7760:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc44c00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740343.727957:0:7760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92de2f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740343.728166:0:7760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92de2f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740343.728180:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98db82949200) 00010000:00010000:1.0:1790740343.728183:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740343.728188:0:7760:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92de2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740343.728195:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92de2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740343.728213:0:7760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44200/0xb25dda4f4e92de36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740343.728219:0:7760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44200/0xb25dda4f4e92de36 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740343.728224:0:7760:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44200/0xb25dda4f4e92de36 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740343.728228:0:7760:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc44200 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740343.728231:0:7760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44200/0xb25dda4f4e92de36 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740343.728237:0:7760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44200/0xb25dda4f4e92de36 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740343.728244:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff98dc985be900) 00010000:00010000:1.0:1790740343.728247:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740343.728249:0:7760:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44200/0xb25dda4f4e92de36 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740343.728267:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44200/0xb25dda4f4e92de36 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740343.728305:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92de28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c4c expref: 8 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740343.728326:0:7760:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44600/0xb25dda4f4e92de3d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c4c expref: 7 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740343.728334:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98dc985be500) 00010000:00010000:1.0:1790740343.728337:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790740343.728339:0:7760:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcbfc44600, rc 0) 00000100:00100000:1.0:1790740343.728418:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+7:11086:x1877727000952576:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 1401us (4089us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740343.728427:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 41 00000100:00100000:1.0:1790740343.734689:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740343.734842:0:6547:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000952704 00000100:00100000:2.0:1790740343.734855:0:6547:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000952704 00000100:00100000:2.0:1790740343.734910:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 7 00000100:00100000:2.0:1790740343.734920:0:6547:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb81b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7bed19f2-4c98-4684-89e7-a6871565665d+7:11086:x1877727000952704:12345-192.168.204.3@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1790740343.735016:0:6547:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb81b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7bed19f2-4c98-4684-89e7-a6871565665d+7:11086:x1877727000952704:12345-192.168.204.3@tcp:900:lhsmtool_posix.0 Request processed in 98us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740343.735024:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 7 00000100:00100000:3.0:1790740343.742387:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740343.742512:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000952960 00000100:00100000:0.0:1790740343.742522:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000952960 00000100:00100000:0.0:1790740343.742584:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 42 00000100:00100000:0.0:1790740343.742595:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc867d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+7:11086:x1877727000952960:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790740343.742616:0:6535:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740343.743915:0:6535:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92de44 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23c53 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740343.744019:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92de4b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740343.744080:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92de4b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740343.744092:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92de4b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740343.744164:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060a00/0xb25dda4f4e92de52 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740343.744173:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060a00/0xb25dda4f4e92de52 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740343.744180:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060a00/0xb25dda4f4e92de52 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740343.744295:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061400/0xb25dda4f4e92de59 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740343.744303:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061400/0xb25dda4f4e92de59 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740343.744309:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061400/0xb25dda4f4e92de59 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790740343.744319:0:6535:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1790740343.744414:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92de4b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740343.744421:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92de4b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740343.744429:0:6535:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92de4b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740343.744444:0:6535:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf061800 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:0.0:1790740343.744448:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92de4b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740343.744947:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92de4b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740343.744961:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98dc985be500) 00010000:00010000:0.0:1790740343.744964:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740343.744969:0:6535:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92de4b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740343.744975:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92de4b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740343.744993:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060a00/0xb25dda4f4e92de52 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740343.744998:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060a00/0xb25dda4f4e92de52 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740343.745003:0:6535:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060a00/0xb25dda4f4e92de52 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740343.745008:0:6535:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf060a00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:0.0:1790740343.745011:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060a00/0xb25dda4f4e92de52 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740343.745016:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060a00/0xb25dda4f4e92de52 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740343.745376:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff98db82949000) 00010000:00010000:0.0:1790740343.745379:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740343.745382:0:6535:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060a00/0xb25dda4f4e92de52 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740343.745388:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060a00/0xb25dda4f4e92de52 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740343.745786:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92de44 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c53 expref: 10 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740343.745802:0:6535:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061400/0xb25dda4f4e92de59 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c53 expref: 9 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740343.745809:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98db82949800) 00010000:00010000:0.0:1790740343.745811:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740343.745813:0:6535:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaf061400, rc 0) 00000100:00100000:0.0:1790740343.745969:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc867d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+9:11086:x1877727000952960:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 3373us (3589us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1790740343.745980:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 42 00000100:00100000:1.0:1790740343.759156:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740343.759257:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000953088 00000100:00100000:3.0:1790740343.759267:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000953088 00000100:00100000:3.0:1790740343.759329:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 43 00000100:00100000:3.0:1790740343.759338:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb81b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+9:11086:x1877727000953088:12345-192.168.204.3@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1790740343.759798:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb81b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+9:11086:x1877727000953088:12345-192.168.204.3@tcp:59:lhsmtool_posix.0 Request processed in 460us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740343.759808:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 43 00000100:00100000:1.0:1790740343.763174:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740343.763378:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000953216 00000100:00100000:0.0:1790740343.763389:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000953216 00000100:00100000:0.0:1790740343.763463:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 44 00000100:00100000:0.0:1790740343.763474:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb81b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+5:11086:x1877727000953216:12345-192.168.204.3@tcp:59:lhsmtool_posix.0 00000100:00080000:1.0:1790740343.763634:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:1.0:1790740343.770288:0:7760:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 6770us 00000100:00100000:2.0:1790740343.783371:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb81b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+5:11086:x1877727000953216:12345-192.168.204.3@tcp:59:lhsmtool_posix.0 Request processed in 19881us (20188us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740343.783391:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 44 00010000:00010000:3.0:1790740344.305576:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740344.427394:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022020736:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790740344.427499:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740344.427626:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022020736 00000100:00100000:2.0:1790740344.427638:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022020736 00000100:00100000:2.0:1790740344.427704:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1790740344.427716:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb81b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022020736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790740344.427766:0:6541:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1790740344.431443:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb81b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022020736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3716us (3931us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740344.431465:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1790740344.436330:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022020736:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1790740344.620560:0:13821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1790740344.625593:0:13823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790740344.938416:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022020992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790740344.938536:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740344.938666:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790740344.938674:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022020864:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790740344.938702:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740344.938791:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022020992 00000100:00100000:2.0:1790740344.938802:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022020992 00000100:00100000:2.0:1790740344.938888:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022020864 00000100:00100000:2.0:1790740344.938892:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022020864 00000100:00100000:2.0:1790740344.938917:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1790740344.938928:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb81b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022020992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790740344.938968:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790740344.939066:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb81b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022020992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740344.939075:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1790740344.939098:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1790740344.939106:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb81b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022020864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790740344.939118:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790740344.939146:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb81b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022020864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740344.939152:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1790740344.939222:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022020864:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790740344.939240:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022020992:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790740344.939570:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790740345.323220:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740346.041947:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740346.047781:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000953344 00000100:00100000:1.0:1790740346.047795:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000953344 00000100:00100000:1.0:1790740346.047865:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 45 00000100:00100000:1.0:1790740346.047876:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc867d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+9:11129:x1877727000953344:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:1.0:1790740346.047898:0:6535:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740346.047919:0:6535:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92de67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23c5a expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.047998:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92de6e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.048013:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92de6e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.048026:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92de6e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.048140:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92de75 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.048150:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92de75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.048157:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92de75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.048202:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92de6e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.048221:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92de6e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.048228:0:6535:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92de6e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.048234:0:6535:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc45400 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740346.048238:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92de6e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.048246:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92de6e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.048259:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98db82949200) 00010000:00010000:1.0:1790740346.048262:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740346.048267:0:6535:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92de6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.048273:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92de6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.048472:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92de75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.048480:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92de75 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.048486:0:6535:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92de75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.048492:0:6535:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc45600 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740346.048500:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92de75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.048506:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92de75 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.048514:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff98dcaec70d00) 00010000:00010000:1.0:1790740346.048517:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740346.048520:0:6535:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92de75 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.048526:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92de75 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.048556:0:6535:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92de67 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c5a expref: 10 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.048566:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98db82949200) 00010000:00010000:1.0:1790740346.048568:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740346.048572:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92de67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c5a expref: 10 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.048581:0:6535:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcbfc45e00, rc 0) 00000100:00100000:1.0:1790740346.048644:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc867d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+9:11129:x1877727000953344:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 771us (6707us total) trans 0 rc 301/301 00000100:00100000:1.0:1790740346.048651:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 45 00000100:00080000:3.0:1790740346.050018:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790740346.065273:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740346.065310:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000953600 00000100:00100000:1.0:1790740346.065320:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000953600 00000100:00100000:1.0:1790740346.065377:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 46 00000100:00100000:1.0:1790740346.065396:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+9:11129:x1877727000953600:12345-192.168.204.3@tcp:36:lfs.0 00010000:00010000:1.0:1790740346.065453:0:6536:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740346.065478:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061200/0xb25dda4f4e92de21 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c45 expref: 9 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.065493:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98db82949200) 00010000:00010000:1.0:1790740346.065504:0:6536:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790740346.065564:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92de7c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.065578:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92de7c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.065590:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92de7c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.065603:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92de83 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.065611:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92de83 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.065618:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92de83 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.066238:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92de8a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.066251:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92de8a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.066259:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92de8a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790740346.066285:0:6536:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000069ac7d4d reply state 000000001e3b7f65 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92de8a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.066297:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92de8a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.066304:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98dcaec70300) 00010000:00010000:1.0:1790740346.066306:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790740346.066309:0:6536:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1790740346.066314:0:6536:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1790740346.066321:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92de7c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.066329:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92de7c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.066336:0:6536:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92de7c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.066343:0:6536:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc45e00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740346.066348:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92de7c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.066356:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92de7c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.066364:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98dcaec70d00) 00010000:00010000:1.0:1790740346.066366:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740346.066370:0:6536:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92de7c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.066387:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92de7c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790740346.066404:0:6536:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000069ac7d4d reply state 000000001e3b7f65 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92de83 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.066412:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92de83 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.066418:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff98dcaec70c00) 00010000:00010000:1.0:1790740346.066421:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790740346.066423:0:6536:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1790740346.066533:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+10:11129:x1877727000953600:12345-192.168.204.3@tcp:36:lfs.0 Request processed in 1138us (1269us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1790740346.066541:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 46 00000100:00100000:1.0:1790740346.174876:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740346.176875:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000953728 00000100:00100000:2.0:1790740346.176891:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000953728 00000100:00100000:2.0:1790740346.176968:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 47 00000100:00100000:2.0:1790740346.176989:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+10:11137:x1877727000953728:12345-192.168.204.3@tcp:101:lctl.0 00010000:00010000:2.0:1790740346.177017:0:7760:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740346.177096:0:7760:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92de91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23c61 expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.177165:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92de98 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.177179:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92de98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.177191:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92de98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740346.177250:0:7760:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790740346.177255:0:7760:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790740346.177295:0:7760:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92de98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.177320:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92de91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c61 expref: 12 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.177340:0:7760:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92de98 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c61 expref: 11 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.177363:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98dcaf045a00) 00010000:00010000:2.0:1790740346.177366:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790740346.177369:0:7760:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f33e00, rc 0) 00000100:00100000:2.0:1790740346.177436:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+11:11137:x1877727000953728:12345-192.168.204.3@tcp:101:lctl.0 Request processed in 458us (2570us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740346.177443:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 47 00000100:00100000:3.0:1790740346.223730:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740346.224823:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000953856 00000100:00100000:1.0:1790740346.224838:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000953856 00000100:00100000:1.0:1790740346.224922:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 48 00000100:00100000:1.0:1790740346.224932:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc867d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+11:11143:x1877727000953856:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:1.0:1790740346.224952:0:6537:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740346.224972:0:6537:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92de9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23c68 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.225942:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92dea6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.225962:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92dea6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.225974:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92dea6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.225997:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92dead lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.226005:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92dead lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.226011:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92dead lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.226195:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33800/0xb25dda4f4e92deb4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.226204:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33800/0xb25dda4f4e92deb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.226300:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33800/0xb25dda4f4e92deb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740346.226338:0:6537:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1790740346.226347:0:6537:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790740346.226388:0:6537:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33800/0xb25dda4f4e92deb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.226400:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92dea6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.226407:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92dea6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.226413:0:6537:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92dea6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.226419:0:6537:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f33000 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740346.226423:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92dea6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.226430:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92dea6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.226440:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98dcaf045a00) 00010000:00010000:2.0:1790740346.226443:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740346.226448:0:6537:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92dea6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.226453:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92dea6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.226476:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92dead lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.226483:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92dead lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.226488:0:6537:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92dead lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.226494:0:6537:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f32200 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740346.226497:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92dead lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.226502:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92dead lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.226509:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff98dcaec70c00) 00010000:00010000:2.0:1790740346.226512:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740346.226515:0:6537:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92dead lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.226520:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92dead lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.226551:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92de9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c68 expref: 13 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.226566:0:6537:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33800/0xb25dda4f4e92deb4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c68 expref: 12 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.226585:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98dcaec70300) 00010000:00010000:2.0:1790740346.226587:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1790740346.226590:0:6537:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f33800, rc 0) 00000100:00100000:2.0:1790740346.226662:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc867d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+12:11143:x1877727000953856:12345-192.168.204.3@tcp:101:bash.0 Request processed in 1731us (2948us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740346.226746:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 48 00000100:00100000:0.0:1790740346.231756:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740346.232260:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000954112 00000100:00100000:1.0:1790740346.232272:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000954112 00000100:00100000:1.0:1790740346.232338:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 49 00000100:00100000:1.0:1790740346.232349:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+12:11143:x1877727000954112:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:1.0:1790740346.232387:0:13222:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740346.232410:0:13222:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92debb lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23c6f expref: -99 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.232516:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92dec2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.232615:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92dec2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.232628:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92dec2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.232828:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92dec9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.232838:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92dec9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.232846:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92dec9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790740346.233809:0:13222:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:1.0:1790740346.235188:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44200/0xb25dda4f4e92ded0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.235209:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44200/0xb25dda4f4e92ded0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.235327:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44200/0xb25dda4f4e92ded0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.235391:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92dec2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.235399:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92dec2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.235406:0:13222:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92dec2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.235412:0:13222:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc45000 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740346.235416:0:13222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92dec2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.235423:0:13222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92dec2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.235435:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98dcaec70300) 00010000:00010000:1.0:1790740346.235439:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740346.235442:0:13222:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92dec2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.235449:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92dec2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790740346.235464:0:13222:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004800693f reply state 000000007481a3a1 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92dec9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.235473:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92dec9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.235479:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98dcaec70d00) 00010000:00010000:1.0:1790740346.235486:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790740346.235490:0:13222:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790740346.235528:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92debb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c6f expref: 15 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.235543:0:13222:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44200/0xb25dda4f4e92ded0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c6f expref: 14 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.235550:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaec70700) 00010000:00010000:1.0:1790740346.235552:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790740346.235554:0:13222:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcbfc44200, rc 0) 00000100:00100000:1.0:1790740346.238202:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+15:11143:x1877727000954112:12345-192.168.204.3@tcp:101:bash.0 Request processed in 5843us (6445us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1790740346.238272:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 49 00000100:00100000:1.0:1790740346.248558:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740346.250284:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000954240 00000100:00100000:2.0:1790740346.250298:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000954240 00000100:00100000:2.0:1790740346.250357:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 28 00000100:00100000:2.0:1790740346.250366:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2401:x1877727000954240:12345-192.168.204.3@tcp:8:bash.0 00010000:00080000:2.0:1790740346.250403:0:8453:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 7bed19f2-4c98-4684-89e7-a6871565665d@192.168.204.3@tcp t0 exp 0000000000000000 cur 417 last 0 00000020:00000080:2.0:1790740346.250434:0:8453:0:(genops.c:1384:class_connect()) connect: client 7bed19f2-4c98-4684-89e7-a6871565665d, cookie 0xb25dda4f4e92dede 00002000:00100000:2.0:1790740346.250445:0:8453:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7bed19f2-4c98-4684-89e7-a6871565665d/ffff98db83e05800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790740346.250462:0:8453:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790740346.250534:0:8453:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790740346.250566:0:8453:0:(import.c:65:import_set_state_nolock()) ffff98db83e04000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790740346.250643:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bed19f2-4c98-4684-89e7-a6871565665d+6:2401:x1877727000954240:12345-192.168.204.3@tcp:8:bash.0 Request processed in 276us (2095us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740346.250650:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 28 00000100:00100000:3.0:1790740346.252571:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740346.252673:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000954368 00000100:00100000:2.0:1790740346.252682:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000954368 00000100:00100000:2.0:1790740346.252792:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 29 00000100:00100000:2.0:1790740346.252802:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc867d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bed19f2-4c98-4684-89e7-a6871565665d+6:0:x1877727000954368:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:2.0:1790740346.252820:0:8451:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740346.252862:0:8451:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cbcd9a72/0xb25dda4f4e92dee5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23c76 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790740346.252887:0:8451:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790740346.252904:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=417s v=(0 0) 00010000:00010000:2.0:1790740346.252908:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740346.252917:0:8451:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbcd9a72/0xb25dda4f4e92dee5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c76 expref: 7 pid: 8451 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.252936:0:8451:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cbcd9a72/0xb25dda4f4e92dee5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c76 expref: 7 pid: 8451 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.252949:0:8451:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f32200, rc 0) 00000100:00100000:2.0:1790740346.253025:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc867d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bed19f2-4c98-4684-89e7-a6871565665d+7:0:x1877727000954368:12345-192.168.204.3@tcp:101:bash.0 Request processed in 225us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740346.253076:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 29 00000100:00080000:3.0:1790740346.256960:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790740346.270307:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740346.271000:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000954496 00000100:00100000:2.0:1790740346.271012:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000954496 00000100:00100000:2.0:1790740346.271107:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 380 00000100:00100000:2.0:1790740346.271118:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:2405:x1877727000954496:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1790740346.271198:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:2405:x1877727000954496:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 83us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740346.271206:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 380 00000100:00100000:0.0:1790740346.271969:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740346.272058:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740346.272074:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000954752 00000100:00100000:1.0:1790740346.272081:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000954752 00000100:00100000:0.0:1790740346.272089:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740346.272125:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000954624 00000100:00100000:1.0:1790740346.272128:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000954624 00000100:00100000:0.0:1790740346.272134:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000954880 00000100:00100000:0.0:1790740346.272137:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000954880 00000100:00100000:1.0:1790740346.272153:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 280 00000100:00100000:0.0:1790740346.272157:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 281 00000100:00100000:1.0:1790740346.272160:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2405:x1877727000954752:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1790740346.272162:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+5:2405:x1877727000954624:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1790740346.272204:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+5:2405:x1877727000954624:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 41us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740346.272210:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 281 00000100:00100000:0.0:1790740346.272224:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 282 00000100:00100000:0.0:1790740346.272230:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2405:x1877727000954880:12345-192.168.204.3@tcp:400:kworker.0 00000100:00080000:3.0:1790740346.272287:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790740346.272291:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790740346.274619:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2405:x1877727000954752:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 2448us (2641us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740346.274633:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 280 00000100:00100000:0.0:1790740346.274750:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2405:x1877727000954880:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 2517us (2657us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740346.274758:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 282 00000100:00100000:3.0:1790740346.275664:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740346.275823:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000955008 00000100:00100000:1.0:1790740346.275832:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000955008 00000100:00100000:1.0:1790740346.276594:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 30 00000100:00100000:1.0:1790740346.276610:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc867d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bed19f2-4c98-4684-89e7-a6871565665d+7:11143:x1877727000955008:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:1.0:1790740346.276646:0:8453:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740346.276669:0:8453:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092e4a354/0xb25dda4f4e92deec lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23c7d expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.276703:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cbcd9a72/0xb25dda4f4e92dee5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c76 expref: 8 pid: 8451 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.276712:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790740346.276717:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790740346.276722:0:8453:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092e4a354/0xb25dda4f4e92deec lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c7d expref: 8 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.276765:0:8453:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cbcd9a72/0xb25dda4f4e92dee5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c76 expref: 8 pid: 8451 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.276779:0:8453:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cbcd9a72/0xb25dda4f4e92dee5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c76 expref: 8 pid: 8451 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740346.276793:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5fd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8453:1877727022021120:192.168.204.3@tcp:104: 00000100:00100000:1.0:1790740346.276875:0:8453:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83eff840 going to sleep for 11 seconds 00000100:00100000:0.0:1790740346.286757:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740346.286853:0:6520:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000955136 00000100:00100000:3.0:1790740346.286864:0:6520:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000955136 00010000:00010000:3.0:1790740346.286913:0:6520:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cbcd9a72/0xb25dda4f4e92dee5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c76 expref: 9 pid: 8451 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740346.287100:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 52 00000100:00100000:3.0:1790740346.287112:0:6520:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc86ac2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7bed19f2-4c98-4684-89e7-a6871565665d+9:2402:x1877727000955136:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790740346.287129:0:6520:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740346.287151:0:6520:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cbcd9a72/0xb25dda4f4e92dee5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c76 expref: 9 pid: 8451 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.287166:0:6520:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cbcd9a72/0xb25dda4f4e92dee5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c76 expref: 9 pid: 8451 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.287216:0:6520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790740346.287221:0:6520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790740346.287230:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000092e4a354/0xb25dda4f4e92deec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c7d expref: 9 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.287241:0:6520:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092e4a354/0xb25dda4f4e92deec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c7d expref: 9 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.287282:0:6520:0:(ldlm_lockd.c:1085:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000092e4a354/0xb25dda4f4e92deec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c7d expref: 9 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740346.287297:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc867d4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6520:1877727022021248:192.168.204.3@tcp:105: 00000100:00100000:3.0:1790740346.287386:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcad272600 going to sleep for 11 seconds 00010000:00010000:1.0:1790740346.288936:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cbcd9a72/0xb25dda4f4e92dee5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c76 expref: 9 pid: 8451 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740346.288961:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5fd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8453:1877727022021120:192.168.204.3@tcp:104: 00010000:00010000:1.0:1790740346.289001:0:8453:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000092e4a354/0xb25dda4f4e92deec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c7d expref: 8 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.289363:0:8453:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcbfc45000, rc 0) 00000100:00100000:1.0:1790740346.289478:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc867d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bed19f2-4c98-4684-89e7-a6871565665d+8:11143:x1877727000955008:12345-192.168.204.3@tcp:101:bash.0 Request processed in 12872us (13816us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740346.289488:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 30 00000100:00100000:1.0:1790740346.294800:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc867d4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6520:1877727022021248:192.168.204.3@tcp:105: 00010000:00010000:1.0:1790740346.294829:0:6520:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740346.294892:0:6520:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc86ac2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7bed19f2-4c98-4684-89e7-a6871565665d+7:2402:x1877727000955136:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 7781us (8148us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740346.294903:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 52 00000100:00100000:0.0:1790740346.300495:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740346.300726:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000955392 00000100:00100000:2.0:1790740346.300736:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000955392 00000100:00100000:2.0:1790740346.300827:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 6 00000100:00100000:2.0:1790740346.300837:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+15:11143:x1877727000955392:12345-192.168.204.3@tcp:35:bash.0 00000100:00100000:2.0:1790740346.301454:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+16:11143:x1877727000955392:12345-192.168.204.3@tcp:35:bash.0 Request processed in 616us (966us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1790740346.301463:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 6 00010000:00010000:1.0:1790740346.346379:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740346.398252:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740346.398437:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000955648 00000100:00100000:2.0:1790740346.398447:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000955648 00000100:00100000:2.0:1790740346.398518:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 50 00000100:00100000:2.0:1790740346.398528:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc867d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+16:11153:x1877727000955648:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:2.0:1790740346.398554:0:6537:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740346.398574:0:6537:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33400/0xb25dda4f4e92def3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23c84 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740346.398670:0:6537:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1790740346.398773:0:6537:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33400/0xb25dda4f4e92def3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c84 expref: 18 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.398787:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98dcaf045a00) 00010000:00010000:2.0:1790740346.398790:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790740346.398795:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33400/0xb25dda4f4e92def3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c84 expref: 18 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.398810:0:6537:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f33400, rc 0) 00000100:00100000:2.0:1790740346.398990:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc867d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+17:11153:x1877727000955648:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 463us (747us total) trans 4294967315 rc 301/301 00000100:00100000:2.0:1790740346.398998:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 50 00000100:00100000:0.0:1790740346.404671:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740346.408063:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000955904 00000100:00100000:1.0:1790740346.408079:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000955904 00000100:00100000:1.0:1790740346.408147:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 7 00000100:00100000:1.0:1790740346.408158:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+17:11153:x1877727000955904:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:1.0:1790740346.408530:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+18:11153:x1877727000955904:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 243us (3737us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1790740346.408540:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 7 00000100:00100000:0.0:1790740346.475391:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc867d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022021376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790740346.475478:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740346.475571:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022021376 00000100:00100000:0.0:1790740346.475579:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022021376 00000100:00100000:0.0:1790740346.475639:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1790740346.475648:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727022021376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790740346.475670:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790740346.475714:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727022021376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740346.475739:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:0.0:1790740346.475763:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790740346.475823:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc867d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022021376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790740346.476272:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83c50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877727022021760:0@lo:400:kworker.0 00000100:00100000:2.0:1790740346.476309:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740346.476339:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83f11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1877727022022272:0@lo:400:kworker.0 00000100:00100000:2.0:1790740346.476377:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740346.476420:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc81325180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1877727022022784:0@lo:400:kworker.0 00000100:00100000:2.0:1790740346.476442:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740346.476462:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1790740346.476467:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3639:1877727022021632:0@lo:400:kworker.0 00000100:00100000:2.0:1790740346.476493:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740346.476509:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83f11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022022144:0@lo:400:kworker.0 00000100:00100000:2.0:1790740346.476532:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740346.476551:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc81326d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022022656:0@lo:400:kworker.0 00000100:00100000:2.0:1790740346.476572:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740346.476600:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022022144 00000100:00100000:2.0:1790740346.476604:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022022144 00000100:00100000:2.0:1790740346.476633:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1790740346.476640:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc884b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022022144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740346.476690:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc884b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022022144:12345-0@lo:400:kworker.0 Request processed in 50us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740346.476696:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1790740346.476716:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022022656 00000100:00100000:2.0:1790740346.476719:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022022656 00000100:00100000:2.0:1790740346.476745:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1790740346.476751:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc884b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022022656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740346.476780:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc884b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022022656:12345-0@lo:400:kworker.0 Request processed in 30us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740346.476786:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1790740346.476801:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022021760 00000100:00100000:2.0:1790740346.476811:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022021760 00000100:00100000:2.0:1790740346.476834:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022022272 00000100:00100000:2.0:1790740346.476837:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022022272 00000100:00100000:2.0:1790740346.476854:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022022784 00000100:00100000:2.0:1790740346.476856:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022022784 00000100:00100000:2.0:1790740346.476871:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1790740346.476877:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc81326300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877727022021760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740346.477174:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022021632 00000100:00100000:3.0:1790740346.477179:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022021632 00000100:00100000:3.0:1790740346.477210:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1790740346.477217:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3639:x1877727022021632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740346.477311:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc867d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022021504:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1790740346.477416:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790740346.477421:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790740346.477432:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83f12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022021888:0@lo:400:kworker.0 00000100:00100000:3.0:1790740346.481160:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3639:x1877727022021632:12345-0@lo:400:kworker.0 Request processed in 3933us (4655us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740346.481176:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1790740346.481249:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1790740346.481264:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc884b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1877727022022272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740346.481316:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc884b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1877727022022272:12345-0@lo:400:kworker.0 Request processed in 58us (4938us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740346.481336:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1790740346.481356:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1790740346.481363:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc884b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1877727022022784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740346.481394:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc884b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1877727022022784:12345-0@lo:400:kworker.0 Request processed in 32us (4951us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740346.482149:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1790740346.482240:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3639:1877727022021632:0@lo:400:kworker.0 00000100:00100000:3.0:1790740346.482259:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83f11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022022144:0@lo:400:kworker.0 00000100:00100000:3.0:1790740346.482272:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc81326d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022022656:0@lo:400:kworker.0 00000100:00100000:3.0:1790740346.482283:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83f11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1877727022022272:0@lo:400:kworker.0 00000100:00100000:3.0:1790740346.482292:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc81325180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1877727022022784:0@lo:400:kworker.0 00000100:00100000:1.0:1790740346.483086:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740346.483138:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83f10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877727022022016:0@lo:400:kworker.0 00000100:00100000:1.0:1790740346.483169:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740346.483193:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc81326680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022022528:0@lo:400:kworker.0 00000100:00100000:1.0:1790740346.483218:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740346.483251:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc81324000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022023040:0@lo:400:kworker.0 00000100:00100000:1.0:1790740346.483274:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740346.483347:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022022528 00000100:00100000:1.0:1790740346.483356:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022022528 00000100:00100000:1.0:1790740346.483421:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022023040 00000100:00100000:1.0:1790740346.483425:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022023040 00000100:00100000:1.0:1790740346.483451:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1790740346.483459:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022022528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740346.483508:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022022528:12345-0@lo:400:kworker.0 Request processed in 50us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740346.483514:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1790740346.483530:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1790740346.483536:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022023040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740346.483566:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022023040:12345-0@lo:400:kworker.0 Request processed in 31us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740346.483571:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:1.0:1790740346.483591:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790740346.483595:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790740346.483602:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022022016 00000100:00100000:1.0:1790740346.483606:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022022016 00000100:00100000:1.0:1790740346.483628:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1790740346.483635:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877727022022016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740346.483663:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877727022022016:12345-0@lo:400:kworker.0 Request processed in 29us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740346.483669:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1790740346.483706:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83f10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877727022022016:0@lo:400:kworker.0 00000100:00100000:1.0:1790740346.483718:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc81326680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022022528:0@lo:400:kworker.0 00000100:00100000:3.0:1790740346.483800:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022021504 00000100:00100000:3.0:1790740346.483804:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022021504 00000100:00100000:3.0:1790740346.483838:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1790740346.483845:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022021504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790740346.483860:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790740346.483998:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022021504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 153us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740346.484005:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1790740346.484225:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc81324000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022023040:0@lo:400:kworker.0 00000100:00100000:1.0:1790740346.484294:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc867d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022021504:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790740346.487268:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc81326300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877727022021760:12345-0@lo:400:kworker.0 Request processed in 10378us (10945us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740346.487284:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1790740346.487437:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740346.487481:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc81325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1877727022022400:0@lo:400:kworker.0 00000100:00100000:0.0:1790740346.487513:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740346.487596:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc81324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1877727022022912:0@lo:400:kworker.0 00000100:00100000:0.0:1790740346.487641:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740346.487685:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022021888 00000100:00100000:2.0:1790740346.487692:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022021888 00000100:00100000:2.0:1790740346.487731:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1790740346.487739:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022021888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740346.487788:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022021888:12345-0@lo:400:kworker.0 Request processed in 50us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740346.487795:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1790740346.488261:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83c50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877727022021760:0@lo:400:kworker.0 00000100:00100000:0.0:1790740346.488364:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83f12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022021888:0@lo:400:kworker.0 00000100:00100000:2.0:1790740346.488463:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022022400 00000100:00100000:2.0:1790740346.488468:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022022400 00000100:00100000:2.0:1790740346.488518:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022022912 00000100:00100000:2.0:1790740346.488521:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022022912 00000100:00100000:2.0:1790740346.488542:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1790740346.488548:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877727022022400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740346.488586:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877727022022400:12345-0@lo:400:kworker.0 Request processed in 38us (1073us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740346.488592:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1790740346.488602:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1790740346.488607:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877727022022912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740346.488643:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877727022022912:12345-0@lo:400:kworker.0 Request processed in 36us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740346.488649:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00080000:0.0:1790740346.488721:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1790740346.488745:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dc81325500 x1877727022022400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740346.488757:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc81325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1877727022022400:0@lo:400:kworker.0 00010000:00080000:0.0:1790740346.488769:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dc81324700 x1877727022022912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740346.488777:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc81324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1877727022022912:0@lo:400:kworker.0 00000100:00100000:0.0:1790740346.543832:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740346.544219:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000956032 00000100:00100000:2.0:1790740346.544231:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000956032 00000100:00100000:2.0:1790740346.544302:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 51 00000100:00100000:2.0:1790740346.544313:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+18:11159:x1877727000956032:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:2.0:1790740346.544340:0:6535:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740346.544361:0:6535:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33400/0xb25dda4f4e92df01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23c8b expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.544425:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92df08 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.544440:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92df08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.544452:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92df08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740346.544492:0:6535:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1790740346.544497:0:6535:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790740346.544515:0:6535:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92df08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.544540:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33400/0xb25dda4f4e92df01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c8b expref: 20 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.544560:0:6535:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92df08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c8b expref: 19 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.544583:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98dcaec70300) 00010000:00010000:2.0:1790740346.544586:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790740346.544590:0:6535:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f32e00, rc 0) 00000100:00100000:2.0:1790740346.545789:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+19:11159:x1877727000956032:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 1469us (1957us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740346.545799:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 51 00000100:00100000:3.0:1790740346.583997:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740346.584461:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000956288 00000100:00100000:2.0:1790740346.584484:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000956288 00000100:00100000:2.0:1790740346.584550:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 52 00000100:00100000:2.0:1790740346.584559:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc867d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+19:11159:x1877727000956288:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:2.0:1790740346.584579:0:7760:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740346.584599:0:7760:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33400/0xb25dda4f4e92df0f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23c92 expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.584712:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92df16 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.584727:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92df16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.584738:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92df16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740346.584750:0:7760:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1790740346.584866:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33400/0xb25dda4f4e92df0f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c92 expref: 22 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.584906:0:7760:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92df16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c92 expref: 21 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.584915:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaec70700) 00010000:00010000:2.0:1790740346.584918:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790740346.584921:0:7760:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f32400, rc 0) 00000100:00100000:2.0:1790740346.584998:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc867d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+21:11159:x1877727000956288:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 439us (1023us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1790740346.585004:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 52 00000100:00100000:0.0:1790740346.589127:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740346.589167:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740346.589404:0:9550:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000956672 00000100:00100000:1.0:1790740346.589415:0:9550:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000956672 00000100:00100000:1.0:1790740346.589484:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 3 00000100:00100000:1.0:1790740346.589494:0:9550:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7bed19f2-4c98-4684-89e7-a6871565665d+21:2405:x1877727000956672:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740346.589512:0:9550:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740346.589537:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92df16 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c92 expref: 21 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.589559:0:9550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaec70700) 00010000:00010000:1.0:1790740346.589564:0:9550:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740346.589622:0:9550:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7bed19f2-4c98-4684-89e7-a6871565665d+20:2405:x1877727000956672:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 129us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740346.589630:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 3 00000100:00100000:3.0:1790740346.589783:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000956544 00000100:00100000:3.0:1790740346.589800:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000956544 00000100:00100000:3.0:1790740346.589833:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 53 00000100:00100000:3.0:1790740346.589840:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+20:11159:x1877727000956544:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:3.0:1790740346.589859:0:13222:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740346.589873:0:13222:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92df24 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23c99 expref: -99 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.589983:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9000/0xb25dda4f4e92df2b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.589997:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9000/0xb25dda4f4e92df2b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.590006:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9000/0xb25dda4f4e92df2b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740346.590017:0:13222:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1790740346.590158:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92df24 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c99 expref: 23 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.590174:0:13222:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9000/0xb25dda4f4e92df2b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c99 expref: 22 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.590181:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaec70700) 00010000:00010000:3.0:1790740346.590183:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1790740346.590185:0:13222:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc9000, rc 0) 00000100:00100000:3.0:1790740346.590211:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+22:11159:x1877727000956544:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 372us (1095us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1790740346.590217:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 53 00000100:00100000:0.0:1790740346.608390:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740346.608580:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000956800 00000100:00100000:1.0:1790740346.608589:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000956800 00000100:00100000:1.0:1790740346.608684:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 31 00000100:00100000:1.0:1790740346.608696:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bed19f2-4c98-4684-89e7-a6871565665d+7:2403:x1877727000956800:12345-192.168.204.3@tcp:1:lfs.0 00010000:00010000:1.0:1790740346.608746:0:8454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008de866e5/0xb25dda4f4e92df39 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.608767:0:8454:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000092e4a354/0xb25dda4f4e92deec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c7d expref: 7 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.608790:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790740346.608795:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790740346.608801:0:8454:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008de866e5/0xb25dda4f4e92df39 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.608838:0:8454:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000092e4a354/0xb25dda4f4e92deec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c7d expref: 7 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.608853:0:8454:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000092e4a354/0xb25dda4f4e92deec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c7d expref: 7 pid: 8453 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740346.608882:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84495880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8454:1877727022023168:192.168.204.3@tcp:104: 00000100:00100000:1.0:1790740346.609002:0:8454:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83effe40 going to sleep for 11 seconds 00000100:00100000:2.0:1790740346.613644:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740346.613745:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000956928 00000100:00100000:3.0:1790740346.613754:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000956928 00002000:00100000:3.0:1790740346.613811:0:8457:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff98dc884b1f80 x1877727000956928/t0(0) o4->7bed19f2-4c98-4684-89e7-a6871565665d@192.168.204.3@tcp:402/0 lens 504/0 e 0 to 0 dl 1790740357 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790740346.613822:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98dc884b1f80 with x1877727000956928 ext(0->12) 00010000:00010000:3.0:1790740346.613832:0:8457:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000092e4a354/0xb25dda4f4e92deec lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c7d expref: 8 pid: 8453 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.613849:0:8457:0:(ldlm_lockd.c:610:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000092e4a354/0xb25dda4f4e92deec lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c7d expref: 8 pid: 8453 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790740346.613866:0:8457:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98dc884b1f80 00000100:00100000:3.0:1790740346.613899:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 0 00000100:00100000:3.0:1790740346.613908:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc884b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7bed19f2-4c98-4684-89e7-a6871565665d+8:2402:x1877727000956928:12345-192.168.204.3@tcp:4:lfs.0 00000001:00100000:2.0:1790740346.615991:0:9531:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7bed19f2-4c98-4684-89e7-a6871565665d 00000100:00100000:3.0:1790740346.617534:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc884b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7bed19f2-4c98-4684-89e7-a6871565665d+9:2402:x1877727000956928:12345-192.168.204.3@tcp:4:lfs.0 Request processed in 3616us (3890us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1790740346.617549:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 0 00002000:00100000:3.0:1790740346.617562:0:8457:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff98dc884b1f80 x1877727000956928/t4294967300(0) o4->7bed19f2-4c98-4684-89e7-a6871565665d@192.168.204.3@tcp:402/0 lens 504/448 e 0 to 0 dl 1790740357 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790740346.617574:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98dc884b1f80 with x1877727000956928 ext(0->12) 00010000:00010000:3.0:1790740346.617585:0:8457:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000092e4a354/0xb25dda4f4e92deec lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c7d expref: 9 pid: 8453 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.617606:0:8457:0:(ldlm_lockd.c:610:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000092e4a354/0xb25dda4f4e92deec lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c7d expref: 9 pid: 8453 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790740346.617632:0:8457:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98dc884b1f80 00000100:00100000:1.0:1790740346.619430:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84495880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8454:1877727022023168:192.168.204.3@tcp:104: 00010000:00010000:1.0:1790740346.619459:0:8454:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008de866e5/0xb25dda4f4e92df39 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740346.624003:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740346.624313:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000957056 00000100:00100000:2.0:1790740346.624324:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000957056 00010000:00010000:2.0:1790740346.624367:0:6521:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000092e4a354/0xb25dda4f4e92deec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c7d expref: 9 pid: 8453 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740346.624526:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 53 00000100:00100000:2.0:1790740346.624538:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc867d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7bed19f2-4c98-4684-89e7-a6871565665d+9:2403:x1877727000957056:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790740346.624553:0:6521:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1790740346.624570:0:6521:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1790740346.624572:0:6521:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1790740346 00002000:00010000:2.0:1790740346.624574:0:6521:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1790740346 00002000:00010000:2.0:1790740346.624577:0:6521:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1790740346 00002000:00010000:2.0:1790740346.624579:0:6521:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1790740346.624585:0:6521:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000092e4a354/0xb25dda4f4e92deec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c7d expref: 9 pid: 8453 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.624614:0:6521:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000092e4a354/0xb25dda4f4e92deec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c7d expref: 9 pid: 8453 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.624637:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092e4a354/0xb25dda4f4e92deec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c7d expref: 9 pid: 8453 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.624657:0:6521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790740346.624662:0:6521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790740346.624668:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008de866e5/0xb25dda4f4e92df39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.624679:0:6521:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008de866e5/0xb25dda4f4e92df39 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.624715:0:6521:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740346.624776:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc867d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7bed19f2-4c98-4684-89e7-a6871565665d+8:2403:x1877727000957056:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 242us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740346.624784:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 53 00010000:00010000:3.0:1790740346.625347:0:8454:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008de866e5/0xb25dda4f4e92df39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.625360:0:8454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008de866e5/0xb25dda4f4e92df39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.625383:0:8454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008de866e5/0xb25dda4f4e92df39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.625393:0:8454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008de866e5/0xb25dda4f4e92df39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.625414:0:8454:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008de866e5/0xb25dda4f4e92df39 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.625422:0:8454:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc44000 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:3.0:1790740346.625427:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008de866e5/0xb25dda4f4e92df39 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.625436:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008de866e5/0xb25dda4f4e92df39 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.625450:0:8454:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008de866e5/0xb25dda4f4e92df39 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.625467:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008de866e5/0xb25dda4f4e92df39 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740346.625536:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bed19f2-4c98-4684-89e7-a6871565665d+7:2403:x1877727000956800:12345-192.168.204.3@tcp:1:lfs.0 Request processed in 16842us (17156us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740346.625545:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 31 00000100:00100000:3.0:1790740346.628945:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740346.629079:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000957312 00000100:00100000:0.0:1790740346.629089:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000957312 00000100:00100000:0.0:1790740346.629143:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 8 00000100:00100000:0.0:1790740346.629153:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc867d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+22:11159:x1877727000957312:12345-192.168.204.3@tcp:35:lfs.0 00000004:00010000:0.0:1790740346.629217:0:6538:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9000/0xb25dda4f4e92df2b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c99 expref: 22 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790740346.629583:0:6538:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:0.0:1790740346.629622:0:6538:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1790740346.629896:0:6538:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:0.0:1790740346.629935:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060200/0xb25dda4f4e92df40 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740346.629950:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44200/0xb25dda4f4e92ded0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c6f expref: 26 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740346.629959:0:6538:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060200/0xb25dda4f4e92df40 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740346.630003:0:6538:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44200/0xb25dda4f4e92ded0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c6f expref: 26 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740346.630017:0:6538:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44200/0xb25dda4f4e92ded0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c6f expref: 26 pid: 13222 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740346.630256:0:6538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfc2ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6538:1877727022023296:192.168.204.3@tcp:104: 00000100:00100000:0.0:1790740346.630518:0:6538:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83d05e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790740346.637800:0:6538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfc2ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6538:1877727022023296:192.168.204.3@tcp:104: 00010000:00010000:2.0:1790740346.637835:0:6538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060200/0xb25dda4f4e92df40 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740346.643431:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740346.643527:0:6520:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000957440 00000100:00100000:1.0:1790740346.643537:0:6520:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000957440 00010000:00010000:1.0:1790740346.643588:0:6520:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44200/0xb25dda4f4e92ded0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c6f expref: 27 pid: 13222 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740346.643624:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 54 00000100:00100000:1.0:1790740346.643636:0:6520:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7bed19f2-4c98-4684-89e7-a6871565665d+27:2402:x1877727000957440:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740346.643683:0:6520:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740346.643691:0:6520:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44200/0xb25dda4f4e92ded0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c6f expref: 27 pid: 13222 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.643705:0:6520:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44200/0xb25dda4f4e92ded0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c6f expref: 27 pid: 13222 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.643727:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44200/0xb25dda4f4e92ded0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c6f expref: 27 pid: 13222 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.643743:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaec70700) 00010000:00010000:1.0:1790740346.643749:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060200/0xb25dda4f4e92df40 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.643758:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060200/0xb25dda4f4e92df40 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.643766:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060200/0xb25dda4f4e92df40 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.643797:0:6520:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740346.643855:0:6520:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7bed19f2-4c98-4684-89e7-a6871565665d+26:2402:x1877727000957440:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 221us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740346.643863:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 54 00010000:00010000:2.0:1790740346.643989:0:6538:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060200/0xb25dda4f4e92df40 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.643998:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060200/0xb25dda4f4e92df40 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790740346.644160:0:6538:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:2.0:1790740346.644273:0:6538:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:2.0:1790740346.644379:0:6538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc884b0e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6538:1877727022023424:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1790740346.644445:0:6538:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740346.644473:0:6538:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5c9c300 going to sleep for 11 seconds 00000100:00100000:1.0:1790740346.644714:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022023424 00000100:00100000:1.0:1790740346.644720:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022023424 00000100:00100000:1.0:1790740346.644762:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1790740346.644771:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc884b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6538:x1877727022023424:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1790740346.644858:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc884b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6538:x1877727022023424:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 88us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740346.644871:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1790740346.645091:0:6538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc884b0e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6538:1877727022023424:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1790740346.645242:0:6538:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:1.0:1790740346.645288:0:6538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84495880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6538:1877727022023552:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1790740346.645319:0:6538:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740346.645337:0:6538:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc99123600 going to sleep for 11 seconds 00000100:00100000:1.0:1790740346.645351:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022023552 00000100:00100000:1.0:1790740346.645355:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022023552 00000100:00100000:1.0:1790740346.645378:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1790740346.645385:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaefdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6538:x1877727022023552:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1790740346.645516:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaefdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6538:x1877727022023552:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 131us (196us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1790740346.645523:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1790740346.645553:0:6538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84495880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6538:1877727022023552:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1790740346.645584:0:6538:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:1.0:1790740346.645615:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060200/0xb25dda4f4e92df40 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.645626:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060200/0xb25dda4f4e92df40 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.645634:0:6538:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060200/0xb25dda4f4e92df40 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.645642:0:6538:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf060200 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740346.645647:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060200/0xb25dda4f4e92df40 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.645667:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060200/0xb25dda4f4e92df40 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.645681:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaec70700) 00010000:00010000:1.0:1790740346.645684:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1790740346.645689:0:6538:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060200/0xb25dda4f4e92df40 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.645696:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060200/0xb25dda4f4e92df40 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790740346.645784:0:6538:0:(mdd_object.c:4180:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1790740346.645842:0:6538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1790740346.645853:0:6538:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 417931820889ns, next at 418931819239ns, rc = 0 00000001:00080000:1.0:1790740346.645858:0:6538:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:1.0:1790740346.645898:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaec70700) 00010000:00010000:1.0:1790740346.645901:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1790740346.645908:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9000/0xb25dda4f4e92df2b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c99 expref: 30 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740346.645998:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc867d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+29:11159:x1877727000957312:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 16846us (17063us total) trans 4294967327 rc 0/0 00000100:00100000:1.0:1790740346.646006:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 8 00000020:00080000:1.0:1790740346.646009:0:6538:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1790740346.649596:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740346.649682:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000957568 00000100:00100000:2.0:1790740346.649692:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000957568 00000100:00100000:2.0:1790740346.649786:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 54 00000100:00100000:2.0:1790740346.649797:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc867d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+29:11159:x1877727000957568:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:2.0:1790740346.649821:0:6535:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740346.649845:0:6535:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33400/0xb25dda4f4e92df47 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23ca0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.649911:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33400/0xb25dda4f4e92df47 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ca0 expref: 30 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.649926:0:6535:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33400/0xb25dda4f4e92df47 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ca0 expref: 30 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.649946:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf045700) 00010000:00010000:2.0:1790740346.649950:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790740346.649953:0:6535:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f33400, rc 0) 00000100:00100000:2.0:1790740346.650055:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc867d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+30:11159:x1877727000957568:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 233us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740346.650063:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 54 00000100:00100000:0.0:1790740346.655422:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740346.655674:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000957824 00000100:00100000:1.0:1790740346.655684:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000957824 00000100:00100000:1.0:1790740346.655747:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 9 00000100:00100000:1.0:1790740346.655758:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c81050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+30:11159:x1877727000957824:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:1.0:1790740346.656213:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c81050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+31:11159:x1877727000957824:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 455us (809us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1790740346.656221:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 9 00000040:00080000:0.0:1790740346.666694:0:13821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1790740346.673522:0:13823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1790740346.762860:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740346.763162:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000958080 00000100:00100000:1.0:1790740346.763171:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000958080 00000100:00100000:1.0:1790740346.763234:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 55 00000100:00100000:1.0:1790740346.763244:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+31:11169:x1877727000958080:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:1.0:1790740346.763273:0:6537:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740346.763293:0:6537:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44200/0xb25dda4f4e92df4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23ca7 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740346.763431:0:6537:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1790740346.763529:0:6537:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44200/0xb25dda4f4e92df4e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ca7 expref: 33 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.763544:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98dcaf045a00) 00010000:00010000:1.0:1790740346.763547:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790740346.763553:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44200/0xb25dda4f4e92df4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ca7 expref: 33 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740346.763568:0:6537:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcbfc44200, rc 0) 00000100:00100000:1.0:1790740346.763632:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+32:11169:x1877727000958080:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 390us (781us total) trans 4294967329 rc 301/301 00000100:00100000:1.0:1790740346.763640:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 55 00000100:00100000:2.0:1790740346.767909:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740346.768186:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000958208 00000100:00100000:3.0:1790740346.768196:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000958208 00000100:00100000:3.0:1790740346.768245:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 56 00000100:00100000:3.0:1790740346.768254:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc884b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+32:11169:x1877727000958208:12345-192.168.204.3@tcp:34:lfs.0 00010000:00010000:3.0:1790740346.768325:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92df5c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.768341:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92df5c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.768355:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92df5c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.768365:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9000/0xb25dda4f4e92df63 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.768371:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9000/0xb25dda4f4e92df63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.768388:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9000/0xb25dda4f4e92df63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.768470:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92df6a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.768477:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92df6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.768484:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92df6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790740346.768527:0:6536:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92df6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.768538:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92df5c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.768544:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92df5c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.768551:0:6536:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92df5c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.768557:0:6536:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc9e00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740346.768560:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92df5c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.768567:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92df5c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.768577:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98dcaec70300) 00010000:00010000:3.0:1790740346.768585:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740346.768589:0:6536:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92df5c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.768596:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92df5c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.768608:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9000/0xb25dda4f4e92df63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.768614:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9000/0xb25dda4f4e92df63 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.768620:0:6536:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9000/0xb25dda4f4e92df63 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.768624:0:6536:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc9000 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740346.768627:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9000/0xb25dda4f4e92df63 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.768633:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9000/0xb25dda4f4e92df63 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.768639:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98dcaec70d00) 00010000:00010000:3.0:1790740346.768641:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740346.768643:0:6536:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9000/0xb25dda4f4e92df63 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.768649:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9000/0xb25dda4f4e92df63 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.768656:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92df6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.768666:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92df6a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.768671:0:6536:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92df6a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.768676:0:6536:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc9400 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740346.768679:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92df6a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.768684:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92df6a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.768691:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf045700) 00010000:00010000:3.0:1790740346.768693:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740346.768695:0:6536:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92df6a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.768700:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92df6a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740346.768816:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc884b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+32:11169:x1877727000958208:12345-192.168.204.3@tcp:34:lfs.0 Request processed in 562us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740346.768823:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 56 00000100:00100000:0.0:1790740346.772183:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740346.772338:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000958464 00000100:00100000:2.0:1790740346.772349:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000958464 00000100:00100000:2.0:1790740346.772497:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 10 00000100:00100000:2.0:1790740346.772508:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+32:11169:x1877727000958464:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:2.0:1790740346.772748:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+33:11169:x1877727000958464:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 241us (572us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1790740346.772756:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 10 00000100:00100000:0.0:1790740346.818129:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740346.818338:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000958720 00000100:00100000:2.0:1790740346.818349:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000958720 00000100:00100000:2.0:1790740346.818423:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 57 00000100:00100000:2.0:1790740346.818433:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+33:11172:x1877727000958720:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:2.0:1790740346.818459:0:6535:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740346.818480:0:6535:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32a00/0xb25dda4f4e92df71 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23cae expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.818553:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92df78 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.818568:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92df78 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.818579:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92df78 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.818590:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92df7f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.818597:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92df7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.818623:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92df7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.818733:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92df86 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.818741:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92df86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.818748:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92df86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740346.818758:0:6535:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1790740346.818849:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92df78 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.818869:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92df78 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.818875:0:6535:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92df78 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.818881:0:6535:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f32c00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740346.818885:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92df78 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.818893:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92df78 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.818905:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98dcaec70300) 00010000:00010000:2.0:1790740346.818908:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740346.818921:0:6535:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92df78 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.818927:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92df78 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.818940:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92df7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.818946:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92df7f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.818951:0:6535:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92df7f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.818957:0:6535:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f33600 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740346.818960:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92df7f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.818978:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92df7f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.818987:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98dcaec70d00) 00010000:00010000:2.0:1790740346.818989:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740346.818992:0:6535:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92df7f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.818998:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92df7f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.819336:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32a00/0xb25dda4f4e92df71 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cae expref: 36 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.819363:0:6535:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92df86 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cae expref: 35 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740346.819371:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf045700) 00010000:00010000:2.0:1790740346.819373:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790740346.819376:0:6535:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f33200, rc 0) 00000100:00100000:2.0:1790740346.819452:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+35:11172:x1877727000958720:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 1020us (1335us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1790740346.819459:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 57 00000100:00100000:0.0:1790740346.824685:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740346.824799:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000958848 00000100:00100000:3.0:1790740346.824809:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000958848 00000100:00100000:3.0:1790740346.824887:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 58 00000100:00100000:3.0:1790740346.824898:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+35:11172:x1877727000958848:12345-192.168.204.3@tcp:54:lfs.0 00010000:00010000:3.0:1790740346.824981:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92df94 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.825012:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92df94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.825024:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92df94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.825105:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92df94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.825112:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92df94 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.825118:0:13222:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92df94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.825124:0:13222:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc8c00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740346.825128:0:13222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92df94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.825135:0:13222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92df94 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.825146:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf045700) 00010000:00010000:3.0:1790740346.825149:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790740346.825154:0:13222:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92df94 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740346.825160:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92df94 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740346.825234:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+35:11172:x1877727000958848:12345-192.168.204.3@tcp:54:lfs.0 Request processed in 337us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740346.825248:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 58 00000100:00100000:0.0:1790740346.830442:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740346.830585:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000959104 00000100:00100000:1.0:1790740346.830595:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000959104 00000100:00100000:1.0:1790740346.830652:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 11 00000100:00100000:1.0:1790740346.830675:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+35:11172:x1877727000959104:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:1.0:1790740346.830898:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+36:11172:x1877727000959104:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 224us (465us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1790740346.830905:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 11 00000100:00100000:0.0:1790740347.170263:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740347.170361:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000959360 00000100:00100000:1.0:1790740347.170372:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000959360 00000100:00100000:1.0:1790740347.170446:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 59 00000100:00100000:1.0:1790740347.170457:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+36:11203:x1877727000959360:12345-192.168.204.3@tcp:101:cat.0 00010000:00010000:1.0:1790740347.170481:0:7760:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740347.170502:0:7760:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44200/0xb25dda4f4e92df9b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23cb5 expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740347.170602:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44e00/0xb25dda4f4e92dfa2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740347.170617:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44e00/0xb25dda4f4e92dfa2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740347.170628:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44e00/0xb25dda4f4e92dfa2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740347.170638:0:7760:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1790740347.170790:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44200/0xb25dda4f4e92df9b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cb5 expref: 39 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740347.170812:0:7760:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44e00/0xb25dda4f4e92dfa2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cb5 expref: 38 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740347.170840:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf045700) 00010000:00010000:1.0:1790740347.170844:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790740347.170847:0:7760:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcbfc44e00, rc 0) 00000100:00100000:1.0:1790740347.170910:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+38:11203:x1877727000959360:12345-192.168.204.3@tcp:101:cat.0 Request processed in 455us (656us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1790740347.170918:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 59 00000100:00100000:0.0:1790740347.174131:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740347.174234:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000959488 00000100:00100000:2.0:1790740347.174245:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000959488 00000100:00100000:2.0:1790740347.174305:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 4 00000100:00100000:2.0:1790740347.174315:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc2a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7bed19f2-4c98-4684-89e7-a6871565665d+38:2404:x1877727000959488:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790740347.174330:0:6522:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740347.174354:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44e00/0xb25dda4f4e92dfa2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cb5 expref: 38 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740347.174373:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf045700) 00010000:00010000:2.0:1790740347.174378:0:6522:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740347.174446:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc2a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7bed19f2-4c98-4684-89e7-a6871565665d+37:2404:x1877727000959488:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 132us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740347.174455:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 4 00000100:00100000:0.0:1790740347.189469:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740347.189564:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000959744 00000100:00100000:1.0:1790740347.189573:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000959744 00000100:00100000:1.0:1790740347.189633:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 12 00000100:00100000:1.0:1790740347.189642:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+37:11203:x1877727000959744:12345-192.168.204.3@tcp:35:cat.0 00000100:00100000:1.0:1790740347.190104:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+38:11203:x1877727000959744:12345-192.168.204.3@tcp:35:cat.0 Request processed in 461us (643us total) trans 4294967334 rc 0/0 00000100:00100000:1.0:1790740347.190113:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 12 00000100:00100000:0.0:1790740347.293315:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740347.293431:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000960000 00000100:00100000:2.0:1790740347.293441:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000960000 00000100:00100000:2.0:1790740347.293500:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 60 00000100:00100000:2.0:1790740347.293510:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+38:11209:x1877727000960000:12345-192.168.204.3@tcp:101:dd.0 00010000:00010000:2.0:1790740347.293547:0:6535:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740347.293551:0:6535:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1790740347.293577:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92df08 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c8b expref: 38 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740347.293596:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98dcaec70300) 00010000:00010000:2.0:1790740347.293601:0:6535:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790740347.293614:0:6535:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32a00/0xb25dda4f4e92dfb0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23cbc expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740347.293714:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92dfb7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740347.293729:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92df86 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cae expref: 38 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740347.293738:0:6535:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92dfb7 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740347.293789:0:6535:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92df86 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cae expref: 38 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740347.293804:0:6535:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92df86 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cae expref: 38 pid: 6535 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740347.293818:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc884b0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6535:1877727022023680:192.168.204.3@tcp:104: 00000100:00100000:2.0:1790740347.293914:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5c9c300 going to sleep for 11 seconds 00000100:00100000:2.0:1790740347.306718:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc884b0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6535:1877727022023680:192.168.204.3@tcp:104: 00010000:00010000:2.0:1790740347.306766:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92dfb7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740347.310114:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740347.310328:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000960128 00000100:00100000:2.0:1790740347.310338:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000960128 00010000:00010000:2.0:1790740347.310377:0:6521:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92df86 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cae expref: 39 pid: 6535 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740347.310430:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 55 00000100:00100000:2.0:1790740347.310440:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7bed19f2-4c98-4684-89e7-a6871565665d+39:2403:x1877727000960128:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790740347.310456:0:6521:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740347.310463:0:6521:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92df86 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cae expref: 39 pid: 6535 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740347.310477:0:6521:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92df86 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cae expref: 39 pid: 6535 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740347.310499:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92df86 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cae expref: 39 pid: 6535 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740347.310516:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf045700) 00010000:00010000:2.0:1790740347.310521:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92dfb7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740347.310532:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92dfb7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740347.310541:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92dfb7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740347.310594:0:6521:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740347.310651:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7bed19f2-4c98-4684-89e7-a6871565665d+38:2403:x1877727000960128:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 212us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740347.310659:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 55 00010000:00010000:3.0:1790740347.310869:0:6535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92dfb7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740347.310878:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92dfb7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740347.310895:0:6535:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1790740347.311102:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32a00/0xb25dda4f4e92dfb0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cbc expref: 39 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740347.311118:0:6535:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92dfb7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cbc expref: 38 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740347.311125:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf045700) 00010000:00010000:3.0:1790740347.311128:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790740347.311131:0:6535:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f33600, rc 0) 00000100:00100000:3.0:1790740347.311158:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+38:11209:x1877727000960000:12345-192.168.204.3@tcp:101:dd.0 Request processed in 17650us (17853us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1790740347.311166:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 60 00000100:00100000:0.0:1790740347.329427:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740347.329570:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000960256 00000100:00100000:1.0:1790740347.329580:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000960256 00000100:00100000:1.0:1790740347.329641:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 61 00000100:00100000:1.0:1790740347.329652:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+38:11209:x1877727000960256:12345-192.168.204.3@tcp:101:dd.0 00010000:00010000:1.0:1790740347.329678:0:6536:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740347.329701:0:6536:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44200/0xb25dda4f4e92dfc5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23cc3 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740347.329738:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92dfcc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740347.329755:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92dfcc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740347.329794:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92dfcc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740347.329915:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44200/0xb25dda4f4e92dfc5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cc3 expref: 40 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740347.329935:0:6536:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92dfcc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cc3 expref: 39 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740347.329944:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf045700) 00010000:00010000:1.0:1790740347.329947:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790740347.329951:0:6536:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcbfc44800, rc 0) 00000100:00100000:1.0:1790740347.330022:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+39:11209:x1877727000960256:12345-192.168.204.3@tcp:101:dd.0 Request processed in 372us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740347.330082:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 61 00000100:00100000:0.0:1790740347.334797:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740347.334873:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000960512 00000100:00100000:3.0:1790740347.334884:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000960512 00000100:00100000:3.0:1790740347.334946:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 62 00000100:00100000:3.0:1790740347.334969:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+39:11209:x1877727000960512:12345-192.168.204.3@tcp:36:dd.0 00010000:00010000:3.0:1790740347.335216:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92dfd3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740347.335235:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92dfd3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740347.335261:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92dfd3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790740347.335306:0:6537:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:3.0:1790740347.335331:0:6537:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000551efd1b reply state 000000009e6fbfbb transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92dfd3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740347.335344:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92dfd3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740347.335352:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf045700) 00010000:00010000:3.0:1790740347.335355:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790740347.335358:0:6537:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790740347.335457:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+42:11209:x1877727000960512:12345-192.168.204.3@tcp:36:dd.0 Request processed in 501us (670us total) trans 4294967337 rc 0/0 00000100:00100000:3.0:1790740347.335465:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 62 00000020:00080000:3.0:1790740347.335470:0:6537:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790740347.370394:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740347.499292:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790740347.499317:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc867d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022023808:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790740347.499396:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740347.499678:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022023808 00000100:00100000:3.0:1790740347.499686:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022023808 00000100:00100000:3.0:1790740347.499750:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1790740347.499761:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc884b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022023808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790740347.499820:0:6540:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1790740347.499892:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc884b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022023808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 133us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740347.499901:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1790740347.500212:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc867d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022023808:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790740347.754277:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740347.754728:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000960640 00000100:00100000:2.0:1790740347.754738:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000960640 00000100:00100000:2.0:1790740347.754808:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 63 00000100:00100000:2.0:1790740347.754818:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc867d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+42:11223:x1877727000960640:12345-192.168.204.3@tcp:101:stat.0 00010000:00010000:2.0:1790740347.754843:0:6535:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740347.754863:0:6535:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92dfda lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23cca expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740347.754929:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92dfe1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740347.755377:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92dfe1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740347.755391:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92dfe1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740347.755403:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92dfe8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740347.755428:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92dfe8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740347.755436:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92dfe8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740347.755506:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92dfef lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740347.755516:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92dfb7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cbc expref: 43 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740347.755525:0:6535:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92dfef lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740347.755561:0:6535:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92dfb7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cbc expref: 43 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740347.755575:0:6535:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92dfb7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cbc expref: 43 pid: 6535 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740347.755590:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc884b0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6535:1877727022023936:192.168.204.3@tcp:104: 00000100:00100000:2.0:1790740347.755690:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5c9c300 going to sleep for 11 seconds 00000100:00100000:2.0:1790740347.761903:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc884b0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6535:1877727022023936:192.168.204.3@tcp:104: 00010000:00010000:2.0:1790740347.761934:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92dfef lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740347.763078:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740347.763482:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000960896 00000100:00100000:2.0:1790740347.763505:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000960896 00000100:00100000:2.0:1790740347.763568:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 13 00000100:00100000:2.0:1790740347.763578:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc867d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+44:6197:x1877727000960896:12345-192.168.204.3@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1790740347.764067:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc867d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+45:6197:x1877727000960896:12345-192.168.204.3@tcp:35:ldlm_bl.0 Request processed in 489us (992us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1790740347.764076:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 13 00000100:00100000:0.0:1790740347.767133:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740347.767898:0:9550:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000961024 00000100:00100000:3.0:1790740347.767918:0:9550:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000961024 00010000:00010000:3.0:1790740347.767976:0:9550:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92dfb7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cbc expref: 45 pid: 6535 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740347.768051:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 56 00000100:00100000:3.0:1790740347.768062:0:9550:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7bed19f2-4c98-4684-89e7-a6871565665d+45:2402:x1877727000961024:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790740347.768078:0:9550:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740347.768084:0:9550:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92dfb7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cbc expref: 45 pid: 6535 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740347.768098:0:9550:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92dfb7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cbc expref: 45 pid: 6535 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740347.768120:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92dfb7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cbc expref: 45 pid: 6535 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740347.768138:0:9550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf045700) 00010000:00010000:3.0:1790740347.768143:0:9550:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92dfef lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740347.768153:0:9550:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92dfef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740347.768160:0:9550:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92dfef lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740347.768205:0:9550:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740347.768268:0:9550:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7bed19f2-4c98-4684-89e7-a6871565665d+44:2402:x1877727000961024:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 208us (1142us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740347.768285:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 56 00010000:00010000:0.0:1790740347.768632:0:6535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92dfef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740347.768641:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92dfef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790740347.768695:0:6535:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1790740347.768700:0:6535:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790740347.768745:0:6535:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92dfef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740347.768759:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92dfef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740347.768769:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92dfe1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740347.768787:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92dfe1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740347.768794:0:6535:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92dfe1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740347.768801:0:6535:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f32e00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:0.0:1790740347.768805:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92dfe1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740347.768813:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92dfe1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740347.768822:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98dcaec70300) 00010000:00010000:0.0:1790740347.768824:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740347.768828:0:6535:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92dfe1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740347.768833:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92dfe1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740347.768843:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92dfe8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740347.768849:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92dfe8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740347.768855:0:6535:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92dfe8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740347.768860:0:6535:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f32c00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:0.0:1790740347.768868:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92dfe8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740347.768875:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92dfe8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740347.768884:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98dcaec70d00) 00010000:00010000:0.0:1790740347.768886:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740347.768889:0:6535:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92dfe8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740347.768894:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92dfe8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740347.768926:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92dfda lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cca expref: 44 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740347.768939:0:6535:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92dfef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cca expref: 43 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740347.768946:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf045700) 00010000:00010000:0.0:1790740347.768962:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790740347.768964:0:6535:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f32400, rc 0) 00000100:00100000:0.0:1790740347.769101:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc867d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+43:11223:x1877727000960640:12345-192.168.204.3@tcp:101:stat.0 Request processed in 14284us (14835us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740347.769109:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 63 00000100:00100000:0.0:1790740347.857508:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740347.857622:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000961280 00000100:00100000:2.0:1790740347.857633:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000961280 00000100:00100000:2.0:1790740347.857704:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 64 00000100:00100000:2.0:1790740347.857714:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+43:11229:x1877727000961280:12345-192.168.204.3@tcp:36:truncate.0 00010000:00010000:2.0:1790740347.857779:0:7760:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740347.857813:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92dfef lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cca expref: 43 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740347.857833:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf045700) 00010000:00010000:2.0:1790740347.857838:0:7760:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790740347.858088:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92dff6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740347.858104:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92dff6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740347.858114:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92dff6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790740347.858164:0:7760:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:2.0:1790740347.858186:0:7760:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a84d735f reply state 00000000883d29b8 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92dff6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740347.858218:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92dff6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740347.858224:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf045700) 00010000:00010000:2.0:1790740347.858227:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790740347.858229:0:7760:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790740347.858468:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+45:11229:x1877727000961280:12345-192.168.204.3@tcp:36:truncate.0 Request processed in 753us (970us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1790740347.858476:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 64 00000020:00080000:2.0:1790740347.858482:0:7760:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1790740348.014990:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740348.015319:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000961408 00000100:00100000:3.0:1790740348.015331:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000961408 00000100:00100000:3.0:1790740348.015421:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 65 00000100:00100000:3.0:1790740348.015432:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82c88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+45:11243:x1877727000961408:12345-192.168.204.3@tcp:101:stat.0 00010000:00010000:3.0:1790740348.015458:0:13222:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740348.015483:0:13222:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92dffd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23cd1 expref: -99 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.015553:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9000/0xb25dda4f4e92e004 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.015569:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9000/0xb25dda4f4e92e004 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.015581:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9000/0xb25dda4f4e92e004 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.015593:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e00b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.015600:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e00b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.015608:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e00b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.015683:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e012 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.015710:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e012 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.015717:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e012 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740348.015762:0:13222:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1790740348.015766:0:13222:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790740348.015802:0:13222:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e012 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.015814:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e012 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.015822:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9000/0xb25dda4f4e92e004 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.015829:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9000/0xb25dda4f4e92e004 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.015836:0:13222:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9000/0xb25dda4f4e92e004 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.015843:0:13222:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc9000 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740348.015848:0:13222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9000/0xb25dda4f4e92e004 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.015855:0:13222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9000/0xb25dda4f4e92e004 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1790740348.015975:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790740348.016277:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98dcaec70300) 00010000:00010000:3.0:1790740348.016287:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740348.016292:0:13222:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9000/0xb25dda4f4e92e004 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.016299:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9000/0xb25dda4f4e92e004 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.016313:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e00b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.016319:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e00b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.016324:0:13222:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e00b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.016328:0:13222:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc9e00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740348.016330:0:13222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e00b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.016335:0:13222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e00b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.016342:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98dcaec70d00) 00010000:00010000:3.0:1790740348.016344:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740348.016347:0:13222:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e00b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.016351:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e00b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.016429:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92dffd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cd1 expref: 47 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.016455:0:13222:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e012 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cd1 expref: 46 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.016462:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf045700) 00010000:00010000:3.0:1790740348.016464:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790740348.016466:0:13222:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc8a00, rc 0) 00000100:00100000:3.0:1790740348.016575:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82c88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+46:11243:x1877727000961408:12345-192.168.204.3@tcp:101:stat.0 Request processed in 1145us (1596us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740348.016583:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 65 00000100:00100000:0.0:1790740348.122519:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740348.122994:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000961664 00000100:00100000:2.0:1790740348.123005:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000961664 00000100:00100000:2.0:1790740348.123115:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 66 00000100:00100000:2.0:1790740348.123125:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+46:11253:x1877727000961664:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:2.0:1790740348.123145:0:6535:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740348.123167:0:6535:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92e019 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23cd8 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740348.123272:0:6535:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1790740348.123392:0:6535:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92e019 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cd8 expref: 48 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740348.123406:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98dcaf045a00) 00010000:00010000:2.0:1790740348.123409:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790740348.123414:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92e019 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cd8 expref: 48 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740348.123450:0:6535:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f32400, rc 0) 00000100:00100000:2.0:1790740348.123522:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+47:11253:x1877727000961664:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 399us (1014us total) trans 4294967341 rc 301/301 00000100:00100000:2.0:1790740348.123530:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 66 00000100:00100000:0.0:1790740348.126793:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740348.127020:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000961920 00000100:00100000:2.0:1790740348.127058:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000961920 00000100:00100000:2.0:1790740348.127125:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 14 00000100:00100000:2.0:1790740348.127135:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+47:11253:x1877727000961920:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:2.0:1790740348.127897:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+48:11253:x1877727000961920:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 761us (1111us total) trans 4294967342 rc 0/0 00000100:00100000:2.0:1790740348.127907:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 14 00000100:00100000:0.0:1790740348.202695:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740348.202771:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000962176 00000100:00100000:3.0:1790740348.202782:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000962176 00000100:00100000:3.0:1790740348.202862:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 67 00000100:00100000:3.0:1790740348.202873:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+48:11259:x1877727000962176:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:3.0:1790740348.202897:0:6537:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740348.202921:0:6537:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e027 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23cdf expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.203094:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e02e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.203110:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e012 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cd1 expref: 49 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.203119:0:6537:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e02e lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.203160:0:6537:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e012 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cd1 expref: 49 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.203191:0:6537:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e012 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cd1 expref: 49 pid: 13222 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740348.203205:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc867d6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6537:1877727022024064:192.168.204.3@tcp:104: 00000100:00100000:3.0:1790740348.204802:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc83e4f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790740348.211466:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740348.212345:0:10416:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000962304 00000100:00100000:1.0:1790740348.212357:0:10416:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000962304 00010000:00010000:1.0:1790740348.212409:0:10416:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e012 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cd1 expref: 50 pid: 13222 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740348.212459:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 57 00000100:00100000:1.0:1790740348.212469:0:10416:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc86ac3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7bed19f2-4c98-4684-89e7-a6871565665d+50:2402:x1877727000962304:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740348.212484:0:10416:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740348.212492:0:10416:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e012 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cd1 expref: 50 pid: 13222 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.212528:0:10416:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e012 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cd1 expref: 50 pid: 13222 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.212565:0:10416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf045700) 00010000:00010000:1.0:1790740348.212571:0:10416:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e02e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.212582:0:10416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e02e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.212589:0:10416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e02e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.212608:0:10416:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740348.212673:0:10416:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc86ac3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7bed19f2-4c98-4684-89e7-a6871565665d+50:2402:x1877727000962304:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 205us (1219us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740348.212680:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 57 00010000:00010000:3.0:1790740348.216118:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e012 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cd1 expref: 49 pid: 13222 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740348.216144:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc867d6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6537:1877727022024064:192.168.204.3@tcp:104: 00010000:00010000:3.0:1790740348.216168:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e02e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.216178:0:6537:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e02e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.216184:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e02e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740348.216217:0:6537:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1790740348.216383:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e027 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cdf expref: 50 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.216400:0:6537:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e02e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cdf expref: 49 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.216408:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf045700) 00010000:00010000:3.0:1790740348.216425:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790740348.216429:0:6537:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc9e00, rc 0) 00000100:00100000:3.0:1790740348.216508:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+49:11259:x1877727000962176:12345-192.168.204.3@tcp:101:bash.0 Request processed in 13636us (13824us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1790740348.216518:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 67 00000100:00100000:0.0:1790740348.227152:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740348.232574:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000962560 00000100:00100000:3.0:1790740348.232590:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000962560 00000100:00100000:3.0:1790740348.232673:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 68 00000100:00100000:3.0:1790740348.232684:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+49:11259:x1877727000962560:12345-192.168.204.3@tcp:36:bash.0 00010000:00010000:3.0:1790740348.233239:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e03c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.233270:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e03c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.233283:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e03c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790740348.233329:0:13222:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:3.0:1790740348.233363:0:13222:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001dd096a7 reply state 00000000e5151436 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e03c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.233388:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e03c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.233396:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf045700) 00010000:00010000:3.0:1790740348.233400:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790740348.233404:0:13222:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790740348.233513:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+52:11259:x1877727000962560:12345-192.168.204.3@tcp:36:bash.0 Request processed in 830us (6369us total) trans 4294967345 rc 0/0 00000100:00100000:3.0:1790740348.233537:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 68 00000020:00080000:3.0:1790740348.233543:0:13222:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1790740348.240074:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740348.240156:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000962688 00000100:00100000:1.0:1790740348.240167:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000962688 00000100:00100000:1.0:1790740348.240251:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 69 00000100:00100000:1.0:1790740348.240263:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+52:11259:x1877727000962688:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:1.0:1790740348.240293:0:7760:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740348.240318:0:7760:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e043 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23ce6 expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.240422:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e04a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.240459:0:7760:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e02e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cdf expref: 53 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.240468:0:7760:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e04a lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.240504:0:7760:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e02e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cdf expref: 53 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.240796:0:7760:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e02e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cdf expref: 53 pid: 6537 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740348.240814:0:7760:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfc29f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7760:1877727022024192:192.168.204.3@tcp:104: 00000100:00100000:1.0:1790740348.240905:0:7760:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc99123000 going to sleep for 11 seconds 00000100:00100000:1.0:1790740348.246232:0:7760:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfc29f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7760:1877727022024192:192.168.204.3@tcp:104: 00010000:00010000:1.0:1790740348.246270:0:7760:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e04a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740348.246764:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740348.246847:0:6520:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000962816 00000100:00100000:1.0:1790740348.246865:0:6520:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000962816 00010000:00010000:1.0:1790740348.246903:0:6520:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e02e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cdf expref: 54 pid: 6537 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740348.246954:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 58 00000100:00100000:1.0:1790740348.246964:0:6520:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7bed19f2-4c98-4684-89e7-a6871565665d+54:2403:x1877727000962816:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740348.246980:0:6520:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740348.247012:0:6520:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e02e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cdf expref: 54 pid: 6537 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.247024:0:6520:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e02e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cdf expref: 54 pid: 6537 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.247205:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e02e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cdf expref: 54 pid: 6537 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.247223:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf045700) 00010000:00010000:1.0:1790740348.247228:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e04a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.247238:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e04a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.247246:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e04a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.247284:0:6520:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740348.247392:0:6520:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7bed19f2-4c98-4684-89e7-a6871565665d+53:2403:x1877727000962816:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 427us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740348.247400:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 58 00010000:00010000:2.0:1790740348.248090:0:7760:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e04a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740348.248102:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e04a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740348.248162:0:7760:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1790740348.248167:0:7760:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790740348.248189:0:7760:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e04a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740348.248223:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e043 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ce6 expref: 53 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740348.248242:0:7760:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e04a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ce6 expref: 52 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740348.248267:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf045700) 00010000:00010000:2.0:1790740348.248270:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790740348.248274:0:7760:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcbfc45200, rc 0) 00000100:00100000:2.0:1790740348.248315:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+52:11259:x1877727000962688:12345-192.168.204.3@tcp:101:bash.0 Request processed in 8055us (8286us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740348.248322:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 69 00000100:00100000:0.0:1790740348.256551:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740348.256631:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000963072 00000100:00100000:1.0:1790740348.256641:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000963072 00000100:00100000:1.0:1790740348.256704:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 15 00000100:00100000:1.0:1790740348.256713:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c82450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+52:11259:x1877727000963072:12345-192.168.204.3@tcp:35:bash.0 00000100:00100000:1.0:1790740348.256974:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c82450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+53:11259:x1877727000963072:12345-192.168.204.3@tcp:35:bash.0 Request processed in 260us (431us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1790740348.257269:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 15 00010000:00010000:2.0:1790740348.394459:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740348.411808:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740348.411913:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000963328 00000100:00100000:3.0:1790740348.411924:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000963328 00000100:00100000:3.0:1790740348.411999:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 70 00000100:00100000:3.0:1790740348.412009:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+53:11269:x1877727000963328:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:3.0:1790740348.412061:0:6537:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740348.412089:0:6537:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e051 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23ced expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740348.412201:0:6537:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1790740348.412315:0:6537:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e051 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ced expref: 55 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.412329:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98dcaf045a00) 00010000:00010000:3.0:1790740348.412332:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790740348.412338:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e051 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ced expref: 55 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.412351:0:6537:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc8a00, rc 0) 00000100:00100000:3.0:1790740348.412422:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+54:11269:x1877727000963328:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 414us (624us total) trans 4294967347 rc 301/301 00000100:00100000:3.0:1790740348.412430:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 70 00000100:00100000:0.0:1790740348.417096:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740348.417187:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000963456 00000100:00100000:3.0:1790740348.417200:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000963456 00000100:00100000:3.0:1790740348.417266:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 71 00000100:00100000:3.0:1790740348.417276:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+54:11269:x1877727000963456:12345-192.168.204.3@tcp:34:lfs.0 00010000:00010000:3.0:1790740348.417386:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9000/0xb25dda4f4e92e05f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.417404:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9000/0xb25dda4f4e92e05f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.417415:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9000/0xb25dda4f4e92e05f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.417426:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e066 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.417432:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e066 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.417439:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e066 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.417517:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e06d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.417527:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e06d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.417534:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e06d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790740348.417585:0:13222:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e06d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.417599:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9000/0xb25dda4f4e92e05f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.417616:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9000/0xb25dda4f4e92e05f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.417623:0:13222:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9000/0xb25dda4f4e92e05f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.417629:0:13222:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc9000 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740348.417634:0:13222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9000/0xb25dda4f4e92e05f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.417643:0:13222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9000/0xb25dda4f4e92e05f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.417655:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98dcaec70300) 00010000:00010000:3.0:1790740348.417658:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740348.417663:0:13222:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9000/0xb25dda4f4e92e05f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.417669:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9000/0xb25dda4f4e92e05f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.417682:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e066 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.417688:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e066 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.417694:0:13222:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e066 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.417699:0:13222:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc9800 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740348.417708:0:13222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e066 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.417715:0:13222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e066 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.417722:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98dcaec70d00) 00010000:00010000:3.0:1790740348.417725:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740348.417728:0:13222:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e066 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.417734:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e066 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.417744:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e06d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.417749:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e06d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.417754:0:13222:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e06d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.417759:0:13222:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc9c00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740348.417762:0:13222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e06d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.417768:0:13222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e06d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.417775:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf045700) 00010000:00010000:3.0:1790740348.417777:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740348.417788:0:13222:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e06d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.417795:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e06d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740348.417887:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+54:11269:x1877727000963456:12345-192.168.204.3@tcp:34:lfs.0 Request processed in 612us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740348.417895:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 71 00000100:00100000:0.0:1790740348.420825:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740348.420961:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000963712 00000100:00100000:2.0:1790740348.420972:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000963712 00000100:00100000:2.0:1790740348.421060:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 16 00000100:00100000:2.0:1790740348.421072:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+54:11269:x1877727000963712:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:2.0:1790740348.421293:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+55:11269:x1877727000963712:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 222us (474us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1790740348.421301:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 16 00000100:00100000:2.0:1790740348.479801:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740348.479991:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000963968 00000100:00100000:1.0:1790740348.480001:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000963968 00000100:00100000:1.0:1790740348.480090:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 72 00000100:00100000:1.0:1790740348.480100:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc884b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+55:11272:x1877727000963968:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:1.0:1790740348.480127:0:7760:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740348.480147:0:7760:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44200/0xb25dda4f4e92e074 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23cf4 expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.480227:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44e00/0xb25dda4f4e92e07b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.480242:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44e00/0xb25dda4f4e92e07b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.480253:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44e00/0xb25dda4f4e92e07b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.480264:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92e082 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.480271:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92e082 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.480278:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92e082 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.480402:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92e089 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.480437:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92e089 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.480444:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92e089 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740348.480456:0:7760:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1790740348.480993:0:7760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44e00/0xb25dda4f4e92e07b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.481004:0:7760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44e00/0xb25dda4f4e92e07b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.481011:0:7760:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44e00/0xb25dda4f4e92e07b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.481017:0:7760:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc44e00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740348.481021:0:7760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44e00/0xb25dda4f4e92e07b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.481028:0:7760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44e00/0xb25dda4f4e92e07b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.481071:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98dcaec70300) 00010000:00010000:1.0:1790740348.481075:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740348.481081:0:7760:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44e00/0xb25dda4f4e92e07b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.481087:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44e00/0xb25dda4f4e92e07b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.481105:0:7760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92e082 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.481119:0:7760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92e082 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.481125:0:7760:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92e082 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.481130:0:7760:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc45000 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740348.481134:0:7760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92e082 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.481140:0:7760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92e082 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.481147:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98dcaec70d00) 00010000:00010000:1.0:1790740348.481149:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740348.481151:0:7760:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92e082 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.481156:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92e082 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.481198:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44200/0xb25dda4f4e92e074 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cf4 expref: 58 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.481210:0:7760:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92e089 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cf4 expref: 57 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.481217:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf045700) 00010000:00010000:1.0:1790740348.481219:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790740348.481226:0:7760:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcbfc44000, rc 0) 00000100:00100000:1.0:1790740348.481357:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc884b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+57:11272:x1877727000963968:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 1258us (1564us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1790740348.481373:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 72 00000100:00100000:0.0:1790740348.498478:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740348.498539:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740348.498638:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000964224 00000100:00100000:2.0:1790740348.498650:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000964224 00000100:00100000:2.0:1790740348.498730:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 5 00000100:00100000:2.0:1790740348.498741:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7bed19f2-4c98-4684-89e7-a6871565665d+57:2403:x1877727000964224:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790740348.498759:0:6522:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740348.498787:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92e089 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cf4 expref: 57 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740348.498806:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf045700) 00010000:00010000:2.0:1790740348.498811:0:6522:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740348.498897:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7bed19f2-4c98-4684-89e7-a6871565665d+56:2403:x1877727000964224:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 158us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740348.498906:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 5 00000100:00100000:3.0:1790740348.499329:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000964096 00000100:00100000:3.0:1790740348.499335:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000964096 00000100:00100000:3.0:1790740348.499375:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 73 00000100:00100000:3.0:1790740348.499381:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+56:11272:x1877727000964096:12345-192.168.204.3@tcp:54:lfs.0 00010000:00010000:3.0:1790740348.499440:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e097 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.499455:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e097 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.499465:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e097 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.499504:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e097 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.499511:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e097 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.499518:0:6535:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e097 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.499534:0:6535:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc9c00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740348.499546:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e097 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.499555:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e097 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.499564:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf045700) 00010000:00010000:3.0:1790740348.499567:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790740348.499571:0:6535:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e097 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.499577:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e097 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740348.499625:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+56:11272:x1877727000964096:12345-192.168.204.3@tcp:54:lfs.0 Request processed in 244us (1096us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740348.499633:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 73 00000100:00100000:0.0:1790740348.505466:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740348.505566:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000964480 00000100:00100000:3.0:1790740348.505576:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000964480 00000100:00100000:3.0:1790740348.505631:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 17 00000100:00100000:3.0:1790740348.505640:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+56:11272:x1877727000964480:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:3.0:1790740348.507004:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+57:11272:x1877727000964480:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 1357us (1539us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1790740348.507016:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 17 00000100:00100000:2.0:1790740348.704890:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740348.705018:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000964736 00000100:00100000:0.0:1790740348.705077:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000964736 00000100:00100000:0.0:1790740348.705135:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 74 00000100:00100000:0.0:1790740348.705144:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc884b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+57:11290:x1877727000964736:12345-192.168.204.3@tcp:101:cat.0 00010000:00010000:0.0:1790740348.705172:0:6536:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740348.705197:0:6536:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060a00/0xb25dda4f4e92e09e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23cfb expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740348.705315:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92e0a5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740348.705331:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92e0a5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740348.705344:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92e0a5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790740348.705370:0:6536:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1790740348.705516:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060a00/0xb25dda4f4e92e09e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cfb expref: 60 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740348.705670:0:6536:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92e0a5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cfb expref: 59 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740348.705680:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf045700) 00010000:00010000:0.0:1790740348.705683:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1790740348.705687:0:6536:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaf061800, rc 0) 00000100:00100000:0.0:1790740348.705763:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc884b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+59:11290:x1877727000964736:12345-192.168.204.3@tcp:101:cat.0 Request processed in 620us (886us total) trans 4294967351 rc 0/0 00000100:00100000:0.0:1790740348.705771:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 74 00000100:00100000:1.0:1790740348.770150:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740348.770291:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000964864 00000100:00100000:3.0:1790740348.770302:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000964864 00000100:00100000:3.0:1790740348.770361:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 75 00000100:00100000:3.0:1790740348.770371:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+59:11291:x1877727000964864:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:3.0:1790740348.770400:0:6537:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740348.770446:0:6537:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e0b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23d02 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.770535:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e0ba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.770551:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e0ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.770565:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e0ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740348.770610:0:6537:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1790740348.770613:0:6537:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790740348.770635:0:6537:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e0ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.770674:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e0b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d02 expref: 61 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.770695:0:6537:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e0ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d02 expref: 60 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.770704:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98dcaec70300) 00010000:00010000:3.0:1790740348.770707:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790740348.770711:0:6537:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc9800, rc 0) 00000100:00100000:3.0:1790740348.770782:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+60:11291:x1877727000964864:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 413us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740348.770789:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 75 00000100:00100000:2.0:1790740348.778136:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740348.778237:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000965248 00000100:00100000:1.0:1790740348.778248:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000965248 00000100:00100000:1.0:1790740348.778305:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 18 00000100:00100000:1.0:1790740348.778315:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc884b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+60:11291:x1877727000965248:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:1.0:1790740348.778855:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc884b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+61:11291:x1877727000965248:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 532us (719us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1790740348.778864:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 18 00000001:00080000:2.0:1790740348.783267:0:6514:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000004:00080000:2.0:1790740348.783323:0:6514:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:2.0:1790740348.783348:0:6514:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98db83eff540 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1790740348.783358:0:6514:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98dc84c20600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98db83effe40 00000020:00080000:2.0:1790740348.783361:0:6514:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98dc84c20200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98db83fb4600 00010000:00010000:1.0:1790740348.783489:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92de83 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.783501:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92de83 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.783510:0:3625:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92de83 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.783516:0:3625:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc45600 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740348.783531:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92de83 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.783539:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92de83 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.783556:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff98dcaec70c00) 00010000:00010000:1.0:1790740348.783574:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740348.783580:0:3625:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92de83 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.783588:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92de83 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.783613:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92de8a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.783620:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92de8a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.783625:0:3625:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92de8a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.783632:0:3625:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc45400 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740348.783634:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92de8a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.783641:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92de8a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.783649:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98dcaec70300) 00010000:00010000:1.0:1790740348.783651:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740348.783654:0:3625:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92de8a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.783659:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92de8a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.783673:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92dec9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740348.784052:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790740348.784078:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc867d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022024320:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1790740348.784140:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740348.784211:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022024320 00000100:00100000:3.0:1790740348.784219:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022024320 00000100:00100000:3.0:1790740348.784275:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00010000:00010000:1.0:1790740348.784275:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92dec9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.784286:0:3625:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92dec9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740348.784290:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc867d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1877727022024320:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1790740348.784296:0:3625:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc44c00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740348.784301:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92dec9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.784308:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92dec9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.784318:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98dcaec70d00) 00010000:00010000:1.0:1790740348.784321:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00002000:00080000:3.0:1790740348.784322:0:8451:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00010000:00010000:1.0:1790740348.784324:0:3625:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92dec9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.784332:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92dec9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.784350:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92dfd3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790740348.784353:0:8451:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6abc877a, atime: 0x6abc877a, ctime: 0x6abc877a, blocks: 0x8 00010000:00010000:1.0:1790740348.784355:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92dfd3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.784363:0:3625:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92dfd3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.784367:0:3625:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc8c00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740348.784375:0:8451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063a6c57a/0xb25dda4f4e92e0c1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.784376:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92dfd3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.784392:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92dfd3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.784401:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=420s v=(0 0) 00010000:00010000:1.0:1790740348.784403:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf045700) 00010000:00010000:1.0:1790740348.784407:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740348.784408:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790740348.784411:0:3625:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92dfd3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.784417:0:8451:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063a6c57a/0xb25dda4f4e92e0c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.784419:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92dfd3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.784445:0:8451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063a6c57a/0xb25dda4f4e92e0c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.784453:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92dff6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.784454:0:8451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063a6c57a/0xb25dda4f4e92e0c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.784470:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92dff6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.784472:0:8451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000063a6c57a/0xb25dda4f4e92e0c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.784484:0:3625:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92dff6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.784490:0:3625:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f32200 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740348.784493:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92dff6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740348.784497:0:8451:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790740348.784500:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92dff6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.784509:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf045700) 00010000:00010000:1.0:1790740348.784511:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740348.784529:0:3625:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92dff6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.784537:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92dff6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.784549:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e03c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.784555:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e03c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.784560:0:3625:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e03c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.784564:0:3625:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc9400 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740348.784566:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e03c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.784571:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e03c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.784578:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf045700) 00010000:00010000:1.0:1790740348.784580:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740348.784583:0:3625:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e03c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.784589:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e03c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.784636:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790740348.784642:0:6523:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000063a6c57a/0xb25dda4f4e92e0c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.784661:0:6523:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc9c00 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:1.0:1790740348.784665:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000063a6c57a/0xb25dda4f4e92e0c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.784672:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000063a6c57a/0xb25dda4f4e92e0c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740348.784997:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc867d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3638:x1877727022024320:12345-0@lo:6:osp-syn-1-0.0 Request processed in 710us (856us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1790740348.785012:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000004:00080000:2.0:1790740348.785196:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98dc867d6a00/2, rc 0, transno 4294967302 00000100:00100000:2.0:1790740348.785202:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc867d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022024320:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1790740348.785883:0:6523:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000063a6c57a/0xb25dda4f4e92e0c1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.785896:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063a6c57a/0xb25dda4f4e92e0c1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.785917:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740348.785919:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740348.785921:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1790740348.786002:0:6567:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1790740348.786202:0:6567:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00080000:0.0:1790740348.786214:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790740348.787876:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740348.788172:0:10416:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000965376 00000100:00100000:1.0:1790740348.788183:0:10416:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000965376 00000100:00100000:1.0:1790740348.788253:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 6 00000100:00100000:1.0:1790740348.788263:0:10416:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7bed19f2-4c98-4684-89e7-a6871565665d+14:11291:x1877727000965376:12345-192.168.204.3@tcp:103:lfs.0 00010000:00010000:1.0:1790740348.788280:0:10416:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1790740348.788305:0:10416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e04a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ce6 expref: 14 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.788333:0:10416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92e0a5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cfb expref: 13 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.788365:0:10416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33400/0xb25dda4f4e92df47 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ca0 expref: 12 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.788377:0:10416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf045700) 00010000:00010000:1.0:1790740348.788383:0:10416:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740348.788457:0:10416:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7bed19f2-4c98-4684-89e7-a6871565665d+11:11291:x1877727000965376:12345-192.168.204.3@tcp:103:lfs.0 Request processed in 195us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740348.788466:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 6 00000100:00100000:0.0:1790740348.795877:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740348.796059:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000965504 00000100:00100000:1.0:1790740348.796070:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000965504 00000100:00100000:1.0:1790740348.796123:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 76 00000100:00100000:1.0:1790740348.796132:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+11:11291:x1877727000965504:12345-192.168.204.3@tcp:58:lfs.0 00010000:00010000:1.0:1790740348.796272:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92e0c8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.796292:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92e0c8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740348.796306:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92e0c8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790740348.796732:0:13222:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790740348.796901:0:13222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1790740348.797003:0:13222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1790740348.797284:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+11:11291:x1877727000965504:12345-192.168.204.3@tcp:58:lfs.0 Request processed in 1149us (1412us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740348.797296:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 76 00000100:00100000:0.0:1790740348.836662:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740348.838853:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000965632 00000100:00100000:1.0:1790740348.838869:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000965632 00000100:00100000:2.0:1790740348.839119:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 77 00000100:00100000:2.0:1790740348.839130:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+11:11293:x1877727000965632:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:2.0:1790740348.839150:0:7760:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740348.839171:0:7760:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33400/0xb25dda4f4e92e0cf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23d09 expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740348.839238:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92e0d6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740348.839252:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92e0d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740348.839263:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92e0d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740348.839276:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92e0dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740348.839299:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92e0dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740348.839306:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92e0dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740348.839394:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92e0e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740348.839402:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92e0e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740348.839409:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92e0e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740348.839451:0:7760:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1790740348.839455:0:7760:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790740348.839603:0:7760:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92e0e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740348.839616:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92e0e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740348.839624:0:7760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92e0d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740348.839631:0:7760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92e0d6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740348.839638:0:7760:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92e0d6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740348.839655:0:7760:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f32200 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740348.839660:0:7760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92e0d6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740348.839667:0:7760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92e0d6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740348.839680:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98dcaec70300) 00010000:00010000:2.0:1790740348.839683:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740348.839688:0:7760:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92e0d6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740348.839693:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92e0d6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740348.839707:0:7760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92e0dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740348.839712:0:7760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92e0dd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740348.839717:0:7760:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92e0dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740348.839722:0:7760:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f33000 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740348.839724:0:7760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92e0dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740348.839729:0:7760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92e0dd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740348.839744:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98db83b66c00) 00010000:00010000:2.0:1790740348.839746:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740348.839749:0:7760:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92e0dd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740348.839755:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92e0dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740348.839797:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33400/0xb25dda4f4e92e0cf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d09 expref: 13 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740348.839812:0:7760:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92e0e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d09 expref: 12 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740348.839818:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf045700) 00010000:00010000:2.0:1790740348.839821:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790740348.839823:0:7760:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f32000, rc 0) 00000100:00100000:2.0:1790740348.839904:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+12:11293:x1877727000965632:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 776us (3254us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740348.839912:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 77 00010000:00010000:3.0:1790740349.418327:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740349.553208:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790740349.553234:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfc29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022024448:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790740349.553318:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740349.553502:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022024448 00000100:00100000:1.0:1790740349.553512:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022024448 00000100:00100000:1.0:1790740349.553576:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1790740349.553588:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc884b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022024448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790740349.553627:0:6541:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1790740349.553690:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc884b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022024448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740349.553698:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1790740349.554421:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfc29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022024448:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1790740349.726640:0:14231:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790740349.726652:0:14231:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790740349.726678:0:14231:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1790740349.726686:0:14231:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1790740349.739212:0:13821:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790740349.739225:0:13821:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790740349.739272:0:13821:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1790740349.739292:0:13821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790740349.739444:0:13821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe10700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13821:1877727022024576:192.168.204.3@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790740349.739960:0:13821:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83d05840 going to sleep for 11 seconds 00000100:00100000:3.0:1790740349.747198:0:13821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe10700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13821:1877727022024576:192.168.204.3@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790740349.749575:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740349.749727:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000965760 00000100:00100000:2.0:1790740349.749738:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000965760 00000100:00100000:2.0:1790740349.749791:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 78 00000100:00100000:2.0:1790740349.749813:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+12:11304:x1877727000965760:12345-192.168.204.3@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790740349.749853:0:6535:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790740349.750008:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+12:11304:x1877727000965760:12345-192.168.204.3@tcp:53:lhsmtool_posix.0 Request processed in 196us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740349.750016:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 78 00000100:00100000:0.0:1790740349.752756:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740349.753523:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000965888 00000100:00100000:3.0:1790740349.753538:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000965888 00000100:00100000:3.0:1790740349.753618:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 79 00000100:00100000:3.0:1790740349.753632:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+12:11304:x1877727000965888:12345-192.168.204.3@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1790740349.753750:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9000/0xb25dda4f4e92e0eb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.753779:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9000/0xb25dda4f4e92e0eb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.754007:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9000/0xb25dda4f4e92e0eb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.758893:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e0f2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.758934:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e0f2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.758948:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e0f2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.759286:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e0f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.759299:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e0f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.759581:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e0f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740349.759642:0:13222:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1790740349.759647:0:13222:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790740349.759665:0:13222:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e0f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.759680:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9000/0xb25dda4f4e92e0eb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.759688:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9000/0xb25dda4f4e92e0eb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.759696:0:13222:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9000/0xb25dda4f4e92e0eb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.759703:0:13222:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc9000 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740349.759707:0:13222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9000/0xb25dda4f4e92e0eb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.759715:0:13222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9000/0xb25dda4f4e92e0eb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.759728:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98db82949800) 00010000:00010000:3.0:1790740349.759731:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740349.759736:0:13222:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9000/0xb25dda4f4e92e0eb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.759743:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9000/0xb25dda4f4e92e0eb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.759768:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e0f2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.759775:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e0f2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.759782:0:13222:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e0f2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.759787:0:13222:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc8a00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740349.759790:0:13222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e0f2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.759796:0:13222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e0f2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.759804:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff98dcaf04c300) 00010000:00010000:3.0:1790740349.759807:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740349.759810:0:13222:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e0f2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.759816:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e0f2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.759832:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e0f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.759839:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e0f9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.759845:0:13222:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e0f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.759856:0:13222:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc8200 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740349.759859:0:13222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e0f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.759866:0:13222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e0f9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.759874:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf045700) 00010000:00010000:3.0:1790740349.759877:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740349.759880:0:13222:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e0f9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.759884:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e0f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740349.761551:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+12:11304:x1877727000965888:12345-192.168.204.3@tcp:34:lhsmtool_posix.0 Request processed in 7912us (8799us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740349.761566:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 79 00000100:00100000:2.0:1790740349.784394:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740349.784592:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000966144 00000100:00100000:0.0:1790740349.784601:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000966144 00000100:00100000:0.0:1790740349.784673:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 80 00000100:00100000:0.0:1790740349.784683:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc884b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+12:11304:x1877727000966144:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790740349.784704:0:7760:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740349.784726:0:7760:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061200/0xb25dda4f4e92e100 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23d10 expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740349.784837:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92e107 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740349.784853:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92e107 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740349.784864:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92e107 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790740349.784876:0:7760:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1790740349.784979:0:7760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92e107 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740349.784987:0:7760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92e107 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740349.784994:0:7760:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92e107 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740349.785000:0:7760:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf061800 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:0.0:1790740349.785005:0:7760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92e107 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740349.785012:0:7760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92e107 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740349.785059:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf045700) 00010000:00010000:0.0:1790740349.785063:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790740349.785069:0:7760:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92e107 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740349.785075:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92e107 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740349.785117:0:7760:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061200/0xb25dda4f4e92e100 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d10 expref: 14 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740349.785127:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98db82949800) 00010000:00010000:0.0:1790740349.785130:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790740349.785133:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061200/0xb25dda4f4e92e100 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d10 expref: 14 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740349.785142:0:7760:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaf061200, rc 0) 00000100:00100000:0.0:1790740349.785219:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc884b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+13:11304:x1877727000966144:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 537us (834us total) trans 4294967353 rc 301/301 00000100:00100000:0.0:1790740349.785227:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 80 00000100:00100000:1.0:1790740349.796216:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740349.796294:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000966272 00000100:00100000:0.0:1790740349.796306:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000966272 00000100:00100000:0.0:1790740349.796366:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 81 00000100:00100000:0.0:1790740349.796376:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+13:11304:x1877727000966272:12345-192.168.204.3@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790740349.796413:0:6536:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790740349.796535:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+13:11304:x1877727000966272:12345-192.168.204.3@tcp:53:lhsmtool_posix.0 Request processed in 160us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740349.796559:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 81 00000100:00100000:3.0:1790740349.802770:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740349.802854:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000966528 00000100:00100000:0.0:1790740349.802866:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000966528 00000100:00100000:0.0:1790740349.802941:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 82 00000100:00100000:0.0:1790740349.802952:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc867d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+13:11304:x1877727000966528:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790740349.802974:0:13222:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740349.802978:0:13222:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790740349.803005:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e0ba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d02 expref: 13 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740349.803065:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98dcaec70300) 00010000:00010000:0.0:1790740349.803070:0:13222:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790740349.803085:0:13222:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061200/0xb25dda4f4e92e115 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23d17 expref: -99 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790740349.803523:0:13222:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:0.0:1790740349.803660:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92e11c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740349.803674:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92e11c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740349.803685:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92e11c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740349.803737:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061200/0xb25dda4f4e92e115 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d17 expref: 15 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740349.803765:0:13222:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92e11c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d17 expref: 14 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740349.803772:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98dc887e4300) 00010000:00010000:0.0:1790740349.803775:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790740349.803778:0:13222:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaf061800, rc 0) 00000100:00100000:0.0:1790740349.803841:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc867d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+14:11304:x1877727000966528:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 891us (1081us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1790740349.803848:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 82 00000100:00100000:0.0:1790740349.818989:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740349.819300:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000966784 00000100:00100000:3.0:1790740349.819311:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000966784 00000100:00100000:3.0:1790740349.819514:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 83 00000100:00100000:3.0:1790740349.819524:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+14:11304:x1877727000966784:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790740349.819581:0:6535:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740349.819606:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92e11c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d17 expref: 14 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.819624:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98dc887e4300) 00010000:00010000:3.0:1790740349.819648:0:6535:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790740349.819673:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e12a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.819687:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e12a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.819697:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e12a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.819710:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e131 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x2c0c1adf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.819717:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e131 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x2c0c1adf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.819722:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e131 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x2c0c1adf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.819768:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e12a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.819776:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e12a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.819783:0:6535:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e12a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.819789:0:6535:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc8200 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740349.819793:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e12a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.819799:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e12a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.819814:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98dcaec70300) 00010000:00010000:3.0:1790740349.819817:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740349.819821:0:6535:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e12a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.819828:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e12a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.819838:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e131 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x2c0c1adf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.819844:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e131 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x2c0c1adf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.819849:0:6535:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e131 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x2c0c1adf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.819853:0:6535:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc8a00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740349.819856:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e131 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x2c0c1adf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.819860:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e131 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x2c0c1adf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.819867:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x2c0c1adf (ffff98dcaf04c300) 00010000:00010000:3.0:1790740349.819868:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740349.819871:0:6535:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e131 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x2c0c1adf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.819876:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e131 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x2c0c1adf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740349.820343:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+13:11304:x1877727000966784:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 Request processed in 810us (1352us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790740349.820353:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 83 00000100:00100000:1.0:1790740349.845438:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740349.845582:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000966912 00000100:00100000:0.0:1790740349.845593:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000966912 00000100:00100000:0.0:1790740349.845662:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 84 00000100:00100000:0.0:1790740349.845674:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+13:11304:x1877727000966912:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790740349.845695:0:6537:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740349.845720:0:6537:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e138 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23d1e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740349.845756:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060200/0xb25dda4f4e92e13f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740349.845770:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060200/0xb25dda4f4e92e13f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740349.845782:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060200/0xb25dda4f4e92e13f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740349.845926:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e138 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d1e expref: 15 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740349.845946:0:6537:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060200/0xb25dda4f4e92e13f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d1e expref: 14 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740349.845954:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98dc887e4000) 00010000:00010000:0.0:1790740349.845957:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790740349.846316:0:6537:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaf060200, rc 0) 00000100:00100000:0.0:1790740349.846393:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+14:11304:x1877727000966912:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 721us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740349.846401:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 84 00000100:00100000:0.0:1790740349.856007:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740349.856126:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000967168 00000100:00100000:3.0:1790740349.856138:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000967168 00000100:00100000:2.0:1790740349.856194:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 85 00000100:00100000:2.0:1790740349.856209:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+14:11304:x1877727000967168:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790740349.856294:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e146 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740349.856312:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e146 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740349.856325:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e146 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790740349.857191:0:6535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:2.0:1790740349.859327:0:6535:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 421145292678ns, next at 422145288199ns, rc = 0 00000004:00010000:2.0:1790740349.859439:0:6535:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a042539c reply state 000000001bc7dea2 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e146 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740349.859468:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e146 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740349.859480:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98dc887e4000) 00010000:00010000:2.0:1790740349.859483:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1790740349.859488:0:6535:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790740349.859635:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+16:11304:x1877727000967168:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 Request processed in 3427us (3631us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1790740349.859652:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 85 00000100:00100000:0.0:1790740349.868486:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740349.868563:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000967296 00000100:00100000:3.0:1790740349.868574:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000967296 00000100:00100000:3.0:1790740349.868637:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 86 00000100:00100000:3.0:1790740349.868649:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+16:11304:x1877727000967296:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790740349.868683:0:6536:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740349.868710:0:6536:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e14d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23d25 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.868775:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e14d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d25 expref: 17 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.868792:0:6536:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e14d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d25 expref: 17 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.868812:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98dc887e4000) 00010000:00010000:3.0:1790740349.868816:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790740349.868820:0:6536:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc8a00, rc 0) 00000100:00100000:3.0:1790740349.868885:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+17:11304:x1877727000967296:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 238us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740349.868893:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 86 00000100:00100000:3.0:1790740349.873444:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740349.873605:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000967424 00000100:00100000:0.0:1790740349.873615:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000967424 00000100:00100000:0.0:1790740349.873663:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 33 00000100:00100000:0.0:1790740349.873673:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc867d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2401:x1877727000967424:12345-192.168.204.3@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1790740349.873710:0:9806:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 7bed19f2-4c98-4684-89e7-a6871565665d@192.168.204.3@tcp t0 exp 0000000000000000 cur 421 last 0 00000020:00000080:0.0:1790740349.873744:0:9806:0:(genops.c:1384:class_connect()) connect: client 7bed19f2-4c98-4684-89e7-a6871565665d, cookie 0xb25dda4f4e92e154 00002000:00100000:0.0:1790740349.873759:0:9806:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7bed19f2-4c98-4684-89e7-a6871565665d/ffff98db844e7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790740349.873781:0:9806:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790740349.873864:0:9806:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790740349.873899:0:9806:0:(import.c:65:import_set_state_nolock()) ffff98db844e3000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790740349.874015:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc867d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7bed19f2-4c98-4684-89e7-a6871565665d+6:2401:x1877727000967424:12345-192.168.204.3@tcp:8:lhsmtool_posix.0 Request processed in 342us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740349.874059:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 33 00000100:00100000:3.0:1790740349.877548:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740349.881593:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000967552 00000100:00100000:0.0:1790740349.881614:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000967552 00000100:00100000:0.0:1790740349.881764:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 34 00000100:00100000:0.0:1790740349.881776:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc867d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bed19f2-4c98-4684-89e7-a6871565665d+6:0:x1877727000967552:12345-192.168.204.3@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1790740349.889349:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1790740349.895730:0:8446:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:1.0:1790740349.895745:0:8446:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7bed19f2-4c98-4684-89e7-a6871565665d 00000100:00100000:2.0:1790740349.896104:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc867d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bed19f2-4c98-4684-89e7-a6871565665d+5:0:x1877727000967552:12345-192.168.204.3@tcp:2:lhsmtool_posix.0 Request processed in 14324us (18561us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1790740349.896118:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 34 00000100:00100000:0.0:1790740349.907521:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740349.907620:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000967808 00000100:00100000:2.0:1790740349.907631:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000967808 00000100:00100000:2.0:1790740349.907901:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 19 00000100:00100000:2.0:1790740349.907924:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+17:11304:x1877727000967808:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790740349.908489:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+18:11304:x1877727000967808:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 Request processed in 577us (975us total) trans 4294967356 rc 0/0 00000100:00100000:2.0:1790740349.908498:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 19 00000100:00100000:1.0:1790740349.919130:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740349.925294:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000968064 00000100:00100000:2.0:1790740349.925311:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000968064 00000100:00100000:2.0:1790740349.926294:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 87 00000100:00100000:2.0:1790740349.926309:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+18:11304:x1877727000968064:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790740349.926467:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+18:11304:x1877727000968064:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 Request processed in 162us (7346us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740349.926476:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 87 00000100:00100000:0.0:1790740349.933636:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740349.934303:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000968192 00000100:00100000:2.0:1790740349.934315:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000968192 00000100:00100000:2.0:1790740349.934462:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 88 00000100:00100000:2.0:1790740349.934472:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+18:11304:x1877727000968192:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790740349.934494:0:13222:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740349.934516:0:13222:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92e15b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23d2c expref: -99 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740349.934608:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92e162 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740349.934623:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92e162 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740349.934634:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92e162 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740349.934681:0:13222:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790740349.934700:0:13222:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92e162 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740349.934724:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92e15b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d2c expref: 20 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740349.934741:0:13222:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92e162 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d2c expref: 19 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740349.934751:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98dc887e4000) 00010000:00010000:2.0:1790740349.934754:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790740349.934758:0:13222:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f32e00, rc 0) 00000100:00100000:2.0:1790740349.934827:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+19:11304:x1877727000968192:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 357us (1202us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740349.934834:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 88 00000100:00100000:2.0:1790740349.945346:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740349.945383:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000968320 00000100:00100000:2.0:1790740349.945393:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000968320 00000100:00100000:2.0:1790740349.945455:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 35 00000100:00100000:2.0:1790740349.945464:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc884b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7bed19f2-4c98-4684-89e7-a6871565665d+5:2403:x1877727000968320:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790740349.945486:0:9806:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740349.945513:0:9806:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c130e9a4/0xb25dda4f4e92e169 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23d33 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790740349.945544:0:9806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abc877e, blocks: 0x0 00010000:00010000:2.0:1790740349.945565:0:9806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=421s v=(0 0) 00010000:00010000:2.0:1790740349.945570:0:9806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740349.945579:0:9806:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c130e9a4/0xb25dda4f4e92e169 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d33 expref: 6 pid: 9806 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740349.945600:0:9806:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c130e9a4/0xb25dda4f4e92e169 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d33 expref: 6 pid: 9806 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740349.945612:0:9806:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f32a00, rc 0) 00000100:00100000:2.0:1790740349.945669:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc884b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7bed19f2-4c98-4684-89e7-a6871565665d+6:2403:x1877727000968320:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 207us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740349.945677:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 35 00000100:00100000:2.0:1790740349.961730:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740349.970849:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000968576 00000100:00100000:0.0:1790740349.970866:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000968576 00000100:00100000:0.0:1790740349.970947:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 89 00000100:00100000:0.0:1790740349.971419:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc884b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+19:11304:x1877727000968576:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790740349.971617:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc884b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+19:11304:x1877727000968576:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 Request processed in 659us (9894us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740349.971626:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 89 00000100:00100000:0.0:1790740349.988886:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740349.989097:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000968704 00000100:00100000:3.0:1790740349.989110:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000968704 00000100:00100000:3.0:1790740349.989182:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 36 00000100:00100000:3.0:1790740349.989194:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84524e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bed19f2-4c98-4684-89e7-a6871565665d+6:11304:x1877727000968704:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790740349.989214:0:8451:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740349.989236:0:8451:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088360182/0xb25dda4f4e92e170 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23d3a expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.989268:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c130e9a4/0xb25dda4f4e92e169 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d33 expref: 7 pid: 9806 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.989276:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790740349.989281:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790740349.989287:0:8451:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088360182/0xb25dda4f4e92e170 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d3a expref: 7 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.989320:0:8451:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c130e9a4/0xb25dda4f4e92e169 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d33 expref: 7 pid: 9806 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740349.989333:0:8451:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c130e9a4/0xb25dda4f4e92e169 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d33 expref: 7 pid: 9806 timeout: 521 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740349.989347:0:8451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc867d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8451:1877727022024704:192.168.204.3@tcp:104: 00000100:00100000:3.0:1790740349.989449:0:8451:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc86ae3e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790740349.992537:0:8451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc867d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8451:1877727022024704:192.168.204.3@tcp:104: 00010000:00010000:1.0:1790740349.992576:0:8451:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088360182/0xb25dda4f4e92e170 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d3a expref: 7 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740349.992597:0:8451:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc8200, rc 0) 00000100:00100000:1.0:1790740349.992683:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84524e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bed19f2-4c98-4684-89e7-a6871565665d+7:11304:x1877727000968704:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 3490us (3807us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740349.992692:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 36 00000100:00100000:1.0:1790740350.006147:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740350.007893:0:6520:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000968832 00000100:00100000:3.0:1790740350.007936:0:6520:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000968832 00010000:00010000:3.0:1790740350.007996:0:6520:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c130e9a4/0xb25dda4f4e92e169 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d33 expref: 7 pid: 9806 timeout: 521 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740350.008088:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 59 00000100:00100000:3.0:1790740350.008098:0:6520:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc2a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7bed19f2-4c98-4684-89e7-a6871565665d+7:2402:x1877727000968832:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790740350.008114:0:6520:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740350.008136:0:6520:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c130e9a4/0xb25dda4f4e92e169 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d33 expref: 7 pid: 9806 timeout: 521 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740350.008150:0:6520:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c130e9a4/0xb25dda4f4e92e169 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d33 expref: 7 pid: 9806 timeout: 521 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740350.008204:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c130e9a4/0xb25dda4f4e92e169 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d33 expref: 7 pid: 9806 timeout: 521 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740350.008222:0:6520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790740350.008227:0:6520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790740350.008235:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088360182/0xb25dda4f4e92e170 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d3a expref: 6 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740350.008246:0:6520:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088360182/0xb25dda4f4e92e170 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d3a expref: 6 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740350.008287:0:6520:0:(ldlm_lockd.c:1085:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000088360182/0xb25dda4f4e92e170 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d3a expref: 6 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740350.008312:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc867d6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6520:1877727022024832:192.168.204.3@tcp:105: 00000100:00100000:3.0:1790740350.008398:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc86ae3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790740350.029011:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740350.029167:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc867d6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6520:1877727022024832:192.168.204.3@tcp:105: 00010000:00010000:3.0:1790740350.029195:0:6520:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740350.029248:0:6520:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc2a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7bed19f2-4c98-4684-89e7-a6871565665d+6:2402:x1877727000968832:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 21152us (23112us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740350.029261:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 59 00000100:00100000:1.0:1790740350.029284:0:8459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000968960 00000100:00100000:1.0:1790740350.029292:0:8459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000968960 00002000:00100000:1.0:1790740350.029334:0:8459:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff98db84526d80 x1877727000968960/t0(0) o4->7bed19f2-4c98-4684-89e7-a6871565665d@192.168.204.3@tcp:406/0 lens 504/0 e 0 to 0 dl 1790740361 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790740350.029345:0:8459:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98db84526d80 with x1877727000968960 ext(0->8) 00002000:00010000:1.0:1790740350.029350:0:8459:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98db84526d80 00000100:00100000:1.0:1790740350.029383:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 0 00000100:00100000:1.0:1790740350.029393:0:8459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84526d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7bed19f2-4c98-4684-89e7-a6871565665d+6:2403:x1877727000968960:12345-192.168.204.3@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1790740350.034554:0:8459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84526d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7bed19f2-4c98-4684-89e7-a6871565665d+8:2403:x1877727000968960:12345-192.168.204.3@tcp:4:lhsmtool_posix.0 Request processed in 5152us (5542us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1790740350.034569:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 0 00002000:00100000:1.0:1790740350.034582:0:8459:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff98db84526d80 x1877727000968960/t4294967303(0) o4->7bed19f2-4c98-4684-89e7-a6871565665d@192.168.204.3@tcp:406/0 lens 504/448 e 0 to 0 dl 1790740361 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790740350.034592:0:8459:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98db84526d80 with x1877727000968960 ext(0->8) 00002000:00010000:1.0:1790740350.034598:0:8459:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98db84526d80 00000100:00100000:0.0:1790740350.044291:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740350.044392:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000969088 00000100:00100000:2.0:1790740350.044404:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000969088 00000100:00100000:2.0:1790740350.044494:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 90 00000100:00100000:2.0:1790740350.044506:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+19:11304:x1877727000969088:12345-192.168.204.3@tcp:44:lhsmtool_posix.0 00000100:00080000:1.0:1790740350.044744:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1790740350.047793:0:6514:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:0.0:1790740350.047810:0:6514:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1790740350.047843:0:6514:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00010000:00010000:3.0:1790740350.047925:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e146 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740350.047947:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e146 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740350.047957:0:3624:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e146 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1790740350.047957:0:6567:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:3.0:1790740350.047974:0:3624:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f33200 already unused, calling callback (ffffffffc19674f0) 00000020:00080000:2.0:1790740350.047977:0:6567:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:3.0:1790740350.047981:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e146 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740350.047991:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e146 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740350.048020:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98dc887e4000) 00010000:00010000:3.0:1790740350.048024:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790740350.048077:0:3624:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e146 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740350.048118:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e146 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740350.048208:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+14:11304:x1877727000969088:12345-192.168.204.3@tcp:44:lhsmtool_posix.0 Request processed in 3697us (3918us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740350.048220:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 90 00000100:00100000:2.0:1790740350.048512:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfc2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022024960:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1790740350.048573:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740350.052881:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022024960 00000100:00100000:0.0:1790740350.052898:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022024960 00000100:00100000:0.0:1790740350.052984:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790740350.052993:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc884b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022024960:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1790740350.053094:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00080000:3.0:1790740350.053194:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790740350.053223:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000969216 00000100:00100000:3.0:1790740350.053228:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000969216 00000100:00100000:3.0:1790740350.053267:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 38 00000100:00100000:3.0:1790740350.053275:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bed19f2-4c98-4684-89e7-a6871565665d+8:2402:x1877727000969216:12345-192.168.204.3@tcp:16:lhsmtool_posix.0 00002000:00010000:1.0:1790740350.053454:0:9806:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1790740350.053459:0:9806:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1790740350 00002000:00010000:1.0:1790740350.053461:0:9806:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1790740350.053464:0:9806:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1790740350 -> 1790740350 00002000:00010000:1.0:1790740350.053479:0:9806:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1790740350.053546:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc884b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3641:x1877727022024960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 554us (4971us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1790740350.053554:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:2.0:1790740350.054675:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98dcbfc2b800/2, rc 0, transno 4294967304 00000100:00100000:2.0:1790740350.054686:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfc2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022024960:0@lo:2:osp-syn-0-0.0 00000001:00080000:2.0:1790740350.055554:0:8446:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:2.0:1790740350.055567:0:8446:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:2.0:1790740350.071960:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022025088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790740350.072088:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740350.072257:0:10118:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022025088 00000100:00100000:0.0:1790740350.072266:0:10118:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022025088 00000100:00100000:0.0:1790740350.072340:0:10118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1790740350.072350:0:10118:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc884b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022025088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790740350.072379:0:10118:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:0.0:1790740350.072449:0:10118:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc884b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022025088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740350.072457:0:10118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1790740350.074375:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1790740350.074387:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98dcbfc2b800, transno 4294967304 00000100:00100000:2.0:1790740350.074432:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022025088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790740350.074835:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022025216:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790740350.074922:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740350.075010:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022025216 00000100:00100000:0.0:1790740350.075018:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022025216 00000100:00100000:0.0:1790740350.075097:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1790740350.075106:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022025216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790740350.075133:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:0.0:1790740350.075179:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022025216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740350.075186:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:1.0:1790740350.075266:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790740350.075292:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022025216:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790740350.075807:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bed19f2-4c98-4684-89e7-a6871565665d+6:2402:x1877727000969216:12345-192.168.204.3@tcp:16:lhsmtool_posix.0 Request processed in 22530us (22713us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740350.075818:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 38 00000100:00100000:3.0:1790740350.081669:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740350.084544:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000969472 00000100:00100000:2.0:1790740350.084563:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000969472 00000100:00100000:2.0:1790740350.084636:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 91 00000100:00100000:2.0:1790740350.084645:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc867d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+14:11304:x1877727000969472:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790740350.084694:0:6536:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740350.084719:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92e162 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d2c expref: 14 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740350.084738:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98dc887e4000) 00010000:00010000:2.0:1790740350.084743:0:6536:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790740350.084770:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92e177 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740350.084796:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92e177 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740350.084805:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92e177 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790740350.084941:0:6536:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000024fccd7 reply state 00000000514f7ebd transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92e177 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740350.084953:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92e177 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740350.084960:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98dc887e4000) 00010000:00010000:2.0:1790740350.084962:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790740350.084965:0:6536:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790740350.085090:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc867d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+15:11304:x1877727000969472:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 Request processed in 446us (3435us total) trans 4294967357 rc 0/0 00000100:00100000:2.0:1790740350.085096:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 91 00000100:00100000:0.0:1790740350.093182:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740350.094460:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000969600 00000100:00100000:2.0:1790740350.094473:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000969600 00000100:00100000:2.0:1790740350.094623:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 39 00000100:00100000:2.0:1790740350.094636:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bed19f2-4c98-4684-89e7-a6871565665d+6:2403:x1877727000969600:12345-192.168.204.3@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1790740350.094824:0:8453:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1790740350.094829:0:8453:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1790740350 -> 1790740348 00002000:00010000:2.0:1790740350.094831:0:8453:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1790740346 00002000:00010000:2.0:1790740350.094834:0:8453:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1790740350 -> 1790740348 00002000:00010000:2.0:1790740350.094836:0:8453:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1790740350.095383:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bed19f2-4c98-4684-89e7-a6871565665d+7:2403:x1877727000969600:12345-192.168.204.3@tcp:2:lhsmtool_posix.0 Request processed in 748us (2208us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1790740350.095409:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 39 00000100:00100000:3.0:1790740350.101785:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740350.102500:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000969856 00000100:00100000:1.0:1790740350.102682:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000969856 00000100:00100000:1.0:1790740350.102796:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 92 00000100:00100000:1.0:1790740350.102808:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83c50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+15:11304:x1877727000969856:12345-192.168.204.3@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1790740350.102901:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e17e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740350.102934:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060200/0xb25dda4f4e92e13f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d1e expref: 15 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740350.102944:0:6537:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e17e lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740350.102989:0:6537:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060200/0xb25dda4f4e92e13f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d1e expref: 15 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740350.103006:0:6537:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060200/0xb25dda4f4e92e13f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d1e expref: 15 pid: 6537 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740350.103022:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6537:1877727022025344:192.168.204.3@tcp:104: 00000100:00100000:1.0:1790740350.103163:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82e52b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790740350.108626:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740350.108969:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000969984 00000100:00100000:0.0:1790740350.108981:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000969984 00010000:00010000:0.0:1790740350.109024:0:6521:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060200/0xb25dda4f4e92e13f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d1e expref: 16 pid: 6537 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740350.109085:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 60 00000100:00100000:0.0:1790740350.109094:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc81324700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7bed19f2-4c98-4684-89e7-a6871565665d+16:2402:x1877727000969984:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790740350.109108:0:6521:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740350.109114:0:6521:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060200/0xb25dda4f4e92e13f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d1e expref: 16 pid: 6537 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740350.109128:0:6521:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060200/0xb25dda4f4e92e13f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d1e expref: 16 pid: 6537 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740350.109152:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98dc887e4000) 00010000:00010000:0.0:1790740350.109170:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e17e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740350.109181:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e17e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740350.109189:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e17e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740350.109210:0:6521:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740350.109264:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc81324700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7bed19f2-4c98-4684-89e7-a6871565665d+16:2402:x1877727000969984:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 170us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740350.109273:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 60 00010000:00010000:1.0:1790740350.113268:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060200/0xb25dda4f4e92e13f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d1e expref: 15 pid: 6537 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740350.113297:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6537:1877727022025344:192.168.204.3@tcp:104: 00010000:00010000:1.0:1790740350.113320:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e17e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740350.113587:0:6537:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e17e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740350.113593:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e17e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740350.113638:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e17e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740350.113645:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e17e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740350.113653:0:6537:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e17e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740350.113659:0:6537:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc45800 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740350.113663:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e17e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740350.113670:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e17e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740350.113687:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98dc887e4000) 00010000:00010000:1.0:1790740350.113707:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1790740350.113713:0:6537:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e17e lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740350.113719:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e17e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740350.114006:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83c50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+14:11304:x1877727000969856:12345-192.168.204.3@tcp:55:lhsmtool_posix.0 Request processed in 11197us (12230us total) trans 0 rc -22/-22 00000100:00100000:1.0:1790740350.114017:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 92 00000100:00100000:3.0:1790740350.119438:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740350.119540:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000970112 00000100:00100000:1.0:1790740350.119551:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000970112 00000100:00100000:1.0:1790740350.119609:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 40 00000100:00100000:1.0:1790740350.119620:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc81325500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7bed19f2-4c98-4684-89e7-a6871565665d+7:2403:x1877727000970112:12345-192.168.204.3@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1790740350.119667:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004ea21cfa/0xb25dda4f4e92e185 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740350.119695:0:9806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088360182/0xb25dda4f4e92e170 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d3a expref: 7 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740350.119704:0:9806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790740350.119709:0:9806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790740350.119714:0:9806:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ea21cfa/0xb25dda4f4e92e185 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740350.119757:0:9806:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000088360182/0xb25dda4f4e92e170 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d3a expref: 7 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740350.119791:0:9806:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000088360182/0xb25dda4f4e92e170 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d3a expref: 7 pid: 8451 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740350.119805:0:9806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9806:1877727022025472:192.168.204.3@tcp:104: 00000100:00100000:1.0:1790740350.119928:0:9806:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82e52b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790740350.127405:0:9806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9806:1877727022025472:192.168.204.3@tcp:104: 00010000:00010000:1.0:1790740350.127436:0:9806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004ea21cfa/0xb25dda4f4e92e185 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740350.128226:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740350.130931:0:9550:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000970240 00000100:00100000:1.0:1790740350.130949:0:9550:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000970240 00010000:00010000:1.0:1790740350.131006:0:9550:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000088360182/0xb25dda4f4e92e170 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d3a expref: 8 pid: 8451 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740350.131173:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 61 00000100:00100000:1.0:1790740350.131183:0:9550:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc81324000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7bed19f2-4c98-4684-89e7-a6871565665d+8:2402:x1877727000970240:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740350.131198:0:9550:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740350.131218:0:9550:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000088360182/0xb25dda4f4e92e170 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d3a expref: 8 pid: 8451 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740350.131232:0:9550:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000088360182/0xb25dda4f4e92e170 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d3a expref: 8 pid: 8451 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740350.131253:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088360182/0xb25dda4f4e92e170 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d3a expref: 8 pid: 8451 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740350.131301:0:9550:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790740350.131305:0:9550:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790740350.131311:0:9550:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004ea21cfa/0xb25dda4f4e92e185 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740350.131320:0:9550:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ea21cfa/0xb25dda4f4e92e185 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740350.131360:0:9550:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740350.131433:0:9550:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc81324000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7bed19f2-4c98-4684-89e7-a6871565665d+7:2402:x1877727000970240:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 251us (3210us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740350.131441:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 61 00010000:00010000:3.0:1790740350.131704:0:9806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004ea21cfa/0xb25dda4f4e92e185 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740350.131715:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ea21cfa/0xb25dda4f4e92e185 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740350.131740:0:9806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004ea21cfa/0xb25dda4f4e92e185 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740350.131749:0:9806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ea21cfa/0xb25dda4f4e92e185 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740350.131764:0:9806:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ea21cfa/0xb25dda4f4e92e185 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740350.131772:0:9806:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc45800 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:3.0:1790740350.131777:0:9806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ea21cfa/0xb25dda4f4e92e185 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740350.131787:0:9806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ea21cfa/0xb25dda4f4e92e185 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740350.131799:0:9806:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ea21cfa/0xb25dda4f4e92e185 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740350.131806:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ea21cfa/0xb25dda4f4e92e185 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740350.131872:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc81325500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7bed19f2-4c98-4684-89e7-a6871565665d+6:2403:x1877727000970112:12345-192.168.204.3@tcp:1:lhsmtool_posix.0 Request processed in 12253us (12446us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740350.131880:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 40 00000100:00100000:2.0:1790740350.136788:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740350.136898:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000970496 00000100:00100000:0.0:1790740350.136918:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000970496 00000100:00100000:0.0:1790740350.136984:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 93 00000100:00100000:0.0:1790740350.136994:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc884b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+14:11304:x1877727000970496:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1790740350.137112:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e18c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740350.137132:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92dfcc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cc3 expref: 14 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740350.137142:0:6535:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e18c lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740350.137180:0:6535:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92dfcc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cc3 expref: 14 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740350.137195:0:6535:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92dfcc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cc3 expref: 14 pid: 6536 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740350.137227:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84524000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6535:1877727022025600:192.168.204.3@tcp:104: 00000100:00100000:0.0:1790740350.137323:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83d05240 going to sleep for 11 seconds 00000100:00100000:2.0:1790740350.144184:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84524000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6535:1877727022025600:192.168.204.3@tcp:104: 00010000:00010000:2.0:1790740350.144216:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e18c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740350.147855:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740350.148064:0:6520:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000970624 00000100:00100000:3.0:1790740350.148074:0:6520:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000970624 00010000:00010000:3.0:1790740350.148119:0:6520:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92dfcc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cc3 expref: 15 pid: 6536 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740350.148153:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 62 00000100:00100000:3.0:1790740350.148177:0:6520:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc86ac1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7bed19f2-4c98-4684-89e7-a6871565665d+15:2403:x1877727000970624:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790740350.148193:0:6520:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740350.148200:0:6520:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92dfcc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cc3 expref: 15 pid: 6536 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740350.148213:0:6520:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92dfcc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cc3 expref: 15 pid: 6536 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740350.148234:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92dfcc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23cc3 expref: 15 pid: 6536 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740350.148250:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf045700) 00010000:00010000:3.0:1790740350.148255:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e18c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740350.148276:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e18c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740350.148284:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e18c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740350.148317:0:6520:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740350.148382:0:6520:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc86ac1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7bed19f2-4c98-4684-89e7-a6871565665d+14:2403:x1877727000970624:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 206us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740350.148390:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 62 00010000:00010000:2.0:1790740350.149096:0:6535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e18c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740350.149107:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e18c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740350.149300:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92e193 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740350.149314:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e14d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d25 expref: 14 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740350.149322:0:6535:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92e193 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740350.149385:0:6535:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e14d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d25 expref: 14 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740350.149401:0:6535:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e14d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d25 expref: 14 pid: 6536 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740350.149417:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6535:1877727022025728:192.168.204.3@tcp:104: 00000100:00100000:2.0:1790740350.149504:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc909bf3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790740350.156335:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6535:1877727022025728:192.168.204.3@tcp:104: 00010000:00010000:0.0:1790740350.156372:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92e193 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740350.157210:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740350.157365:0:10416:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000970752 00000100:00100000:2.0:1790740350.157374:0:10416:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000970752 00010000:00010000:2.0:1790740350.157418:0:10416:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e14d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d25 expref: 15 pid: 6536 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740350.157462:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 63 00000100:00100000:2.0:1790740350.157471:0:10416:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7bed19f2-4c98-4684-89e7-a6871565665d+15:2402:x1877727000970752:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790740350.157485:0:10416:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740350.157492:0:10416:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e14d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d25 expref: 15 pid: 6536 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740350.157505:0:10416:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e14d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d25 expref: 15 pid: 6536 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740350.157537:0:10416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e14d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d25 expref: 15 pid: 6536 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740350.157553:0:10416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98dc887e4000) 00010000:00010000:2.0:1790740350.157559:0:10416:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92e193 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740350.157568:0:10416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92e193 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740350.157577:0:10416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92e193 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740350.157606:0:10416:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740350.157672:0:10416:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7bed19f2-4c98-4684-89e7-a6871565665d+14:2402:x1877727000970752:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 201us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740350.157681:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 63 00010000:00010000:1.0:1790740350.158671:0:6535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92e193 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740350.158685:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92e193 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790740350.158803:0:6535:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:1.0:1790740350.158959:0:6535:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:1.0:1790740350.158995:0:6535:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:1.0:1790740350.159134:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfd00e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6535:1877727022025856:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1790740350.159188:0:6535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740350.159212:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82e52840 going to sleep for 11 seconds 00000100:00100000:0.0:1790740350.159472:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022025856 00000100:00100000:0.0:1790740350.159480:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022025856 00000100:00100000:0.0:1790740350.159539:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1790740350.159550:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfd01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6535:x1877727022025856:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1790740350.159637:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfd01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6535:x1877727022025856:12345-0@lo:1000:mdt00_000.0 Request processed in 89us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740350.159645:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1790740350.159850:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfd00e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6535:1877727022025856:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1790740350.159997:0:6535:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:2.0:1790740350.160069:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6535:1877727022025984:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1790740350.160104:0:6535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740350.160136:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc909bf300 going to sleep for 11 seconds 00000100:00100000:1.0:1790740350.160653:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022025984 00000100:00100000:1.0:1790740350.160658:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022025984 00000100:00100000:1.0:1790740350.160713:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1790740350.160721:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6535:x1877727022025984:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1790740350.161129:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6535:x1877727022025984:12345-0@lo:1000:mdt00_000.0 Request processed in 408us (1023us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1790740350.161137:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1790740350.168219:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6535:1877727022025984:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1790740350.169213:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92e193 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740350.169227:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92e193 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740350.169235:0:6535:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92e193 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740350.169241:0:6535:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f32400 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:0.0:1790740350.169585:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92e193 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740350.169600:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92e193 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740350.169642:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98dc887e4000) 00010000:00010000:0.0:1790740350.169644:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790740350.169651:0:6535:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92e193 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740350.169657:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92e193 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740350.169695:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92e0c8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740350.169702:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92e0c8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740350.169707:0:6535:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92e0c8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740350.169712:0:6535:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc45400 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:0.0:1790740350.169715:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92e0c8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740350.169720:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92e0c8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740350.169726:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf045700) 00010000:00010000:0.0:1790740350.169728:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790740350.169731:0:6535:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92e0c8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740350.169736:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92e0c8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740350.169798:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e19a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740350.169814:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92e0e4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d09 expref: 17 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740350.170689:0:6535:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e19a lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740350.170737:0:6535:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92e0e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d09 expref: 17 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740350.170756:0:6535:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92e0e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d09 expref: 17 pid: 7760 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740350.170773:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84527480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6535:1877727022026112:192.168.204.3@tcp:104: 00000100:00100000:0.0:1790740350.173462:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83d05c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790740350.184890:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740350.185082:0:9550:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000970880 00000100:00100000:1.0:1790740350.185092:0:9550:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000970880 00010000:00010000:1.0:1790740350.185136:0:9550:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92e0e4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d09 expref: 18 pid: 7760 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740350.185175:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 64 00000100:00100000:1.0:1790740350.185185:0:9550:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc81324700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7bed19f2-4c98-4684-89e7-a6871565665d+18:2402:x1877727000970880:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740350.185200:0:9550:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740350.185208:0:9550:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92e0e4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d09 expref: 18 pid: 7760 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740350.185223:0:9550:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92e0e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d09 expref: 18 pid: 7760 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740350.185259:0:9550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf045700) 00010000:00010000:1.0:1790740350.185266:0:9550:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e19a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740350.185277:0:9550:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e19a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740350.185286:0:9550:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e19a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740350.185454:0:9550:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740350.185507:0:9550:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc81324700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7bed19f2-4c98-4684-89e7-a6871565665d+18:2402:x1877727000970880:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 322us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740350.185599:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 64 00010000:00010000:0.0:1790740350.186601:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92e0e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d09 expref: 17 pid: 7760 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740350.186623:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84527480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6535:1877727022026112:192.168.204.3@tcp:104: 00010000:00010000:0.0:1790740350.186647:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e19a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740350.186658:0:6535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e19a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740350.186665:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e19a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740350.186688:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e19a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740350.186696:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e19a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740350.186703:0:6535:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e19a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740350.186709:0:6535:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf061c00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:0.0:1790740350.186713:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e19a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740350.186720:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e19a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740350.186734:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf045700) 00010000:00010000:0.0:1790740350.186736:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740350.186741:0:6535:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e19a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740350.186747:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e19a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740350.186757:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e18c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740350.186763:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e18c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740350.187440:0:6535:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e18c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740350.187459:0:6535:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf061a00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:0.0:1790740350.187463:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e18c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740350.187471:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e18c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740350.187481:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf045700) 00010000:00010000:0.0:1790740350.187483:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790740350.187487:0:6535:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e18c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740350.187493:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e18c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740350.187955:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc884b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+16:11304:x1877727000970496:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 Request processed in 50958us (51175us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1790740350.187968:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 93 00000020:00080000:0.0:1790740350.187975:0:6535:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1790740350.193919:0:13821:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790740350.193933:0:13821:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790740350.193955:0:13821:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1790740350.193962:0:13821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790740350.197180:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740350.197319:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000971136 00000100:00100000:0.0:1790740350.197344:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000971136 00000100:00100000:0.0:1790740350.197408:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 20 00000100:00100000:0.0:1790740350.197418:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc81324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+16:11304:x1877727000971136:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1790740350.197691:0:6539:0:(mdd_object.c:4180:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1790740350.197723:0:6539:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:0.0:1790740350.197756:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e1a1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740350.197784:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e1a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740350.197828:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e1a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740350.197837:0:6539:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e1a1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740350.197843:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e1a1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740350.197850:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e1a1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740350.198252:0:6539:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790740350.198359:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc81324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+18:11304:x1877727000971136:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 Request processed in 940us (1187us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1790740350.198367:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 20 00000020:00080000:0.0:1790740350.198372:0:6539:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790740350.199878:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740350.199892:0:6524:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e1a1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740350.199911:0:6524:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf061c00 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:3.0:1790740350.199916:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e1a1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740350.199927:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e1a1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740350.199945:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98dc887e4000) 00010000:00010000:3.0:1790740350.199948:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790740350.199953:0:6524:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e1a1 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740350.199959:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e1a1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740350.200060:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740350.200063:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740350.200065:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740350.445139:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740351.386856:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740351.386925:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740351.386955:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740351.386978:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740351.386998:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740351.387014:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740351.387062:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740351.387099:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000971264 00000100:00100000:2.0:1790740351.387111:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000971264 00000100:00100000:2.0:1790740351.387156:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 382 00000100:00100000:2.0:1790740351.387165:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:2402:x1877727000971264:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1790740351.387231:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:2402:x1877727000971264:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 67us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740351.387237:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 382 00000100:00100000:2.0:1790740351.387266:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000971392 00000100:00100000:2.0:1790740351.387269:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000971392 00000100:00100000:2.0:1790740351.387294:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000971904 00000100:00100000:2.0:1790740351.387296:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000971904 00000100:00100000:2.0:1790740351.387315:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000971520 00000100:00100000:2.0:1790740351.387318:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000971520 00000100:00100000:2.0:1790740351.387341:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000972032 00000100:00100000:2.0:1790740351.387343:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000972032 00000100:00100000:2.0:1790740351.387356:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 289 00000100:00100000:2.0:1790740351.387362:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+18:2403:x1877727000971392:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1790740351.387394:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+18:2403:x1877727000971392:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 33us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740351.387399:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 289 00000100:00100000:2.0:1790740351.387409:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 290 00000100:00100000:2.0:1790740351.387414:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2403:x1877727000971904:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1790740351.387431:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2403:x1877727000971904:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 17us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740351.387436:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 290 00000100:00100000:2.0:1790740351.387446:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 291 00000100:00100000:2.0:1790740351.387451:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+5:2402:x1877727000971520:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1790740351.387468:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+5:2402:x1877727000971520:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 18us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740351.387473:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 291 00000100:00100000:2.0:1790740351.387482:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 292 00000100:00100000:2.0:1790740351.387487:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2402:x1877727000972032:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1790740351.387503:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2402:x1877727000972032:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 17us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740351.387508:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 292 00000100:00100000:2.0:1790740351.387522:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000971648 00000100:00100000:2.0:1790740351.387525:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000971648 00000100:00100000:2.0:1790740351.387545:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000971776 00000100:00100000:2.0:1790740351.387553:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000971776 00000100:00100000:2.0:1790740351.387572:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 115 00000100:00100000:2.0:1790740351.387578:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bed19f2-4c98-4684-89e7-a6871565665d+6:2403:x1877727000971648:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1790740351.387603:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bed19f2-4c98-4684-89e7-a6871565665d+6:2403:x1877727000971648:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 26us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740351.387609:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 115 00000100:00100000:2.0:1790740351.387621:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 116 00000100:00100000:2.0:1790740351.387627:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bed19f2-4c98-4684-89e7-a6871565665d+7:2402:x1877727000971776:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1790740351.387648:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bed19f2-4c98-4684-89e7-a6871565665d+7:2402:x1877727000971776:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 21us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740351.387653:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 116 00000100:00080000:2.0:1790740351.387672:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790740351.387676:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790740351.387679:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790740351.387681:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790740351.467256:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740351.596976:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022026240:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790740351.597076:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740351.597259:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022026240 00000100:00100000:2.0:1790740351.597267:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022026240 00000100:00100000:2.0:1790740351.597324:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1790740351.597333:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022026240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790740351.597361:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790740351.597399:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022026240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740351.597407:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:2.0:1790740351.597427:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790740351.597444:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3641:1877727022026368:0@lo:400:kworker.0 00000100:00100000:2.0:1790740351.597476:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740351.597499:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022026880:0@lo:400:kworker.0 00000100:00100000:2.0:1790740351.597522:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740351.597539:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db845bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022027392:0@lo:400:kworker.0 00000100:00100000:1.0:1790740351.597557:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727022026496:0@lo:400:kworker.0 00000100:00100000:2.0:1790740351.597560:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740351.597579:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1790740351.597584:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877727022026752:0@lo:400:kworker.0 00000100:00100000:1.0:1790740351.597589:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740351.597604:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740351.597608:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877727022027008:0@lo:400:kworker.0 00000100:00100000:2.0:1790740351.597618:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022027264:0@lo:400:kworker.0 00000100:00100000:1.0:1790740351.597626:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740351.597633:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740351.597639:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db845be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1877727022027520:0@lo:400:kworker.0 00000100:00100000:2.0:1790740351.597646:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db845bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022027776:0@lo:400:kworker.0 00000100:00100000:1.0:1790740351.597658:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740351.597661:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740351.597675:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1790740351.597680:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022026624:0@lo:400:kworker.0 00000100:00100000:2.0:1790740351.597683:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022026368 00000100:00100000:2.0:1790740351.597686:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022026368 00000100:00100000:2.0:1790740351.597711:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1790740351.597711:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740351.597717:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3641:x1877727022026368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740351.597729:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1877727022027136:0@lo:400:kworker.0 00000100:00100000:2.0:1790740351.597749:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3641:x1877727022026368:12345-0@lo:400:kworker.0 Request processed in 32us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740351.597750:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740351.597756:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1790740351.597765:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db845be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1877727022027648:0@lo:400:kworker.0 00000100:00100000:2.0:1790740351.597780:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022027392 00000100:00100000:1.0:1790740351.597782:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740351.597783:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022027392 00000100:00100000:2.0:1790740351.597805:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022027264 00000100:00100000:2.0:1790740351.597808:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022027264 00000100:00100000:2.0:1790740351.597819:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022027776 00000100:00100000:2.0:1790740351.597821:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022027776 00000100:00100000:2.0:1790740351.597860:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1790740351.597873:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1877727022027392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740351.597918:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1877727022027392:12345-0@lo:400:kworker.0 Request processed in 46us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740351.597924:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1790740351.597937:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1790740351.597942:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022027264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740351.597981:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022027264:12345-0@lo:400:kworker.0 Request processed in 38us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740351.597987:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1790740351.597998:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1790740351.598004:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3641:x1877727022027776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740351.598023:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022026496 00000100:00100000:1.0:1790740351.598027:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022026496 00000100:00100000:2.0:1790740351.598047:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3641:x1877727022027776:12345-0@lo:400:kworker.0 Request processed in 26us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740351.598053:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1790740351.598069:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022026752 00000100:00100000:1.0:1790740351.598069:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022027008 00000100:00100000:2.0:1790740351.598072:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022026752 00000100:00100000:1.0:1790740351.598078:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022027008 00000100:00100000:2.0:1790740351.598085:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022027520 00000100:00100000:2.0:1790740351.598087:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022027520 00000100:00100000:1.0:1790740351.598092:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022027136 00000100:00100000:1.0:1790740351.598094:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022027136 00000100:00100000:2.0:1790740351.598097:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022027648 00000100:00100000:2.0:1790740351.598098:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022027648 00000100:00100000:1.0:1790740351.598107:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1790740351.598110:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1790740351.598112:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfd02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727022026496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740351.598115:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877727022026752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740351.598142:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877727022026752:12345-0@lo:400:kworker.0 Request processed in 26us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740351.598145:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfd02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727022026496:12345-0@lo:400:kworker.0 Request processed in 34us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740351.598148:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1790740351.598151:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1790740351.598159:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1790740351.598162:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1790740351.598164:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfd00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877727022027008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740351.598166:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfd00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877727022027520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740351.598191:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfd00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877727022027008:12345-0@lo:400:kworker.0 Request processed in 26us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740351.598191:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfd00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877727022027520:12345-0@lo:400:kworker.0 Request processed in 24us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740351.598197:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1790740351.600111:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1790740351.600152:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1790740351.600166:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877727022027136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740351.600274:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877727022027136:12345-0@lo:400:kworker.0 Request processed in 114us (2522us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740351.600282:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1790740351.600296:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1790740351.600303:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877727022027648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740351.600333:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877727022027648:12345-0@lo:400:kworker.0 Request processed in 31us (2549us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740351.600339:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00080000:2.0:1790740351.600465:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790740351.600471:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790740351.600475:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790740351.600524:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022026240:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790740351.600564:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877727022026752:0@lo:400:kworker.0 00000100:00100000:2.0:1790740351.600577:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022027264:0@lo:400:kworker.0 00000100:00100000:2.0:1790740351.600591:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db845bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022027776:0@lo:400:kworker.0 00000100:00100000:2.0:1790740351.600600:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3641:1877727022026368:0@lo:400:kworker.0 00000100:00100000:2.0:1790740351.600611:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db845bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022027392:0@lo:400:kworker.0 00000100:00100000:2.0:1790740351.600675:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022026880 00000100:00100000:2.0:1790740351.600691:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022026880 00000100:00100000:2.0:1790740351.600728:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022026624 00000100:00100000:2.0:1790740351.600732:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022026624 00000100:00100000:2.0:1790740351.600745:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1790740351.600751:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022026880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740351.600792:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022026880:12345-0@lo:400:kworker.0 Request processed in 41us (3269us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740351.600799:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1790740351.600811:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1790740351.600817:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022026624:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1790740351.602709:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcbfe2f100 x1877727022027136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740351.602727:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1877727022027136:0@lo:400:kworker.0 00010000:00080000:1.0:1790740351.602741:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db845be680 x1877727022027648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740351.602749:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db845be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1877727022027648:0@lo:400:kworker.0 00000100:00100000:1.0:1790740351.602762:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727022026496:0@lo:400:kworker.0 00000100:00100000:1.0:1790740351.602773:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877727022027008:0@lo:400:kworker.0 00000100:00100000:1.0:1790740351.602785:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db845be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1877727022027520:0@lo:400:kworker.0 00000100:00100000:1.0:1790740351.603015:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022026880:0@lo:400:kworker.0 00000100:00100000:2.0:1790740351.603123:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022026624:12345-0@lo:400:kworker.0 Request processed in 2305us (5409us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740351.603133:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1790740351.603968:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022026624:0@lo:400:kworker.0 00000100:00100000:2.0:1790740351.609119:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790740351.609143:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db845bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022027904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790740351.609214:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740351.611559:0:10118:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022027904 00000100:00100000:1.0:1790740351.611577:0:10118:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022027904 00000100:00100000:1.0:1790740351.611642:0:10118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1790740351.611653:0:10118:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1877727022027904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790740351.611681:0:10118:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790740351.611768:0:10118:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1877727022027904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (2554us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740351.611775:0:10118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1790740351.611831:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db845bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022027904:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1790740351.708241:0:14282:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790740351.708253:0:14282:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790740351.708276:0:14282:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1790740351.708282:0:14282:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790740351.870327:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740351.870402:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000972288 00000100:00100000:3.0:1790740351.870414:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000972288 00000100:00100000:3.0:1790740351.870475:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 94 00000100:00100000:3.0:1790740351.870485:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+18:11323:x1877727000972288:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:3.0:1790740351.870505:0:6536:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740351.870525:0:6536:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e1a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23d41 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740351.871069:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9000/0xb25dda4f4e92e1af lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740351.871100:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9000/0xb25dda4f4e92e1af lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740351.871114:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9000/0xb25dda4f4e92e1af lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740351.871127:0:6536:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1790740351.871252:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e1a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d41 expref: 21 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740351.871271:0:6536:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9000/0xb25dda4f4e92e1af lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d41 expref: 20 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740351.871280:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98dcaec70300) 00010000:00010000:3.0:1790740351.871283:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790740351.871288:0:6536:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc9000, rc 0) 00000100:00100000:3.0:1790740351.871353:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+20:11323:x1877727000972288:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 869us (1036us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1790740351.871361:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 94 00000100:00100000:0.0:1790740351.875815:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740351.876119:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000972416 00000100:00100000:1.0:1790740351.876129:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000972416 00000100:00100000:1.0:1790740351.876186:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 95 00000100:00100000:1.0:1790740351.876197:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+20:11323:x1877727000972416:12345-192.168.204.3@tcp:34:lfs.0 00010000:00010000:1.0:1790740351.876272:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e1bd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740351.876291:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e1bd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740351.876316:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e1bd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740351.876346:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e1c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740351.876354:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e1c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740351.876362:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e1c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740351.876447:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92e1cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740351.876456:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92e1cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740351.876462:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92e1cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790740351.876510:0:6537:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92e1cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740351.876523:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e1bd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740351.876530:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e1bd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740351.876537:0:6537:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e1bd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740351.876543:0:6537:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc44c00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740351.876548:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e1bd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740351.876562:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e1bd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740351.876587:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98dcaec70300) 00010000:00010000:1.0:1790740351.876590:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740351.876596:0:6537:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e1bd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740351.876602:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e1bd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740351.876615:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e1c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740351.876622:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e1c4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740351.876627:0:6537:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e1c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740351.876632:0:6537:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc45200 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740351.876635:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e1c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740351.876641:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e1c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740351.876648:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98dcaec70600) 00010000:00010000:1.0:1790740351.876651:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740351.876654:0:6537:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e1c4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740351.876670:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e1c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740351.876685:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92e1cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740351.876692:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92e1cb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740351.876698:0:6537:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92e1cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740351.876703:0:6537:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc45000 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740351.876706:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92e1cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740351.876712:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92e1cb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740351.876720:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaec70700) 00010000:00010000:1.0:1790740351.876722:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740351.876725:0:6537:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92e1cb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740351.876731:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92e1cb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740351.877409:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+20:11323:x1877727000972416:12345-192.168.204.3@tcp:34:lfs.0 Request processed in 1207us (1598us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740351.877420:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 95 00000100:00100000:1.0:1790740351.960926:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740351.961182:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000972672 00000100:00100000:3.0:1790740351.961192:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000972672 00000100:00100000:3.0:1790740351.961250:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 96 00000100:00100000:3.0:1790740351.961259:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+20:11326:x1877727000972672:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:3.0:1790740351.961282:0:13222:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740351.961302:0:13222:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e1d2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23d48 expref: -99 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740351.961401:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e1d9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740351.961415:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e1d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740351.961428:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e1d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740351.961442:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e1e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740351.961449:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e1e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740351.961456:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e1e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740351.961633:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e1e7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740351.961641:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e1e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740351.961648:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e1e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740351.961659:0:13222:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1790740351.961739:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e1d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740351.961756:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e1d9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740351.961763:0:13222:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e1d9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740351.961768:0:13222:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc8200 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740351.961773:0:13222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e1d9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740351.961780:0:13222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e1d9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740351.961804:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98dcaec70300) 00010000:00010000:3.0:1790740351.961806:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740351.961812:0:13222:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e1d9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740351.961956:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e1d9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740351.961970:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e1e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740351.961976:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e1e0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740351.961981:0:13222:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e1e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740351.961986:0:13222:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc9800 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740351.961996:0:13222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e1e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740351.962002:0:13222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e1e0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740351.962010:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98dcaf04cb00) 00010000:00010000:3.0:1790740351.962012:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740351.962015:0:13222:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e1e0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740351.962021:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e1e0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740351.962169:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e1d2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d48 expref: 23 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740351.962188:0:13222:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e1e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d48 expref: 22 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740351.962196:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf04c900) 00010000:00010000:3.0:1790740351.962198:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790740351.962200:0:13222:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc9c00, rc 0) 00000100:00100000:3.0:1790740351.962278:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+22:11326:x1877727000972672:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 1019us (1501us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1790740351.962286:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 96 00000100:00100000:0.0:1790740351.970066:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740351.970683:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000972800 00000100:00100000:3.0:1790740351.970760:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000972800 00000100:00100000:3.0:1790740351.970833:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 97 00000100:00100000:3.0:1790740351.970845:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+22:11326:x1877727000972800:12345-192.168.204.3@tcp:54:lfs.0 00010000:00010000:3.0:1790740351.970951:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e1f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740351.970969:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e1f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740351.970980:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e1f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740351.971020:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e1f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740351.971028:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e1f5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740351.971056:0:6536:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e1f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740351.971063:0:6536:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc8a00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740351.971068:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e1f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740351.971077:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e1f5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740351.971089:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf04c900) 00010000:00010000:3.0:1790740351.971092:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790740351.971097:0:6536:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e1f5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740351.971103:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e1f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740351.971255:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+22:11326:x1877727000972800:12345-192.168.204.3@tcp:54:lfs.0 Request processed in 412us (1237us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740351.971264:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 97 00000100:00100000:0.0:1790740351.989682:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740351.989837:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000973056 00000100:00100000:1.0:1790740351.989848:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000973056 00000100:00100000:1.0:1790740351.989929:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 21 00000100:00100000:1.0:1790740351.989939:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c82050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+22:11326:x1877727000973056:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:1.0:1790740351.990191:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c82050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+23:11326:x1877727000973056:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 253us (521us total) trans 4294967367 rc 0/0 00000100:00100000:1.0:1790740351.990199:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 21 00000100:00100000:0.0:1790740352.034977:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740352.035071:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000973312 00000100:00100000:3.0:1790740352.035082:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000973312 00000100:00100000:3.0:1790740352.035160:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 98 00000100:00100000:3.0:1790740352.035171:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+23:10845:x1877727000973312:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:3.0:1790740352.035196:0:7760:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740352.035219:0:7760:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e1fc lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23d4f expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.035349:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e203 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.035365:0:7760:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e1e7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d48 expref: 24 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.035374:0:7760:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e203 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.035407:0:7760:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e1e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d48 expref: 24 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.035421:0:7760:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e1e7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d48 expref: 24 pid: 13222 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740352.035434:0:7760:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc81326680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7760:1877727022028032:192.168.204.3@tcp:104: 00000100:00100000:3.0:1790740352.036201:0:7760:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc897fb840 going to sleep for 11 seconds 00000100:00080000:2.0:1790740352.036665:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790740352.041110:0:7760:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc81326680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7760:1877727022028032:192.168.204.3@tcp:104: 00010000:00010000:1.0:1790740352.041140:0:7760:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e203 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740352.041327:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740352.041671:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000973440 00000100:00100000:2.0:1790740352.041679:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000973440 00010000:00010000:2.0:1790740352.041926:0:6521:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e1e7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d48 expref: 25 pid: 13222 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740352.041971:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 65 00000100:00100000:2.0:1790740352.041982:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84526300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7bed19f2-4c98-4684-89e7-a6871565665d+25:2402:x1877727000973440:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790740352.041997:0:6521:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740352.042004:0:6521:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e1e7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d48 expref: 25 pid: 13222 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.042076:0:6521:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e1e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d48 expref: 25 pid: 13222 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.042099:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e1e7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d48 expref: 25 pid: 13222 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.042118:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf04c900) 00010000:00010000:2.0:1790740352.042123:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e203 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.042132:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e203 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.042140:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e203 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.042173:0:6521:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740352.042221:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84526300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7bed19f2-4c98-4684-89e7-a6871565665d+24:2402:x1877727000973440:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 241us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740352.042228:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 65 00010000:00010000:3.0:1790740352.042460:0:7760:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e203 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.042468:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e203 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740352.042542:0:7760:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1790740352.042677:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e1fc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d4f expref: 25 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.042938:0:7760:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e203 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d4f expref: 24 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.042946:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf04c900) 00010000:00010000:3.0:1790740352.042948:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790740352.042951:0:7760:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc9800, rc 0) 00000100:00100000:3.0:1790740352.042999:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+24:10845:x1877727000973312:12345-192.168.204.3@tcp:101:bash.0 Request processed in 7831us (8034us total) trans 4294967368 rc 0/0 00000100:00100000:3.0:1790740352.043007:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 98 00000100:00100000:0.0:1790740352.049306:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740352.049375:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000973568 00000100:00100000:3.0:1790740352.049385:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000973568 00000100:00100000:3.0:1790740352.049442:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 99 00000100:00100000:3.0:1790740352.049451:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+24:10845:x1877727000973568:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:3.0:1790740352.049475:0:13222:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740352.049495:0:13222:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e211 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23d56 expref: -99 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.049550:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e218 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.049573:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e218 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.049584:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e218 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.049689:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e211 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d56 expref: 26 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.049717:0:13222:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e218 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d56 expref: 25 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.049726:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf04c900) 00010000:00010000:3.0:1790740352.049729:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790740352.049733:0:13222:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc8200, rc 0) 00000100:00100000:3.0:1790740352.049793:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+25:10845:x1877727000973568:12345-192.168.204.3@tcp:101:bash.0 Request processed in 342us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740352.049800:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 99 00000100:00100000:0.0:1790740352.056520:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740352.057463:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000973824 00000100:00100000:3.0:1790740352.057474:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000973824 00000100:00100000:3.0:1790740352.057531:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 100 00000100:00100000:3.0:1790740352.057541:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84527100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+25:10845:x1877727000973824:12345-192.168.204.3@tcp:36:bash.0 00010000:00010000:3.0:1790740352.057970:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e21f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.058009:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e21f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.058021:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e21f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790740352.062547:0:6536:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:1.0:1790740352.062831:0:6536:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000009fae9d51 reply state 00000000ea85037c transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e21f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.062853:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e21f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.062863:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf04c900) 00010000:00010000:1.0:1790740352.062877:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790740352.062881:0:6536:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1790740352.062950:0:6536:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:1.0:1790740352.066288:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84527100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+29:10845:x1877727000973824:12345-192.168.204.3@tcp:36:bash.0 Request processed in 8734us (9764us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1790740352.066884:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 100 00000020:00080000:1.0:1790740352.066895:0:6536:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1790740352.074152:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740352.074235:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000973952 00000100:00100000:3.0:1790740352.074245:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000973952 00000100:00100000:3.0:1790740352.074312:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 101 00000100:00100000:3.0:1790740352.074321:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+29:10845:x1877727000973952:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:3.0:1790740352.074344:0:7760:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740352.074363:0:7760:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e226 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23d5d expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.074419:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e226 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d5d expref: 30 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.074434:0:7760:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e226 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d5d expref: 30 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.074451:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf04c900) 00010000:00010000:3.0:1790740352.074454:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790740352.074458:0:7760:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc9400, rc 0) 00000100:00100000:3.0:1790740352.074523:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+30:10845:x1877727000973952:12345-192.168.204.3@tcp:101:bash.0 Request processed in 203us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740352.074530:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 101 00000100:00100000:0.0:1790740352.078271:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740352.078433:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000974080 00000100:00100000:2.0:1790740352.078444:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000974080 00000100:00100000:2.0:1790740352.078524:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 41 00000100:00100000:2.0:1790740352.078534:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84527b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bed19f2-4c98-4684-89e7-a6871565665d+6:10845:x1877727000974080:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:2.0:1790740352.078551:0:8453:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740352.078572:0:8453:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b97c2dc8/0xb25dda4f4e92e22d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23d64 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790740352.078611:0:8453:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6abc877c, atime: 0x6abc877a, ctime: 0x6abc877c, blocks: 0x8 00010000:00010000:2.0:1790740352.078634:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=423s v=(0 0) 00010000:00010000:2.0:1790740352.078639:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740352.078648:0:8453:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b97c2dc8/0xb25dda4f4e92e22d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d64 expref: 7 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.078668:0:8453:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b97c2dc8/0xb25dda4f4e92e22d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d64 expref: 7 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.078680:0:8453:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f33400, rc 0) 00000100:00100000:2.0:1790740352.078743:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84527b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bed19f2-4c98-4684-89e7-a6871565665d+7:10845:x1877727000974080:12345-192.168.204.3@tcp:101:bash.0 Request processed in 211us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740352.078750:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 41 00000100:00100000:0.0:1790740352.082723:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740352.082959:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000974208 00000100:00100000:3.0:1790740352.082983:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000974208 00002000:00010000:3.0:1790740352.083073:0:8457:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:3.0:1790740352.083079:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98db84525500 with x1877727000974208 ext(0->18446744073709551615) 00002000:00010000:3.0:1790740352.083093:0:8457:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98db84525500. 00000100:00100000:3.0:1790740352.083121:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 1 00000100:00100000:3.0:1790740352.083131:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7bed19f2-4c98-4684-89e7-a6871565665d+7:2404:x1877727000974208:12345-192.168.204.3@tcp:10:bash.0 00002000:00010000:3.0:1790740352.083446:0:8457:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1790740352.083734:0:8457:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1790740348 -> 1790740352 00002000:00010000:3.0:1790740352.083736:0:8457:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1790740346 -> 1790740346 00002000:00010000:3.0:1790740352.083739:0:8457:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1790740348 -> 1790740352 00002000:00010000:3.0:1790740352.083741:0:8457:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1790740352.083810:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7bed19f2-4c98-4684-89e7-a6871565665d+8:2404:x1877727000974208:12345-192.168.204.3@tcp:10:bash.0 Request processed in 680us (1100us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1790740352.083909:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 1 00002000:00010000:3.0:1790740352.083914:0:8457:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:3.0:1790740352.083916:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98db84525500 with x1877727000974208 ext(0->18446744073709551615) 00002000:00010000:3.0:1790740352.083922:0:8457:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98db84525500. 00000100:00100000:0.0:1790740352.163944:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740352.164112:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000974336 00000100:00100000:1.0:1790740352.164122:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000974336 00000100:00100000:1.0:1790740352.164194:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 102 00000100:00100000:1.0:1790740352.164203:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+30:11340:x1877727000974336:12345-192.168.204.3@tcp:34:lfs.0 00010000:00010000:1.0:1790740352.164272:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e234 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.164289:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e234 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.164299:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e234 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.164313:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e23b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.164320:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e23b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.164327:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e23b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.164396:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44200/0xb25dda4f4e92e242 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.164405:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44200/0xb25dda4f4e92e242 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.164413:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44200/0xb25dda4f4e92e242 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790740352.164465:0:6537:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44200/0xb25dda4f4e92e242 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.164479:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e234 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.164492:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e234 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.164499:0:6537:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e234 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.164505:0:6537:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc45200 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740352.164509:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e234 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.164516:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e234 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.164528:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98dcaec70300) 00010000:00010000:1.0:1790740352.164531:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740352.164536:0:6537:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e234 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.164541:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e234 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.164556:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e23b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.164561:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e23b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.164566:0:6537:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e23b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.164571:0:6537:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc44c00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740352.164579:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e23b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.164585:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e23b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.164591:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98dcaec70700) 00010000:00010000:1.0:1790740352.164594:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740352.164596:0:6537:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e23b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.164601:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e23b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.164615:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44200/0xb25dda4f4e92e242 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.164621:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44200/0xb25dda4f4e92e242 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.164627:0:6537:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44200/0xb25dda4f4e92e242 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.164632:0:6537:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc44200 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740352.164634:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44200/0xb25dda4f4e92e242 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.164640:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44200/0xb25dda4f4e92e242 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.164646:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf04c900) 00010000:00010000:1.0:1790740352.164648:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740352.164657:0:6537:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44200/0xb25dda4f4e92e242 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.164664:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44200/0xb25dda4f4e92e242 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740352.164744:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+30:11340:x1877727000974336:12345-192.168.204.3@tcp:34:lfs.0 Request processed in 541us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740352.164751:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 102 00000100:00100000:0.0:1790740352.217075:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740352.217163:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000974592 00000100:00100000:1.0:1790740352.217173:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000974592 00000100:00100000:1.0:1790740352.217229:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 103 00000100:00100000:1.0:1790740352.217239:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+30:11343:x1877727000974592:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:1.0:1790740352.217260:0:6536:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740352.217279:0:6536:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44200/0xb25dda4f4e92e249 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23d6b expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.217360:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e250 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.217375:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e250 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.217387:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e250 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.217401:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e257 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.217409:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e257 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.217434:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e257 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.217549:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e25e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.217558:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e25e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.217565:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e25e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740352.217575:0:6536:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1790740352.217652:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e250 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.217660:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e250 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.217667:0:6536:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e250 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.217674:0:6536:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc44c00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740352.217679:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e250 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.217686:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e250 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.217697:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98dcaec70300) 00010000:00010000:1.0:1790740352.217701:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740352.217712:0:6536:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e250 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.217718:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e250 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.217733:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e257 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.217739:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e257 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.217745:0:6536:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e257 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.217750:0:6536:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc45200 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740352.217752:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e257 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.217758:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e257 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.217764:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98dcaec70700) 00010000:00010000:1.0:1790740352.217766:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740352.217769:0:6536:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e257 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.217774:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e257 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.217814:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44200/0xb25dda4f4e92e249 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d6b expref: 33 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.217839:0:6536:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e25e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d6b expref: 32 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.217846:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf04c900) 00010000:00010000:1.0:1790740352.217848:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1790740352.217851:0:6536:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcbfc45c00, rc 0) 00000100:00100000:1.0:1790740352.217927:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+32:11343:x1877727000974592:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 689us (860us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1790740352.217934:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 103 00000100:00100000:2.0:1790740352.222364:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740352.222443:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000974720 00000100:00100000:1.0:1790740352.222453:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000974720 00000100:00100000:1.0:1790740352.222516:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 104 00000100:00100000:1.0:1790740352.222525:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+32:11343:x1877727000974720:12345-192.168.204.3@tcp:54:lfs.0 00010000:00010000:1.0:1790740352.222596:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92e26c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.222614:0:13222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e203 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d4f expref: 32 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.222624:0:13222:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92e26c lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.222659:0:13222:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e203 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d4f expref: 32 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.222674:0:13222:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e203 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d4f expref: 32 pid: 7760 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740352.222705:0:13222:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db845c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13222:1877727022028160:192.168.204.3@tcp:104: 00000100:00100000:1.0:1790740352.222798:0:13222:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82e52540 going to sleep for 11 seconds 00000100:00100000:0.0:1790740352.227138:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740352.227242:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000974976 00000100:00100000:2.0:1790740352.227252:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000974976 00000100:00100000:2.0:1790740352.227321:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 22 00000100:00100000:2.0:1790740352.227331:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+33:6197:x1877727000974976:12345-192.168.204.3@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1790740352.227626:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+34:6197:x1877727000974976:12345-192.168.204.3@tcp:35:ldlm_bl.0 Request processed in 296us (500us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1790740352.227634:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 22 00000100:00100000:1.0:1790740352.228122:0:13222:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db845c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13222:1877727022028160:192.168.204.3@tcp:104: 00010000:00010000:1.0:1790740352.228149:0:13222:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92e26c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740352.231088:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740352.231188:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000975104 00000100:00100000:2.0:1790740352.231197:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000975104 00010000:00010000:2.0:1790740352.231238:0:6522:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e203 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d4f expref: 34 pid: 7760 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740352.231304:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 66 00000100:00100000:2.0:1790740352.231314:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7bed19f2-4c98-4684-89e7-a6871565665d+34:2402:x1877727000975104:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790740352.231329:0:6522:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740352.231337:0:6522:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e203 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d4f expref: 34 pid: 7760 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.231350:0:6522:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e203 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d4f expref: 34 pid: 7760 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.231373:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e203 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d4f expref: 34 pid: 7760 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.231392:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf04c900) 00010000:00010000:2.0:1790740352.231398:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92e26c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.231408:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92e26c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.231416:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92e26c lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.231446:0:6522:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740352.231631:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7bed19f2-4c98-4684-89e7-a6871565665d+33:2402:x1877727000975104:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 317us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740352.231639:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 66 00010000:00010000:3.0:1790740352.231696:0:13222:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92e26c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.231705:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92e26c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.231744:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92e26c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.231752:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92e26c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.231792:0:13222:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92e26c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.231799:0:13222:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc45000 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740352.231804:0:13222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92e26c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.231819:0:13222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92e26c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.231829:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf04c900) 00010000:00010000:3.0:1790740352.231831:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790740352.231835:0:13222:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92e26c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.231842:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92e26c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740352.231892:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+32:11343:x1877727000974720:12345-192.168.204.3@tcp:54:lfs.0 Request processed in 9368us (9538us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740352.231899:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 104 00000100:00100000:2.0:1790740352.235770:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740352.236358:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000975360 00000100:00100000:3.0:1790740352.236370:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000975360 00000100:00100000:3.0:1790740352.236478:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 23 00000100:00100000:3.0:1790740352.236489:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+32:11343:x1877727000975360:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:3.0:1790740352.236743:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+33:11343:x1877727000975360:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 254us (985us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1790740352.236751:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 23 00000100:00100000:0.0:1790740352.354519:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740352.354674:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000975616 00000100:00100000:2.0:1790740352.354684:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000975616 00000100:00100000:2.0:1790740352.354750:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 105 00000100:00100000:2.0:1790740352.354760:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+33:11354:x1877727000975616:12345-192.168.204.3@tcp:101:cat.0 00010000:00010000:2.0:1790740352.354788:0:6535:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740352.354811:0:6535:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92e273 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23d72 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.354899:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92e27a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.354914:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92e27a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.354925:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92e27a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.354941:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e281 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.354949:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e281 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.354955:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e281 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.355115:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92e288 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.355125:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92e288 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.355144:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92e288 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740352.355156:0:6535:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:2.0:1790740352.355233:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92e27a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.355241:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92e27a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.355248:0:6535:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92e27a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.355254:0:6535:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f32e00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740352.355259:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92e27a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.355266:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92e27a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.355278:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98dcaec70300) 00010000:00010000:2.0:1790740352.355281:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740352.355286:0:6535:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92e27a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.355293:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92e27a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.355306:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e281 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.355312:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e281 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.355324:0:6535:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e281 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.355329:0:6535:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f33200 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740352.355333:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e281 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.355339:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e281 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.355348:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98db83b66200) 00010000:00010000:2.0:1790740352.355350:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740352.355353:0:6535:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e281 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.355359:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e281 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.355400:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92e273 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d72 expref: 36 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.355414:0:6535:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92e288 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d72 expref: 35 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.355421:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf04c900) 00010000:00010000:2.0:1790740352.355423:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790740352.355426:0:6535:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f32c00, rc 0) 00000100:00100000:2.0:1790740352.355500:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+35:11354:x1877727000975616:12345-192.168.204.3@tcp:101:cat.0 Request processed in 742us (992us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1790740352.355517:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 105 00000100:00100000:2.0:1790740352.361944:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740352.362736:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000975872 00000100:00100000:0.0:1790740352.362748:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000975872 00000100:00100000:0.0:1790740352.362889:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 24 00000100:00100000:0.0:1790740352.362900:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+35:11354:x1877727000975872:12345-192.168.204.3@tcp:35:cat.0 00000100:00100000:0.0:1790740352.363255:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+36:11354:x1877727000975872:12345-192.168.204.3@tcp:35:cat.0 Request processed in 356us (1319us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1790740352.363263:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 24 00000100:00100000:3.0:1790740352.403600:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740352.403765:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000976128 00000100:00100000:1.0:1790740352.403776:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000976128 00000100:00100000:1.0:1790740352.403953:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 106 00000100:00100000:1.0:1790740352.403965:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc81325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+36:11355:x1877727000976128:12345-192.168.204.3@tcp:36:rm.0 00010000:00010000:1.0:1790740352.404025:0:7760:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1790740352.404076:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e226 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d5d expref: 36 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.404100:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92e288 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d72 expref: 35 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.404114:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e25e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d6b expref: 34 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.404127:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e218 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d56 expref: 33 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.404138:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf04c900) 00010000:00010000:1.0:1790740352.404142:0:7760:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790740352.404175:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e296 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.404190:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e296 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.404200:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e296 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.404215:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e29d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.404222:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e29d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.404229:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e29d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.404306:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92e2a4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.404319:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92e2a4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.404326:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92e2a4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790740352.404560:0:7760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:1.0:1790740352.404572:0:7760:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 423690539962ns, next at 424690536945ns, rc = 0 00010000:00010000:1.0:1790740352.404620:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92e2ab lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.404629:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92e2ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.404643:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92e2ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.404651:0:7760:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92e2ab lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.404658:0:7760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92e2ab lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.404665:0:7760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92e2ab lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.404693:0:7760:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790740352.404717:0:7760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92e2a4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.404724:0:7760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92e2a4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.404731:0:7760:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92e2a4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.404737:0:7760:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc44000 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740352.404742:0:7760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92e2a4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.404749:0:7760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92e2a4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.404758:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf04c900) 00010000:00010000:1.0:1790740352.404761:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1790740352.404771:0:7760:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92e2a4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.404778:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92e2a4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.404794:0:7760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e296 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.404801:0:7760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e296 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.404806:0:7760:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e296 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.404811:0:7760:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc45200 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740352.404814:0:7760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e296 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.404820:0:7760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e296 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.404916:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98dcaec70300) 00010000:00010000:1.0:1790740352.404919:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740352.404923:0:7760:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e296 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.404929:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e296 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790740352.404939:0:7760:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008628cfb5 reply state 00000000ce18e0c8 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e29d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.404960:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e29d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.404966:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98dcaec70700) 00010000:00010000:1.0:1790740352.404968:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790740352.404971:0:7760:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790740352.405098:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc81325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+34:11355:x1877727000976128:12345-192.168.204.3@tcp:36:rm.0 Request processed in 1133us (1508us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1790740352.405106:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 106 00010000:00010000:0.0:1790740352.405184:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790740352.405192:0:6524:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92e2ab lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740352.405198:0:6524:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc45600 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:0.0:1790740352.405201:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92e2ab lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740352.405208:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92e2ab lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740352.405217:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf04c900) 00010000:00010000:0.0:1790740352.405220:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790740352.405223:0:6524:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92e2ab lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740352.405229:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92e2ab lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740352.405247:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740352.405248:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740352.405250:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740352.467558:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740352.467769:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000976384 00000100:00100000:3.0:1790740352.467781:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000976384 00000100:00100000:3.0:1790740352.467849:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 107 00000100:00100000:3.0:1790740352.467869:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+34:11361:x1877727000976384:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:3.0:1790740352.467895:0:13222:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740352.467916:0:13222:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92e2b2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23d79 expref: -99 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.468075:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e2b9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.468093:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e2b9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.468104:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e2b9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.468115:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e2c0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.468419:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e2c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.468428:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e2c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790740352.468751:0:13222:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:3.0:1790740352.468907:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e2c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.468995:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e2c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.469003:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e2c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.469070:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e2b9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.469079:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e2b9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.469086:0:13222:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e2b9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.469091:0:13222:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc9e00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740352.469096:0:13222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e2b9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.469104:0:13222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e2b9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.469115:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98dcaec70300) 00010000:00010000:3.0:1790740352.469495:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740352.469502:0:13222:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e2b9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.469510:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e2b9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790740352.469527:0:13222:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000009c31de56 reply state 00000000d3ff20b9 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e2c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.469548:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e2c0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.469554:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98dcaec70700) 00010000:00010000:3.0:1790740352.469557:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790740352.469560:0:13222:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790740352.469598:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92e2b2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d79 expref: 37 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.469612:0:13222:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e2c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d79 expref: 36 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.469619:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98dcaf04cb00) 00010000:00010000:3.0:1790740352.469621:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790740352.469624:0:13222:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc9400, rc 0) 00000100:00100000:3.0:1790740352.471762:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+37:11361:x1877727000976384:12345-192.168.204.3@tcp:101:bash.0 Request processed in 3892us (4201us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1790740352.471775:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 107 00000100:00100000:3.0:1790740352.481898:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740352.482653:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000976512 00000100:00100000:2.0:1790740352.482668:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000976512 00000100:00100000:2.0:1790740352.482742:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 42 00000100:00100000:2.0:1790740352.482752:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc81326d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7bed19f2-4c98-4684-89e7-a6871565665d+7:2404:x1877727000976512:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:2.0:1790740352.482770:0:9806:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740352.482790:0:9806:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cbcd9a72/0xb25dda4f4e92e2d5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23d80 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790740352.482816:0:9806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790740352.482836:0:9806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=423s v=(0 0) 00010000:00010000:2.0:1790740352.482841:0:9806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740352.482851:0:9806:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbcd9a72/0xb25dda4f4e92e2d5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d80 expref: 8 pid: 9806 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.482887:0:9806:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cbcd9a72/0xb25dda4f4e92e2d5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d80 expref: 8 pid: 9806 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.482902:0:9806:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f32200, rc 0) 00000100:00100000:2.0:1790740352.482965:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc81326d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7bed19f2-4c98-4684-89e7-a6871565665d+8:2404:x1877727000976512:12345-192.168.204.3@tcp:101:bash.0 Request processed in 215us (1078us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740352.482971:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 42 00000100:00100000:0.0:1790740352.489834:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740352.489987:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000976640 00000100:00100000:2.0:1790740352.489998:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000976640 00000100:00100000:2.0:1790740352.490101:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 43 00000100:00100000:2.0:1790740352.490127:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bed19f2-4c98-4684-89e7-a6871565665d+8:11361:x1877727000976640:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:2.0:1790740352.490146:0:8453:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740352.490165:0:8453:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e7c6367/0xb25dda4f4e92e2dc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23d87 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.490198:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cbcd9a72/0xb25dda4f4e92e2d5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d80 expref: 9 pid: 9806 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.490208:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740352.490213:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740352.490219:0:8453:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e7c6367/0xb25dda4f4e92e2dc lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d87 expref: 9 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.490254:0:8453:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cbcd9a72/0xb25dda4f4e92e2d5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d80 expref: 9 pid: 9806 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.490268:0:8453:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cbcd9a72/0xb25dda4f4e92e2d5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d80 expref: 9 pid: 9806 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740352.490282:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db845bd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8453:1877727022028288:192.168.204.3@tcp:104: 00000100:00100000:2.0:1790740352.490394:0:8453:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb6db2d80 going to sleep for 11 seconds 00010000:00010000:1.0:1790740352.491274:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740352.497367:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740352.497595:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db845bd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8453:1877727022028288:192.168.204.3@tcp:104: 00010000:00010000:2.0:1790740352.497630:0:8453:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009e7c6367/0xb25dda4f4e92e2dc lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d87 expref: 9 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.497674:0:8453:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f33200, rc 0) 00000100:00100000:0.0:1790740352.498074:0:6520:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000976768 00000100:00100000:0.0:1790740352.498082:0:6520:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000976768 00010000:00010000:0.0:1790740352.498120:0:6520:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cbcd9a72/0xb25dda4f4e92e2d5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d80 expref: 10 pid: 9806 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740352.498162:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 67 00000100:00100000:0.0:1790740352.498172:0:6520:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7bed19f2-4c98-4684-89e7-a6871565665d+10:2402:x1877727000976768:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790740352.498188:0:6520:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740352.498210:0:6520:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cbcd9a72/0xb25dda4f4e92e2d5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d80 expref: 10 pid: 9806 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740352.498223:0:6520:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cbcd9a72/0xb25dda4f4e92e2d5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d80 expref: 10 pid: 9806 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740352.498246:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cbcd9a72/0xb25dda4f4e92e2d5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d80 expref: 10 pid: 9806 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740352.498262:0:6520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740352.498266:0:6520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740352.498274:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009e7c6367/0xb25dda4f4e92e2dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d87 expref: 9 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740352.498313:0:6520:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e7c6367/0xb25dda4f4e92e2dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d87 expref: 9 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740352.498353:0:6520:0:(ldlm_lockd.c:1085:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009e7c6367/0xb25dda4f4e92e2dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d87 expref: 9 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740352.499112:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bed19f2-4c98-4684-89e7-a6871565665d+9:11361:x1877727000976640:12345-192.168.204.3@tcp:101:bash.0 Request processed in 8983us (9283us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740352.499122:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 43 00000100:00100000:0.0:1790740352.500717:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfc77b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6520:1877727022028416:192.168.204.3@tcp:105: 00000100:00100000:0.0:1790740352.500836:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83d050c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790740352.504558:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfc77b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6520:1877727022028416:192.168.204.3@tcp:105: 00010000:00010000:3.0:1790740352.504587:0:6520:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740352.504645:0:6520:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7bed19f2-4c98-4684-89e7-a6871565665d+8:2402:x1877727000976768:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 6474us (7289us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740352.504656:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 67 00000100:00100000:0.0:1790740352.508114:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740352.508195:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000977024 00000100:00100000:3.0:1790740352.508205:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000977024 00000100:00100000:3.0:1790740352.508281:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 25 00000100:00100000:3.0:1790740352.508300:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+37:11361:x1877727000977024:12345-192.168.204.3@tcp:35:bash.0 00000100:00100000:3.0:1790740352.508591:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+38:11361:x1877727000977024:12345-192.168.204.3@tcp:35:bash.0 Request processed in 301us (486us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1790740352.508599:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 25 00000100:00100000:1.0:1790740352.618904:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc81326680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022028544:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790740352.618986:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740352.620569:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022028544 00000100:00100000:0.0:1790740352.620587:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022028544 00000100:00100000:0.0:1790740352.620669:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1790740352.620681:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022028544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790740352.620721:0:6541:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000001:00080000:2.0:1790740352.623923:0:9531:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:2.0:1790740352.623945:0:9531:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:0.0:1790740352.626541:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022028544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5853us (7545us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740352.626556:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1790740352.631333:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc81326680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022028544:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790740352.741914:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740352.742022:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000977152 00000100:00100000:2.0:1790740352.742056:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000977152 00000100:00100000:2.0:1790740352.742120:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 108 00000100:00100000:2.0:1790740352.742130:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+38:11377:x1877727000977152:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:2.0:1790740352.742166:0:6536:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740352.742187:0:6536:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92e2e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23d8e expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.742267:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32a00/0xb25dda4f4e92e2ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.742282:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32a00/0xb25dda4f4e92e2ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.742296:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32a00/0xb25dda4f4e92e2ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740352.742342:0:6536:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1790740352.742346:0:6536:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790740352.742364:0:6536:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32a00/0xb25dda4f4e92e2ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.742409:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92e2e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d8e expref: 40 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.742428:0:6536:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32a00/0xb25dda4f4e92e2ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d8e expref: 39 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.742435:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98dcaec70300) 00010000:00010000:2.0:1790740352.742438:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790740352.742442:0:6536:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f32a00, rc 0) 00000100:00100000:2.0:1790740352.742509:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+39:11377:x1877727000977152:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 381us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740352.742516:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 108 00000100:00100000:0.0:1790740352.747319:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740352.747419:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000977408 00000100:00100000:1.0:1790740352.747430:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000977408 00000100:00100000:1.0:1790740352.747500:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 109 00000100:00100000:1.0:1790740352.747511:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+39:11377:x1877727000977408:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:1.0:1790740352.747533:0:7760:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740352.747554:0:7760:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44e00/0xb25dda4f4e92e2f1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23d95 expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.747665:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e2f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.747698:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e2f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.747724:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e2f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740352.747737:0:7760:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1790740352.747875:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44e00/0xb25dda4f4e92e2f1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d95 expref: 42 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.747894:0:7760:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e2f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d95 expref: 41 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.747902:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98dcaf04cb00) 00010000:00010000:1.0:1790740352.747905:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790740352.747909:0:7760:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcbfc44400, rc 0) 00000100:00100000:1.0:1790740352.748234:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+41:11377:x1877727000977408:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 723us (922us total) trans 4294967380 rc 0/0 00000100:00100000:1.0:1790740352.748242:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 109 00000100:00100000:0.0:1790740352.757166:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740352.757210:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740352.757298:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000977664 00000100:00100000:3.0:1790740352.757309:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000977664 00000100:00100000:3.0:1790740352.757376:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 110 00000100:00100000:3.0:1790740352.757386:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+41:11377:x1877727000977664:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:3.0:1790740352.757412:0:13222:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740352.757434:0:13222:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92e306 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23d9c expref: -99 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.757568:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e30d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.757584:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e30d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.757595:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e30d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740352.757608:0:13222:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1790740352.758161:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92e306 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d9c expref: 44 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.758183:0:13222:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e30d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d9c expref: 43 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.758212:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98dcaf04cb00) 00010000:00010000:3.0:1790740352.758215:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1790740352.758218:0:13222:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc9e00, rc 0) 00000100:00100000:3.0:1790740352.758292:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+43:11377:x1877727000977664:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 907us (1135us total) trans 4294967381 rc 0/0 00000100:00100000:3.0:1790740352.758299:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 110 00000100:00100000:1.0:1790740352.763984:0:10416:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000977792 00000100:00100000:1.0:1790740352.764001:0:10416:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000977792 00000100:00100000:1.0:1790740352.764270:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 7 00000100:00100000:1.0:1790740352.764294:0:10416:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7bed19f2-4c98-4684-89e7-a6871565665d+43:2403:x1877727000977792:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740352.764314:0:10416:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740352.764342:0:10416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e2f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d95 expref: 43 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.764396:0:10416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98dcaf04cb00) 00010000:00010000:1.0:1790740352.764402:0:10416:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740352.764481:0:10416:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7bed19f2-4c98-4684-89e7-a6871565665d+42:2403:x1877727000977792:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 202us (7270us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740352.764488:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 7 00000100:00100000:2.0:1790740352.779242:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740352.779615:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000977920 00000100:00100000:3.0:1790740352.779625:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000977920 00000100:00100000:3.0:1790740352.779690:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 44 00000100:00100000:3.0:1790740352.779714:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7bed19f2-4c98-4684-89e7-a6871565665d+6:2404:x1877727000977920:12345-192.168.204.3@tcp:1:lfs.0 00010000:00010000:3.0:1790740352.779769:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be556e7d/0xb25dda4f4e92e31b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.779791:0:9806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009e7c6367/0xb25dda4f4e92e2dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d87 expref: 6 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.779800:0:9806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1790740352.779805:0:9806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790740352.779809:0:9806:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be556e7d/0xb25dda4f4e92e31b lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.779849:0:9806:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009e7c6367/0xb25dda4f4e92e2dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d87 expref: 6 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.779875:0:9806:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009e7c6367/0xb25dda4f4e92e2dc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d87 expref: 6 pid: 8453 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740352.779911:0:9806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc81324000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9806:1877727022028672:192.168.204.3@tcp:104: 00000100:00100000:3.0:1790740352.780012:0:9806:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc98473e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790740352.789001:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740352.789245:0:8459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000978048 00000100:00100000:1.0:1790740352.789255:0:8459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000978048 00002000:00100000:1.0:1790740352.789308:0:8459:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff98dcbfc74e00 x1877727000978048/t0(0) o4->7bed19f2-4c98-4684-89e7-a6871565665d@192.168.204.3@tcp:408/0 lens 504/0 e 0 to 0 dl 1790740363 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790740352.789321:0:8459:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98dcbfc74e00 with x1877727000978048 ext(0->8) 00010000:00010000:1.0:1790740352.789331:0:8459:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009e7c6367/0xb25dda4f4e92e2dc lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d87 expref: 7 pid: 8453 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.789350:0:8459:0:(ldlm_lockd.c:610:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009e7c6367/0xb25dda4f4e92e2dc lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d87 expref: 7 pid: 8453 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790740352.789358:0:8459:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98dcbfc74e00 00000100:00100000:1.0:1790740352.789400:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 1 00000100:00100000:1.0:1790740352.789409:0:8459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7bed19f2-4c98-4684-89e7-a6871565665d+7:2403:x1877727000978048:12345-192.168.204.3@tcp:4:lfs.0 00000100:00100000:3.0:1790740352.790077:0:9806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc81324000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9806:1877727022028672:192.168.204.3@tcp:104: 00010000:00010000:3.0:1790740352.790103:0:9806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000be556e7d/0xb25dda4f4e92e31b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740352.791730:0:8459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7bed19f2-4c98-4684-89e7-a6871565665d+9:2403:x1877727000978048:12345-192.168.204.3@tcp:4:lfs.0 Request processed in 2314us (2732us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1790740352.791765:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 1 00002000:00100000:2.0:1790740352.791776:0:8459:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff98dcbfc74e00 x1877727000978048/t4294967303(0) o4->7bed19f2-4c98-4684-89e7-a6871565665d@192.168.204.3@tcp:408/0 lens 504/448 e 0 to 0 dl 1790740363 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790740352.791787:0:8459:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98dcbfc74e00 with x1877727000978048 ext(0->8) 00010000:00010000:2.0:1790740352.791796:0:8459:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009e7c6367/0xb25dda4f4e92e2dc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d87 expref: 9 pid: 8453 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.791814:0:8459:0:(ldlm_lockd.c:610:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009e7c6367/0xb25dda4f4e92e2dc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d87 expref: 9 pid: 8453 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790740352.791833:0:8459:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98dcbfc74e00 00000100:00100000:2.0:1790740352.798666:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740352.799006:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000978176 00000100:00100000:0.0:1790740352.799018:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000978176 00010000:00010000:0.0:1790740352.799173:0:6522:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009e7c6367/0xb25dda4f4e92e2dc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d87 expref: 9 pid: 8453 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740352.799293:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 68 00000100:00100000:0.0:1790740352.799304:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc86ac2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7bed19f2-4c98-4684-89e7-a6871565665d+9:2402:x1877727000978176:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790740352.799323:0:6522:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1790740352.799340:0:6522:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1790740352.799344:0:6522:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1790740352 00002000:00010000:0.0:1790740352.799346:0:6522:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1790740353 00002000:00010000:0.0:1790740352.799349:0:6522:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1790740352 00002000:00010000:0.0:1790740352.799351:0:6522:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1790740352.799358:0:6522:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009e7c6367/0xb25dda4f4e92e2dc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d87 expref: 9 pid: 8453 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740352.799374:0:6522:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009e7c6367/0xb25dda4f4e92e2dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d87 expref: 9 pid: 8453 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740352.799584:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e7c6367/0xb25dda4f4e92e2dc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d87 expref: 9 pid: 8453 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740352.799604:0:6522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790740352.799608:0:6522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790740352.799615:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000be556e7d/0xb25dda4f4e92e31b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740352.799625:0:6522:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be556e7d/0xb25dda4f4e92e31b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740352.799671:0:6522:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740352.800006:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc86ac2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7bed19f2-4c98-4684-89e7-a6871565665d+8:2402:x1877727000978176:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 702us (1350us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740352.800015:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 68 00010000:00010000:3.0:1790740352.800353:0:9806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000be556e7d/0xb25dda4f4e92e31b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.800365:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be556e7d/0xb25dda4f4e92e31b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.800403:0:9806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be556e7d/0xb25dda4f4e92e31b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.800413:0:9806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be556e7d/0xb25dda4f4e92e31b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.800422:0:9806:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be556e7d/0xb25dda4f4e92e31b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.800430:0:9806:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc8c00 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:3.0:1790740352.800435:0:9806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be556e7d/0xb25dda4f4e92e31b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.800457:0:9806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be556e7d/0xb25dda4f4e92e31b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.800471:0:9806:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be556e7d/0xb25dda4f4e92e31b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.800479:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be556e7d/0xb25dda4f4e92e31b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740352.800546:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7bed19f2-4c98-4684-89e7-a6871565665d+7:2404:x1877727000977920:12345-192.168.204.3@tcp:1:lfs.0 Request processed in 20835us (21314us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740352.800554:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 44 00000100:00100000:2.0:1790740352.818063:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740352.821591:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000978432 00000100:00100000:3.0:1790740352.821608:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000978432 00000100:00100000:3.0:1790740352.821682:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 26 00000100:00100000:3.0:1790740352.821703:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc9925f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+42:11377:x1877727000978432:12345-192.168.204.3@tcp:35:lfs.0 00000004:00010000:3.0:1790740352.821777:0:6538:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e30d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d9c expref: 42 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790740352.821996:0:6538:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:3.0:1790740352.822027:0:6538:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1790740352.822432:0:6538:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:3.0:1790740352.822472:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92e322 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.822488:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e2c7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d79 expref: 46 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.822506:0:6538:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92e322 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.822551:0:6538:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e2c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d79 expref: 46 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.822570:0:6538:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e2c7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d79 expref: 46 pid: 13222 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740352.822587:0:6538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc81324000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6538:1877727022028800:192.168.204.3@tcp:104: 00000100:00100000:3.0:1790740352.822671:0:6538:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc98473e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790740352.832877:0:6538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc81324000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6538:1877727022028800:192.168.204.3@tcp:104: 00010000:00010000:3.0:1790740352.832911:0:6538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92e322 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740352.837018:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740352.837689:0:6520:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000978560 00000100:00100000:3.0:1790740352.837768:0:6520:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000978560 00010000:00010000:3.0:1790740352.837817:0:6520:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e2c7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d79 expref: 47 pid: 13222 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740352.837932:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 69 00000100:00100000:3.0:1790740352.837945:0:6520:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7bed19f2-4c98-4684-89e7-a6871565665d+47:2402:x1877727000978560:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790740352.837961:0:6520:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740352.837970:0:6520:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e2c7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d79 expref: 47 pid: 13222 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.838007:0:6520:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e2c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d79 expref: 47 pid: 13222 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.838059:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e2c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d79 expref: 47 pid: 13222 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.838077:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98dcaf04cb00) 00010000:00010000:3.0:1790740352.838082:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92e322 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.838091:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92e322 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.838098:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92e322 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.838134:0:6520:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740352.838205:0:6520:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7bed19f2-4c98-4684-89e7-a6871565665d+46:2402:x1877727000978560:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 263us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740352.838213:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 69 00010000:00010000:2.0:1790740352.838483:0:6538:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92e322 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740352.838491:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92e322 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790740352.838613:0:6538:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:2.0:1790740352.838755:0:6538:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:2.0:1790740352.838869:0:6538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db845bc700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6538:1877727022028928:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1790740352.838933:0:6538:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740352.838970:0:6538:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb6db2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790740352.839974:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022028928 00000100:00100000:0.0:1790740352.839983:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022028928 00000100:00100000:1.0:1790740352.840100:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1790740352.840111:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6538:x1877727022028928:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1790740352.840514:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6538:x1877727022028928:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 404us (1580us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740352.840522:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1790740352.840884:0:6538:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:2.0:1790740352.840890:0:6538:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967302 00000004:00080000:2.0:1790740352.840909:0:6538:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98dc867d6a00, transno 4294967302 00000100:00100000:2.0:1790740352.840971:0:6538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db845bc700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6538:1877727022028928:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1790740352.841132:0:6538:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:2.0:1790740352.841404:0:6538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db845bc700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6538:1877727022029056:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1790740352.841457:0:6538:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740352.841479:0:6538:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb6db2540 going to sleep for 11 seconds 00000100:00100000:0.0:1790740352.841534:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022029056 00000100:00100000:0.0:1790740352.841541:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022029056 00000100:00100000:0.0:1790740352.841578:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1790740352.841587:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6538:x1877727022029056:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1790740352.841746:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6538:x1877727022029056:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 159us (287us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1790740352.841754:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1790740352.841974:0:6538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db845bc700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6538:1877727022029056:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1790740352.842018:0:6538:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:3.0:1790740352.842262:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92e322 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.842274:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92e322 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.842310:0:6538:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92e322 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.842316:0:6538:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc8c00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740352.842320:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92e322 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.842328:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92e322 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.842343:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98dcaf04cb00) 00010000:00010000:3.0:1790740352.842346:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1790740352.842351:0:6538:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92e322 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740352.842357:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92e322 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790740352.842469:0:6538:0:(mdd_object.c:4180:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1790740352.842525:0:6538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:3.0:1790740352.842776:0:6538:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 424128743652ns, next at 425128740430ns, rc = 0 00000001:00080000:3.0:1790740352.842785:0:6538:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:3.0:1790740352.842903:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98dcaf04cb00) 00010000:00010000:3.0:1790740352.842907:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1790740352.842915:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e30d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d9c expref: 50 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740352.843433:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc9925f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+49:11377:x1877727000978432:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 21740us (25412us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1790740352.843455:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 26 00000020:00080000:3.0:1790740352.843461:0:6538:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1790740352.847298:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740352.848882:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000978688 00000100:00100000:1.0:1790740352.848898:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000978688 00000100:00100000:1.0:1790740352.849022:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 111 00000100:00100000:1.0:1790740352.849048:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+49:11377:x1877727000978688:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:1.0:1790740352.849074:0:6537:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740352.849098:0:6537:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44e00/0xb25dda4f4e92e329 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23da3 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.849160:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44e00/0xb25dda4f4e92e329 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23da3 expref: 50 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.849175:0:6537:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44e00/0xb25dda4f4e92e329 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23da3 expref: 50 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.849195:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98dcaec70600) 00010000:00010000:1.0:1790740352.849199:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790740352.849202:0:6537:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcbfc44e00, rc 0) 00000100:00100000:1.0:1790740352.849292:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+50:11377:x1877727000978688:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 261us (2004us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740352.849300:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 111 00000100:00100000:2.0:1790740352.863736:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740352.864504:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000978944 00000100:00100000:0.0:1790740352.864515:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000978944 00000100:00100000:0.0:1790740352.864619:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 27 00000100:00100000:0.0:1790740352.864631:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+50:11377:x1877727000978944:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:0.0:1790740352.865131:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+51:11377:x1877727000978944:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 500us (1406us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1790740352.865140:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 27 00000100:00100000:0.0:1790740352.990165:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740352.990271:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000979072 00000100:00100000:1.0:1790740352.990297:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000979072 00000100:00100000:1.0:1790740352.990375:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 112 00000100:00100000:1.0:1790740352.990389:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+51:11387:x1877727000979072:12345-192.168.204.3@tcp:34:lfs.0 00010000:00010000:1.0:1790740352.990478:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92e330 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.990497:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92e330 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.990516:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92e330 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.990528:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92e337 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.990535:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92e337 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.990541:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92e337 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.990609:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92e33e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.990617:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92e33e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.990623:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92e33e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790740352.990669:0:7760:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92e33e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.990681:0:7760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92e330 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.990688:0:7760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92e330 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.990695:0:7760:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92e330 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.990711:0:7760:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc45400 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740352.990717:0:7760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92e330 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.990725:0:7760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92e330 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.990739:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98dcaec70300) 00010000:00010000:1.0:1790740352.990742:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740352.990748:0:7760:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92e330 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.990754:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92e330 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.990769:0:7760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92e337 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.990776:0:7760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92e337 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.990782:0:7760:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92e337 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.991112:0:7760:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc44800 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740352.991116:0:7760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92e337 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.991123:0:7760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92e337 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.991142:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98dcaec70700) 00010000:00010000:1.0:1790740352.991145:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740352.991149:0:7760:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92e337 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.991154:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92e337 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.991166:0:7760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92e33e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.991172:0:7760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92e33e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.991179:0:7760:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92e33e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.991183:0:7760:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc45e00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740352.991186:0:7760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92e33e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.991192:0:7760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92e33e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.991199:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98dcaec70600) 00010000:00010000:1.0:1790740352.991201:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740352.991204:0:7760:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92e33e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740352.991210:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92e33e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740352.991361:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+51:11387:x1877727000979072:12345-192.168.204.3@tcp:34:lfs.0 Request processed in 974us (1208us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740352.991370:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 112 00000100:00100000:2.0:1790740353.034078:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740353.034243:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000979328 00000100:00100000:3.0:1790740353.034256:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000979328 00000100:00100000:3.0:1790740353.034377:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 113 00000100:00100000:3.0:1790740353.034388:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+51:11390:x1877727000979328:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:3.0:1790740353.034410:0:13222:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740353.034432:0:13222:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e345 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23daa expref: -99 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740353.034530:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92e34c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740353.034544:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92e34c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740353.034554:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92e34c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740353.034563:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e353 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740353.034570:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e353 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740353.034576:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e353 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740353.034689:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e35a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740353.034709:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e35a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740353.034716:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e35a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740353.034727:0:13222:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1790740353.034805:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92e34c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740353.034812:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92e34c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740353.034819:0:13222:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92e34c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740353.034825:0:13222:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc8c00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740353.034830:0:13222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92e34c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740353.034837:0:13222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92e34c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740353.034860:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98dcaec70300) 00010000:00010000:3.0:1790740353.034863:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740353.034868:0:13222:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92e34c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740353.034875:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92e34c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740353.034890:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e353 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740353.034902:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e353 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740353.034908:0:13222:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e353 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740353.034913:0:13222:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc9400 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740353.034916:0:13222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e353 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740353.034922:0:13222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e353 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740353.034931:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98dcaec70700) 00010000:00010000:3.0:1790740353.034933:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740353.034936:0:13222:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e353 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740353.034941:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e353 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740353.034979:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e345 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23daa expref: 54 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740353.034992:0:13222:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e35a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23daa expref: 53 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740353.034999:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98dcaec70600) 00010000:00010000:3.0:1790740353.035002:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790740353.035011:0:13222:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc9800, rc 0) 00000100:00100000:3.0:1790740353.035328:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+53:11390:x1877727000979328:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 940us (1303us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1790740353.035337:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 113 00000100:00100000:0.0:1790740353.039456:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740353.039542:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000979456 00000100:00100000:1.0:1790740353.039553:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000979456 00000100:00100000:1.0:1790740353.039613:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 114 00000100:00100000:1.0:1790740353.039622:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+53:11390:x1877727000979456:12345-192.168.204.3@tcp:54:lfs.0 00010000:00010000:1.0:1790740353.039693:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92e368 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.039710:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92e368 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.039721:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92e368 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.039758:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92e368 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.039766:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92e368 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.039783:0:6537:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92e368 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.039790:0:6537:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc45e00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740353.039794:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92e368 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.039801:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92e368 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.039826:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98dcaec70600) 00010000:00010000:1.0:1790740353.039829:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790740353.039833:0:6537:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92e368 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.039838:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92e368 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740353.039932:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+53:11390:x1877727000979456:12345-192.168.204.3@tcp:54:lfs.0 Request processed in 310us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740353.039939:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 114 00000100:00100000:2.0:1790740353.043362:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740353.043490:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000979712 00000100:00100000:3.0:1790740353.043501:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000979712 00000100:00100000:3.0:1790740353.043565:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 28 00000100:00100000:3.0:1790740353.043576:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+53:11390:x1877727000979712:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:3.0:1790740353.043826:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+54:11390:x1877727000979712:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 252us (474us total) trans 4294967393 rc 0/0 00000100:00100000:3.0:1790740353.043833:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 28 00000100:00100000:2.0:1790740353.146640:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740353.146735:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000979968 00000100:00100000:1.0:1790740353.146745:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000979968 00000100:00100000:1.0:1790740353.146812:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 115 00000100:00100000:1.0:1790740353.146822:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+54:11400:x1877727000979968:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:1.0:1790740353.146859:0:6536:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740353.146862:0:6536:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1790740353.146891:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32a00/0xb25dda4f4e92e2ea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d8e expref: 54 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.146911:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98dcaec70300) 00010000:00010000:1.0:1790740353.146915:0:6536:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790740353.146928:0:6536:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92e36f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23db1 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.147231:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92e376 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.147257:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92e376 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.147267:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92e376 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740353.147288:0:6536:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1790740353.147394:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92e36f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23db1 expref: 56 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.147409:0:6536:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92e376 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23db1 expref: 55 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.147417:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98dcaec70600) 00010000:00010000:1.0:1790740353.147420:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790740353.147422:0:6536:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcbfc44800, rc 0) 00000100:00100000:1.0:1790740353.147517:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+55:11400:x1877727000979968:12345-192.168.204.3@tcp:101:bash.0 Request processed in 696us (890us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1790740353.147524:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 115 00000100:00100000:2.0:1790740353.151975:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740353.152090:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740353.152236:0:10416:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000980224 00000100:00100000:1.0:1790740353.152247:0:10416:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000980224 00000100:00100000:1.0:1790740353.152325:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 8 00000100:00100000:1.0:1790740353.152336:0:10416:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84495880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7bed19f2-4c98-4684-89e7-a6871565665d+55:2403:x1877727000980224:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740353.152374:0:10416:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740353.152400:0:10416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92e376 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23db1 expref: 55 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.152428:0:10416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98dcaec70600) 00010000:00010000:1.0:1790740353.152433:0:10416:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740353.152499:0:10416:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84495880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7bed19f2-4c98-4684-89e7-a6871565665d+54:2403:x1877727000980224:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 165us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740353.152506:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 8 00000100:00100000:3.0:1790740353.154382:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000980096 00000100:00100000:3.0:1790740353.154397:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000980096 00000100:00100000:3.0:1790740353.154499:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 116 00000100:00100000:3.0:1790740353.154509:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+54:11400:x1877727000980096:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:3.0:1790740353.154536:0:13222:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740353.154561:0:13222:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e384 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23db8 expref: -99 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740353.154605:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e38b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740353.154621:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e38b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740353.154634:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e38b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740353.154755:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e384 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23db8 expref: 56 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740353.154807:0:13222:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e38b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23db8 expref: 55 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740353.154817:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98dcaec70600) 00010000:00010000:3.0:1790740353.154820:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790740353.154823:0:13222:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc9400, rc 0) 00000100:00100000:3.0:1790740353.154908:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+55:11400:x1877727000980096:12345-192.168.204.3@tcp:101:bash.0 Request processed in 401us (2944us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740353.154915:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 116 00000100:00100000:2.0:1790740353.159381:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740353.159464:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000980480 00000100:00100000:3.0:1790740353.159474:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000980480 00000100:00100000:3.0:1790740353.159552:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 117 00000100:00100000:3.0:1790740353.159563:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+55:11400:x1877727000980480:12345-192.168.204.3@tcp:36:bash.0 00010000:00010000:3.0:1790740353.159618:0:7760:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740353.159644:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e35a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23daa expref: 55 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740353.159662:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98dcaec70600) 00010000:00010000:3.0:1790740353.159667:0:7760:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790740353.159869:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92e392 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740353.159884:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92e392 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740353.159893:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92e392 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790740353.159957:0:7760:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:3.0:1790740353.159983:0:7760:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ea4b118e reply state 0000000098cf050f transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92e392 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740353.159996:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92e392 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740353.160003:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98dcaec70600) 00010000:00010000:3.0:1790740353.160006:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790740353.160008:0:7760:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790740353.160131:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+57:11400:x1877727000980480:12345-192.168.204.3@tcp:36:bash.0 Request processed in 570us (760us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1790740353.160139:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 117 00000020:00080000:3.0:1790740353.160144:0:7760:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1790740353.163976:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740353.164299:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000980608 00000100:00100000:2.0:1790740353.164310:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000980608 00000100:00100000:2.0:1790740353.164377:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 118 00000100:00100000:2.0:1790740353.164387:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc81324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+57:11400:x1877727000980608:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:2.0:1790740353.164410:0:6535:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740353.164431:0:6535:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92e399 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23dbf expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740353.164520:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92e3a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740353.164535:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92e3a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740353.164546:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92e3a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740353.164574:0:6535:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1790740353.164578:0:6535:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790740353.164594:0:6535:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92e3a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740353.164617:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92e399 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23dbf expref: 59 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740353.164633:0:6535:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92e3a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23dbf expref: 58 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740353.164659:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98dcaec70600) 00010000:00010000:2.0:1790740353.164662:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790740353.164666:0:6535:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f32c00, rc 0) 00000100:00100000:2.0:1790740353.164737:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc81324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+58:11400:x1877727000980608:12345-192.168.204.3@tcp:101:bash.0 Request processed in 352us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740353.164745:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 118 00000100:00100000:3.0:1790740353.168296:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740353.168470:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000980864 00000100:00100000:2.0:1790740353.168479:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000980864 00000100:00100000:2.0:1790740353.168538:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 29 00000100:00100000:2.0:1790740353.168549:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc81324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+58:11400:x1877727000980864:12345-192.168.204.3@tcp:35:bash.0 00000100:00100000:2.0:1790740353.168823:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc81324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+59:11400:x1877727000980864:12345-192.168.204.3@tcp:35:bash.0 Request processed in 276us (548us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1790740353.168832:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 29 00000100:00100000:3.0:1790740353.251625:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740353.251738:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000980992 00000100:00100000:1.0:1790740353.251747:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000980992 00000100:00100000:1.0:1790740353.251874:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 119 00000100:00100000:1.0:1790740353.251884:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc81326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+59:11406:x1877727000980992:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:1.0:1790740353.251913:0:13222:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740353.251937:0:13222:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92e3a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23dc6 expref: -99 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.252004:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92e3ae lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.252020:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92e3ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.252071:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92e3ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740353.252119:0:13222:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1790740353.252123:0:13222:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790740353.252142:0:13222:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92e3ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.252168:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92e3a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23dc6 expref: 61 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.252202:0:13222:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92e3ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23dc6 expref: 60 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.252212:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98dcaec70300) 00010000:00010000:1.0:1790740353.252214:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790740353.252217:0:13222:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcbfc45e00, rc 0) 00000100:00100000:1.0:1790740353.252410:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc81326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+60:11406:x1877727000980992:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 526us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740353.252417:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 119 00000100:00100000:3.0:1790740353.255467:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740353.255579:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000981120 00000100:00100000:1.0:1790740353.255590:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000981120 00000100:00100000:1.0:1790740353.255701:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 120 00000100:00100000:1.0:1790740353.255711:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc867d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+60:11406:x1877727000981120:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:1.0:1790740353.255735:0:7760:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740353.255754:0:7760:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92e3b5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23dcd expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.255825:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92e3bc lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.255841:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92e3bc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.255861:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92e3bc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.255873:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e3c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.255895:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e3c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.255902:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e3c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.255979:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e3ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.255988:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e3ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.255995:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e3ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740353.256075:0:7760:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1790740353.256080:0:7760:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790740353.256097:0:7760:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e3ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.256107:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e3ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.256116:0:7760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92e3bc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.256121:0:7760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92e3bc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.256127:0:7760:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92e3bc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.256142:0:7760:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc45a00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740353.256147:0:7760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92e3bc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.256155:0:7760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92e3bc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.256167:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98dcaec70300) 00010000:00010000:1.0:1790740353.256170:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740353.256174:0:7760:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92e3bc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.256180:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92e3bc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.256193:0:7760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e3c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.256200:0:7760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e3c3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.256205:0:7760:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e3c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.256210:0:7760:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc45800 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740353.256213:0:7760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e3c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.256219:0:7760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e3c3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.256236:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98dcaec70700) 00010000:00010000:1.0:1790740353.256239:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740353.256241:0:7760:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e3c3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.256246:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e3c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.256272:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92e3b5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23dcd expref: 62 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.256284:0:7760:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e3ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23dcd expref: 61 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.256291:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98dcaec70600) 00010000:00010000:1.0:1790740353.256293:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790740353.256295:0:7760:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcbfc44400, rc 0) 00000100:00100000:1.0:1790740353.256464:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc867d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+61:11406:x1877727000981120:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 754us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740353.256472:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 120 00000100:00100000:3.0:1790740353.260370:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740353.260498:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000981376 00000100:00100000:1.0:1790740353.260510:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000981376 00000100:00100000:1.0:1790740353.260573:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 121 00000100:00100000:1.0:1790740353.260582:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+61:11406:x1877727000981376:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:1.0:1790740353.260603:0:6537:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740353.260622:0:6537:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92e3d1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23dd4 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.260747:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e3d8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.260774:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92e3a0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23dbf expref: 62 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.260783:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e3ca lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23dcd expref: 62 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.260792:0:6537:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e3d8 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.260835:0:6537:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e3ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23dcd expref: 62 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.260857:0:6537:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e3ca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23dcd expref: 62 pid: 7760 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740353.260870:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db845c2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6537:1877727022029184:192.168.204.3@tcp:104: 00010000:00010000:1.0:1790740353.260975:0:6537:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92e3a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23dbf expref: 62 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.260986:0:6537:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92e3a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23dbf expref: 62 pid: 6535 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740353.260994:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db845c1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6537:1877727022029312:192.168.204.3@tcp:104: 00000100:00100000:1.0:1790740353.261028:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82e52a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790740353.262204:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740353.262291:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000981504 00000100:00100000:0.0:1790740353.262299:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000981504 00010000:00010000:0.0:1790740353.262330:0:6522:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e3ca lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23dcd expref: 63 pid: 7760 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740353.262383:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 70 00000100:00100000:0.0:1790740353.262392:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7bed19f2-4c98-4684-89e7-a6871565665d+63:2402:x1877727000981504:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790740353.262404:0:6522:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740353.262410:0:6522:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e3ca lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23dcd expref: 63 pid: 7760 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740353.262421:0:6522:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e3ca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23dcd expref: 63 pid: 7760 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740353.262439:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98dcaec70600) 00010000:00010000:0.0:1790740353.262444:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e3d8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740353.262452:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e3d8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740353.262459:0:6522:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740353.262506:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7bed19f2-4c98-4684-89e7-a6871565665d+63:2402:x1877727000981504:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 114us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740353.262513:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 70 00010000:00010000:2.0:1790740353.263396:0:6537:0:(ldlm_lockd.c:744:ldlm_handle_ast_error()) ### client (nid 192.168.204.3@tcp) returned -22 from blocking AST (req@0000000063c9416f x1877727022029184) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e3ca lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23dcd expref: 62 pid: 7760 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740353.263413:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e3ca lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23dcd expref: 62 pid: 7760 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740353.263429:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db845c2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6537:1877727022029184:192.168.204.3@tcp:104: 00000100:00100000:2.0:1790740353.263442:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db845c1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6537:1877727022029312:192.168.204.3@tcp:104: 00010000:00010000:2.0:1790740353.263464:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98dcaec70600) 00010000:00010000:2.0:1790740353.263478:0:6537:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e3d8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740353.263485:0:6537:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e3d8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740353.263494:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e3d8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740353.269112:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740353.270434:0:6520:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000981632 00000100:00100000:3.0:1790740353.270449:0:6520:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000981632 00010000:00010000:3.0:1790740353.270501:0:6520:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92e3a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23dbf expref: 62 pid: 6535 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740353.270544:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 71 00000100:00100000:3.0:1790740353.270554:0:6520:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7bed19f2-4c98-4684-89e7-a6871565665d+62:2403:x1877727000981632:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790740353.270570:0:6520:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740353.270578:0:6520:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92e3a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23dbf expref: 62 pid: 6535 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740353.270608:0:6520:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92e3a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23dbf expref: 62 pid: 6535 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740353.270632:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92e3a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23dbf expref: 62 pid: 6535 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740353.270649:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98dcaec70600) 00010000:00010000:3.0:1790740353.270654:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e3d8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740353.270664:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e3d8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740353.270671:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e3d8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740353.270705:0:6520:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740353.270925:0:6520:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7bed19f2-4c98-4684-89e7-a6871565665d+61:2403:x1877727000981632:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 372us (1824us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740353.270934:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 71 00010000:00010000:2.0:1790740353.273538:0:6537:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e3d8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740353.273556:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e3d8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740353.273581:0:6537:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1790740353.273738:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92e3d1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23dd4 expref: 62 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740353.273763:0:6537:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e3d8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23dd4 expref: 61 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740353.273785:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98dcaec70600) 00010000:00010000:2.0:1790740353.273788:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790740353.273792:0:6537:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcbfc45c00, rc 0) 00000100:00100000:2.0:1790740353.273877:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+61:11406:x1877727000981376:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 13295us (13519us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1790740353.273886:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 121 00000100:00100000:3.0:1790740353.278508:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740353.278598:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000981888 00000100:00100000:2.0:1790740353.278626:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000981888 00000100:00100000:2.0:1790740353.278705:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 9 00000100:00100000:2.0:1790740353.278714:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7bed19f2-4c98-4684-89e7-a6871565665d+61:11406:x1877727000981888:12345-192.168.204.3@tcp:103:lfs.0 00010000:00010000:2.0:1790740353.278731:0:6521:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740353.278755:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44e00/0xb25dda4f4e92e329 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23da3 expref: 61 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740353.278785:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98dcaec70600) 00010000:00010000:2.0:1790740353.278791:0:6521:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740353.278868:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7bed19f2-4c98-4684-89e7-a6871565665d+60:11406:x1877727000981888:12345-192.168.204.3@tcp:103:lfs.0 Request processed in 155us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740353.278877:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 9 00000100:00100000:0.0:1790740353.292978:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740353.293239:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000982016 00000100:00100000:3.0:1790740353.293251:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000982016 00000100:00100000:3.0:1790740353.293322:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 122 00000100:00100000:3.0:1790740353.293332:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+60:11406:x1877727000982016:12345-192.168.204.3@tcp:58:lfs.0 00010000:00010000:3.0:1790740353.293472:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e3e6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740353.293504:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e3e6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740353.293517:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e3e6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790740353.293633:0:13222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1790740353.293732:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+60:11406:x1877727000982016:12345-192.168.204.3@tcp:58:lfs.0 Request processed in 401us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740353.293740:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 122 00000100:00100000:3.0:1790740353.298221:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740353.299515:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000982144 00000100:00100000:1.0:1790740353.299744:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000982144 00000100:00100000:1.0:1790740353.299993:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 123 00000100:00100000:1.0:1790740353.300005:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+60:11406:x1877727000982144:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:1.0:1790740353.300028:0:7760:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740353.300071:0:7760:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92e3ed lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23ddb expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.300145:0:7760:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e3e6 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.300156:0:7760:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92e3ed lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ddb expref: 61 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.300176:0:7760:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e3e6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.300190:0:7760:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92e3ed lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ddb expref: 61 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.300205:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98dcaec70600) 00010000:00010000:1.0:1790740353.300208:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790740353.300212:0:7760:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92e3ed lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ddb expref: 61 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740353.300220:0:7760:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcbfc45400, rc 0) 00000100:00100000:1.0:1790740353.300297:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+61:11406:x1877727000982144:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 294us (2086us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740353.300320:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 123 00010000:00010000:3.0:1790740353.515762:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790740354.282296:0:13821:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790740354.282307:0:13821:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790740354.282354:0:13821:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1790740354.282365:0:13821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790740354.282497:0:13821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db845c0a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13821:1877727022029440:192.168.204.3@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790740354.282686:0:13821:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82e52cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790740354.289563:0:13821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db845c0a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13821:1877727022029440:192.168.204.3@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790740354.296840:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740354.297092:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000982272 00000100:00100000:2.0:1790740354.297102:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000982272 00000100:00100000:2.0:1790740354.297186:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 124 00000100:00100000:2.0:1790740354.297198:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+61:11407:x1877727000982272:12345-192.168.204.3@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790740354.297240:0:6537:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790740354.297431:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+61:11407:x1877727000982272:12345-192.168.204.3@tcp:53:lhsmtool_posix.0 Request processed in 235us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740354.297439:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 124 00000100:00080000:0.0:1790740354.300096:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790740354.314941:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740354.315090:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000982400 00000100:00100000:0.0:1790740354.315187:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000982400 00000100:00100000:0.0:1790740354.315336:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 125 00000100:00100000:0.0:1790740354.315348:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+61:11407:x1877727000982400:12345-192.168.204.3@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1790740354.315667:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060a00/0xb25dda4f4e92e3f4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.315687:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060a00/0xb25dda4f4e92e3f4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.315702:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060a00/0xb25dda4f4e92e3f4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.315720:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e3fb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.315727:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e3fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.315734:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e3fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.315758:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e402 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.315780:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e402 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.315788:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e402 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790740354.316444:0:13222:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1790740354.316451:0:13222:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790740354.316468:0:13222:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e402 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.316482:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060a00/0xb25dda4f4e92e3f4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.316498:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060a00/0xb25dda4f4e92e3f4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.316504:0:13222:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060a00/0xb25dda4f4e92e3f4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.316511:0:13222:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf060a00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:0.0:1790740354.316516:0:13222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060a00/0xb25dda4f4e92e3f4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.316523:0:13222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060a00/0xb25dda4f4e92e3f4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.316536:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98db82949800) 00010000:00010000:0.0:1790740354.316539:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740354.316544:0:13222:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060a00/0xb25dda4f4e92e3f4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.316550:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060a00/0xb25dda4f4e92e3f4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.316564:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e3fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.316571:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e3fb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.316576:0:13222:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e3fb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.316581:0:13222:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf061a00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:0.0:1790740354.316590:0:13222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e3fb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.316596:0:13222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e3fb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.316603:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff98dc887e4300) 00010000:00010000:0.0:1790740354.316606:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740354.316609:0:13222:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e3fb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.316615:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e3fb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.316632:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e402 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.316637:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e402 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.316643:0:13222:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e402 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.316647:0:13222:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf061c00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:0.0:1790740354.316650:0:13222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e402 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.316655:0:13222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e402 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.316661:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98dcaec70600) 00010000:00010000:0.0:1790740354.316663:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740354.316674:0:13222:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e402 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.316681:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e402 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740354.316794:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+61:11407:x1877727000982400:12345-192.168.204.3@tcp:34:lhsmtool_posix.0 Request processed in 1447us (1862us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740354.318325:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 125 00000100:00100000:1.0:1790740354.322224:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740354.328305:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000982656 00000100:00100000:3.0:1790740354.328321:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000982656 00000100:00100000:3.0:1790740354.328396:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 126 00000100:00100000:3.0:1790740354.328408:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+61:11407:x1877727000982656:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790740354.328431:0:7760:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740354.328454:0:7760:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e409 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23de2 expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740354.328566:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e410 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740354.328582:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e410 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740354.328595:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e410 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740354.328629:0:7760:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1790740354.328722:0:7760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e410 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740354.328731:0:7760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e410 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740354.328738:0:7760:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e410 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740354.328745:0:7760:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc9e00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740354.328750:0:7760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e410 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740354.328759:0:7760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e410 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740354.328770:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98dcaec70600) 00010000:00010000:3.0:1790740354.328773:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790740354.328778:0:7760:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e410 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740354.328784:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e410 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740354.328840:0:7760:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e409 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23de2 expref: 63 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740354.328851:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98db82949800) 00010000:00010000:3.0:1790740354.328853:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790740354.328865:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e409 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23de2 expref: 63 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740354.328876:0:7760:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc9c00, rc 0) 00000100:00100000:3.0:1790740354.328955:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+62:11407:x1877727000982656:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 550us (6752us total) trans 4294967399 rc 301/301 00000100:00100000:3.0:1790740354.328962:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 126 00000100:00100000:3.0:1790740354.334615:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740354.334719:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000982784 00000100:00100000:2.0:1790740354.334731:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000982784 00000100:00100000:2.0:1790740354.334800:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 127 00000100:00100000:2.0:1790740354.334809:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+62:11407:x1877727000982784:12345-192.168.204.3@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790740354.334859:0:6535:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790740354.334981:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+62:11407:x1877727000982784:12345-192.168.204.3@tcp:53:lhsmtool_posix.0 Request processed in 173us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740354.335004:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 127 00000100:00100000:0.0:1790740354.343628:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740354.343750:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000983040 00000100:00100000:3.0:1790740354.343764:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000983040 00000100:00100000:3.0:1790740354.343843:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 128 00000100:00100000:3.0:1790740354.343853:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+62:11407:x1877727000983040:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790740354.343875:0:13222:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740354.343879:0:13222:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1790740354.343908:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92e3ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23dc6 expref: 62 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740354.343929:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98dcaec70300) 00010000:00010000:3.0:1790740354.343934:0:13222:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790740354.343948:0:13222:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e41e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23de9 expref: -99 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790740354.344514:0:13222:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:3.0:1790740354.344656:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e425 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740354.344671:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e425 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740354.344693:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e425 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740354.344749:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e41e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23de9 expref: 64 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740354.344766:0:13222:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e425 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23de9 expref: 63 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740354.344774:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98dcaf04cb00) 00010000:00010000:3.0:1790740354.344777:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790740354.344779:0:13222:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc9e00, rc 0) 00000100:00100000:3.0:1790740354.344871:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+63:11407:x1877727000983040:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 1018us (1253us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1790740354.344879:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 128 00000100:00100000:0.0:1790740354.355801:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740354.356083:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000983296 00000100:00100000:2.0:1790740354.356093:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000983296 00000100:00100000:2.0:1790740354.356152:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 129 00000100:00100000:2.0:1790740354.356175:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+63:11407:x1877727000983296:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790740354.356245:0:6537:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740354.356283:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e425 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23de9 expref: 63 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.356303:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98dcaf04cb00) 00010000:00010000:2.0:1790740354.356314:0:6537:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790740354.356334:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92e433 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.356347:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92e433 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.356357:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92e433 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.356393:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e43a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x16cf87e4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.356401:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e43a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x16cf87e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.356409:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e43a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x16cf87e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.356467:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92e433 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.356474:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92e433 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.356481:0:6537:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92e433 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.356486:0:6537:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f32e00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740354.356490:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92e433 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.356498:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92e433 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.356506:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98dcaec70300) 00010000:00010000:2.0:1790740354.356508:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740354.356512:0:6537:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92e433 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.356518:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92e433 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.356526:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e43a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x16cf87e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.356532:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e43a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x16cf87e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.356538:0:6537:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e43a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x16cf87e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.356548:0:6537:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f33200 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740354.356551:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e43a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x16cf87e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.356557:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e43a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x16cf87e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.356564:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x16cf87e4 (ffff98dcaf045700) 00010000:00010000:2.0:1790740354.356566:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740354.356568:0:6537:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e43a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x16cf87e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.356573:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e43a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x16cf87e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740354.356655:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+62:11407:x1877727000983296:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 Request processed in 482us (866us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790740354.356663:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 129 00000100:00100000:2.0:1790740354.359658:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740354.359733:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000983424 00000100:00100000:1.0:1790740354.359743:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000983424 00000100:00100000:1.0:1790740354.359804:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 130 00000100:00100000:1.0:1790740354.359814:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+62:11407:x1877727000983424:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790740354.359845:0:6536:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740354.359869:0:6536:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92e441 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23df0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.359910:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92e448 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.359924:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92e448 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.359934:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92e448 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.360191:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92e441 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23df0 expref: 64 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.360218:0:6536:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92e448 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23df0 expref: 63 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.360227:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98dcaec70c00) 00010000:00010000:1.0:1790740354.360231:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790740354.360234:0:6536:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcbfc44000, rc 0) 00000100:00100000:1.0:1790740354.360405:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+63:11407:x1877727000983424:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 591us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740354.360413:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 130 00000100:00100000:0.0:1790740354.375973:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740354.376167:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000983680 00000100:00100000:1.0:1790740354.376177:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000983680 00000100:00100000:1.0:1790740354.376288:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 131 00000100:00100000:1.0:1790740354.376299:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+63:11407:x1877727000983680:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790740354.376388:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92e44f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.376409:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92e44f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.376422:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92e44f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790740354.376584:0:7760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:1.0:1790740354.376595:0:7760:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 425662563438ns, next at 426662560438ns, rc = 0 00000004:00010000:1.0:1790740354.376648:0:7760:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005c355219 reply state 00000000373f3966 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92e44f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.376680:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92e44f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.376688:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98dcaec70c00) 00010000:00010000:1.0:1790740354.376691:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1790740354.376695:0:7760:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790740354.376807:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+65:11407:x1877727000983680:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 Request processed in 509us (845us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1790740354.376814:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 131 00000100:00100000:1.0:1790740354.383717:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740354.383911:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000983808 00000100:00100000:3.0:1790740354.383921:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000983808 00000100:00100000:3.0:1790740354.383989:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 132 00000100:00100000:3.0:1790740354.384001:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+65:11407:x1877727000983808:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790740354.384069:0:6535:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740354.384092:0:6535:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e456 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23df7 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740354.384150:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e456 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23df7 expref: 66 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740354.384174:0:6535:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e456 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23df7 expref: 66 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740354.384213:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98dcaec70c00) 00010000:00010000:3.0:1790740354.384217:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790740354.384221:0:6535:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc9c00, rc 0) 00000100:00100000:3.0:1790740354.384287:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+66:11407:x1877727000983808:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 289us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740354.384294:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 132 00000100:00100000:3.0:1790740354.390684:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740354.391161:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000983936 00000100:00100000:2.0:1790740354.391171:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000983936 00000100:00100000:2.0:1790740354.391263:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 45 00000100:00100000:2.0:1790740354.391275:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83f12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bed19f2-4c98-4684-89e7-a6871565665d+8:2404:x1877727000983936:12345-192.168.204.3@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1790740354.391508:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83f12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bed19f2-4c98-4684-89e7-a6871565665d+9:2404:x1877727000983936:12345-192.168.204.3@tcp:2:lhsmtool_posix.0 Request processed in 234us (837us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1790740354.391515:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 45 00000100:00080000:0.0:1790740354.391652:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790740354.401896:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740354.402874:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000984192 00000100:00100000:2.0:1790740354.402902:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000984192 00000100:00100000:2.0:1790740354.402974:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 30 00000100:00100000:2.0:1790740354.402985:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+66:11407:x1877727000984192:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790740354.403991:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+67:11407:x1877727000984192:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 Request processed in 1002us (2099us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1790740354.404001:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 30 00000100:00100000:1.0:1790740354.407138:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740354.407472:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000984448 00000100:00100000:2.0:1790740354.407484:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000984448 00000100:00100000:2.0:1790740354.407555:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 133 00000100:00100000:2.0:1790740354.407566:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+67:11407:x1877727000984448:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790740354.407678:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+67:11407:x1877727000984448:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 Request processed in 115us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740354.407686:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 133 00000100:00100000:3.0:1790740354.410534:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740354.410642:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000984576 00000100:00100000:1.0:1790740354.410652:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000984576 00000100:00100000:1.0:1790740354.410711:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 134 00000100:00100000:1.0:1790740354.410721:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83f10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+67:11407:x1877727000984576:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790740354.410742:0:7760:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740354.410765:0:7760:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92e45d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23dfe expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.410868:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44200/0xb25dda4f4e92e464 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.410882:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44200/0xb25dda4f4e92e464 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.410893:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44200/0xb25dda4f4e92e464 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740354.410954:0:7760:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790740354.410971:0:7760:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44200/0xb25dda4f4e92e464 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.410996:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92e45d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23dfe expref: 69 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.411015:0:7760:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44200/0xb25dda4f4e92e464 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23dfe expref: 68 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.411023:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98dcaec70c00) 00010000:00010000:1.0:1790740354.411026:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1790740354.411078:0:7760:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcbfc44200, rc 0) 00000100:00100000:1.0:1790740354.411536:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83f10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+68:11407:x1877727000984576:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 816us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740354.411544:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 134 00000100:00100000:0.0:1790740354.415223:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740354.415547:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000984704 00000100:00100000:2.0:1790740354.415556:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000984704 00000100:00100000:2.0:1790740354.415647:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 46 00000100:00100000:2.0:1790740354.415657:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bed19f2-4c98-4684-89e7-a6871565665d+9:2403:x1877727000984704:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790740354.415675:0:8451:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740354.415697:0:8451:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098921d05/0xb25dda4f4e92e46b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23e05 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790740354.415723:0:8451:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abc8782, blocks: 0x0 00010000:00010000:2.0:1790740354.415743:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=425s v=(0 0) 00010000:00010000:2.0:1790740354.415758:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740354.415768:0:8451:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098921d05/0xb25dda4f4e92e46b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e05 expref: 10 pid: 8451 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.415805:0:8451:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000098921d05/0xb25dda4f4e92e46b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e05 expref: 10 pid: 8451 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.415818:0:8451:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f32e00, rc 0) 00000100:00100000:2.0:1790740354.415887:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bed19f2-4c98-4684-89e7-a6871565665d+10:2403:x1877727000984704:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 231us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740354.415894:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 46 00000100:00100000:3.0:1790740354.418505:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740354.418759:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000984960 00000100:00100000:0.0:1790740354.418771:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000984960 00000100:00100000:0.0:1790740354.418900:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 135 00000100:00100000:0.0:1790740354.418911:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83f11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+68:11407:x1877727000984960:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790740354.419058:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83f11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+68:11407:x1877727000984960:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 Request processed in 121us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740354.419066:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 135 00000100:00100000:0.0:1790740354.422328:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740354.422418:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000985088 00000100:00100000:2.0:1790740354.422427:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000985088 00000100:00100000:2.0:1790740354.422485:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 47 00000100:00100000:2.0:1790740354.422495:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bed19f2-4c98-4684-89e7-a6871565665d+10:11407:x1877727000985088:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790740354.422516:0:8454:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740354.422540:0:8454:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e7c6367/0xb25dda4f4e92e472 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23e0c expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.422579:0:8454:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000098921d05/0xb25dda4f4e92e46b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e05 expref: 11 pid: 8451 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.422588:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740354.422592:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740354.422599:0:8454:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e7c6367/0xb25dda4f4e92e472 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e0c expref: 11 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.422635:0:8454:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000098921d05/0xb25dda4f4e92e46b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e05 expref: 11 pid: 8451 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.422667:0:8454:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000098921d05/0xb25dda4f4e92e46b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e05 expref: 11 pid: 8451 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740354.422683:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8454:1877727022029568:192.168.204.3@tcp:104: 00000100:00100000:2.0:1790740354.422972:0:8454:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc897fb780 going to sleep for 11 seconds 00000100:00100000:2.0:1790740354.425919:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8454:1877727022029568:192.168.204.3@tcp:104: 00010000:00010000:2.0:1790740354.425956:0:8454:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009e7c6367/0xb25dda4f4e92e472 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e0c expref: 11 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.425975:0:8454:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f33200, rc 0) 00000100:00100000:2.0:1790740354.426064:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bed19f2-4c98-4684-89e7-a6871565665d+11:11407:x1877727000985088:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 3570us (3745us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740354.426072:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 47 00000100:00100000:3.0:1790740354.429200:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740354.429428:0:9550:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000985216 00000100:00100000:1.0:1790740354.429439:0:9550:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000985216 00010000:00010000:1.0:1790740354.429487:0:9550:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000098921d05/0xb25dda4f4e92e46b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e05 expref: 11 pid: 8451 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740354.429529:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 72 00000100:00100000:1.0:1790740354.429540:0:9550:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83f11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7bed19f2-4c98-4684-89e7-a6871565665d+11:2403:x1877727000985216:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740354.429554:0:9550:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740354.429577:0:9550:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000098921d05/0xb25dda4f4e92e46b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e05 expref: 11 pid: 8451 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.429610:0:9550:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000098921d05/0xb25dda4f4e92e46b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e05 expref: 11 pid: 8451 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.429634:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098921d05/0xb25dda4f4e92e46b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e05 expref: 11 pid: 8451 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.429650:0:9550:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790740354.429654:0:9550:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790740354.429662:0:9550:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009e7c6367/0xb25dda4f4e92e472 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e0c expref: 10 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.429673:0:9550:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e7c6367/0xb25dda4f4e92e472 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e0c expref: 10 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.429713:0:9550:0:(ldlm_lockd.c:1085:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009e7c6367/0xb25dda4f4e92e472 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e0c expref: 10 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740354.429728:0:9550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db845c1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9550:1877727022029696:192.168.204.3@tcp:105: 00000100:00100000:1.0:1790740354.429982:0:9550:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82e523c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790740354.433290:0:9550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db845c1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9550:1877727022029696:192.168.204.3@tcp:105: 00010000:00010000:1.0:1790740354.433318:0:9550:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740354.433374:0:9550:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83f11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7bed19f2-4c98-4684-89e7-a6871565665d+10:2403:x1877727000985216:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 3836us (4184us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740354.433385:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 72 00000100:00100000:2.0:1790740354.439777:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740354.439920:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000985344 00000100:00100000:3.0:1790740354.439932:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000985344 00002000:00100000:3.0:1790740354.439986:0:8457:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff98dcbfe2f100 x1877727000985344/t0(0) o4->7bed19f2-4c98-4684-89e7-a6871565665d@192.168.204.3@tcp:410/0 lens 504/0 e 0 to 0 dl 1790740365 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790740354.439998:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98dcbfe2f100 with x1877727000985344 ext(0->12) 00002000:00010000:3.0:1790740354.440004:0:8457:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98dcbfe2f100 00000100:00100000:3.0:1790740354.440070:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 2 00000100:00100000:3.0:1790740354.440080:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7bed19f2-4c98-4684-89e7-a6871565665d+10:2402:x1877727000985344:12345-192.168.204.3@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1790740354.441497:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7bed19f2-4c98-4684-89e7-a6871565665d+12:2402:x1877727000985344:12345-192.168.204.3@tcp:4:lhsmtool_posix.0 Request processed in 1411us (1723us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1790740354.441508:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 2 00002000:00100000:2.0:1790740354.441520:0:8457:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff98dcbfe2f100 x1877727000985344/t4294967309(0) o4->7bed19f2-4c98-4684-89e7-a6871565665d@192.168.204.3@tcp:410/0 lens 504/448 e 0 to 0 dl 1790740365 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790740354.441530:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98dcbfe2f100 with x1877727000985344 ext(0->12) 00002000:00010000:2.0:1790740354.441535:0:8457:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98dcbfe2f100 00000100:00100000:3.0:1790740354.444804:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740354.445584:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000985472 00000100:00100000:1.0:1790740354.445598:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000985472 00000100:00100000:1.0:1790740354.445702:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 136 00000100:00100000:1.0:1790740354.445713:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+68:11407:x1877727000985472:12345-192.168.204.3@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1790740354.447671:0:6514:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:0.0:1790740354.447686:0:6514:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:0.0:1790740354.447721:0:6514:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00010000:00010000:1.0:1790740354.447853:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92e177 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.447865:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92e177 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.447873:0:3625:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92e177 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.447880:0:3625:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f33600 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740354.447885:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92e177 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.447894:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92e177 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.447911:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98dc887e4000) 00010000:00010000:1.0:1790740354.447914:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740354.447919:0:3625:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92e177 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.447926:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92e177 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.447957:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e21f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.447964:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e21f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.447984:0:3625:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e21f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.447988:0:3625:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc8a00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740354.447991:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e21f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.447997:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e21f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.448004:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98dcaf04c900) 00010000:00010000:1.0:1790740354.448006:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740354.448008:0:3625:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e21f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.448013:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e21f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.448028:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e29d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.448072:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e29d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.448078:0:3625:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e29d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.448083:0:3625:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc44c00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740354.448086:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e29d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.448102:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e29d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.448110:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98dcaec70700) 00010000:00010000:1.0:1790740354.448113:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740354.448116:0:3625:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e29d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.448121:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e29d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.448132:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e2c0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.448138:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e2c0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.448143:0:3625:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e2c0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.448148:0:3625:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc8200 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740354.448151:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e2c0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.448156:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e2c0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.448163:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98dcaec70700) 00010000:00010000:1.0:1790740354.448166:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740354.448168:0:3625:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e2c0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.448180:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e2c0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.448197:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92e392 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.448203:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92e392 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.448208:0:3625:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92e392 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.448214:0:3625:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc8c00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740354.448217:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92e392 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.448223:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92e392 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.448231:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98dcaec70600) 00010000:00010000:1.0:1790740354.448234:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740354.448237:0:3625:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92e392 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.448242:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92e392 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.448324:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92e44f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.448331:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92e44f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.448343:0:3625:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92e44f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.448348:0:3625:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc45600 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740354.448351:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92e44f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.448357:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92e44f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.448366:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98dcaec70c00) 00010000:00010000:1.0:1790740354.448368:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790740354.448371:0:3625:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92e44f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.448377:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92e44f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740354.448543:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db845c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022029952:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1790740354.448614:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740354.448650:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790740354.448656:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db845c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022030080:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1790740354.448680:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740354.448711:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022029952 00000100:00100000:1.0:1790740354.448720:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022029952 00000020:00080000:0.0:1790740354.448864:0:6514:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98dcb6db2cc0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1790740354.448870:0:6514:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98dcb6c4f100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98dcb6db2000 00000020:00080000:0.0:1790740354.448873:0:6514:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98dcb6c4f200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98db83fb4400 00000004:00080000:0.0:1790740354.448911:0:6514:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1790740354.448945:0:6514:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98dc909bfe40 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1790740354.448949:0:6514:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98dcad1aec00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98dc909bf0c0 00000020:00080000:0.0:1790740354.448952:0:6514:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98dcad1ae300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98dc897f6e00 00000100:00100000:2.0:1790740354.449095:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db845c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022029824:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1790740354.449139:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1790740354.449185:0:6567:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1790740354.449319:0:6567:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1790740354.449333:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022030080 00000100:00100000:2.0:1790740354.449338:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022030080 00000100:00100000:2.0:1790740354.449372:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022029824 00000100:00100000:2.0:1790740354.449375:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022029824 00000100:00100000:0.0:1790740354.449428:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790740354.449438:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3640:x1877727022030080:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1790740354.449547:0:8453:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1790740354.449551:0:8453:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1790740354 00002000:00010000:0.0:1790740354.449554:0:8453:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1790740354.449556:0:8453:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1790740354 -> 1790740354 00002000:00010000:0.0:1790740354.449558:0:8453:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1790740354.449606:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3640:x1877727022030080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 169us (925us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1790740354.449613:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790740354.449717:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790740354.449725:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb6f3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3640:x1877727022029952:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1790740354.449751:0:9806:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:1.0:1790740354.449778:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092e4a354/0xb25dda4f4e92e479 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.449800:0:9806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b97c2dc8/0xb25dda4f4e92e22d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d64 expref: 11 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.449810:0:9806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1790740354.449815:0:9806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790740354.449819:0:9806:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092e4a354/0xb25dda4f4e92e479 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.449863:0:9806:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b97c2dc8/0xb25dda4f4e92e22d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d64 expref: 11 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.449879:0:9806:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b97c2dc8/0xb25dda4f4e92e22d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d64 expref: 11 pid: 8453 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740354.449893:0:9806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db845c2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9806:1877727022030208:192.168.204.3@tcp:104: 00000100:00100000:1.0:1790740354.449959:0:9806:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82e523c0 going to sleep for 11 seconds 00000004:00080000:1.0:1790740354.449996:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98db845c2300/2, rc 0, transno 4294967310 00000100:00100000:1.0:1790740354.450001:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db845c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022030080:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1790740354.450099:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+16:11407:x1877727000985472:12345-192.168.204.3@tcp:44:lhsmtool_posix.0 Request processed in 4388us (5307us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740354.450107:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 136 00000100:00100000:2.0:1790740354.450449:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790740354.450457:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1877727022029824:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1790740354.450471:0:8451:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:2.0:1790740354.450498:0:8451:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6abc8780, atime: 0x6abc8781, ctime: 0x6abc8780, blocks: 0x8 00010000:00010000:2.0:1790740354.450504:0:8451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c363486f/0xb25dda4f4e92e480 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.450514:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=425s v=(0 0) 00010000:00010000:2.0:1790740354.450517:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740354.450523:0:8451:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c363486f/0xb25dda4f4e92e480 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.450539:0:8451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c363486f/0xb25dda4f4e92e480 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.450551:0:8451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c363486f/0xb25dda4f4e92e480 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.450559:0:8451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c363486f/0xb25dda4f4e92e480 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.450591:0:8451:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790740354.450836:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3639:x1877727022029824:12345-0@lo:6:osp-syn-1-0.0 Request processed in 277us (1592us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1790740354.450845:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1790740354.450907:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790740354.450913:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790740354.450944:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790740354.450950:0:6524:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c363486f/0xb25dda4f4e92e480 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.450958:0:6524:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f32c00 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:2.0:1790740354.450963:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c363486f/0xb25dda4f4e92e480 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.450973:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c363486f/0xb25dda4f4e92e480 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.450986:0:6524:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c363486f/0xb25dda4f4e92e480 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.450994:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c363486f/0xb25dda4f4e92e480 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.451015:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740354.451016:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740354.451018:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1790740354.451194:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98db845c1c00/2, rc 0, transno 4294967305 00000100:00100000:2.0:1790740354.451200:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db845c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022029824:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1790740354.457170:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740354.457304:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740354.457379:0:10416:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000985728 00000100:00100000:2.0:1790740354.457389:0:10416:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000985728 00010000:00010000:2.0:1790740354.457429:0:10416:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b97c2dc8/0xb25dda4f4e92e22d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d64 expref: 12 pid: 8453 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740354.457474:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 73 00000100:00100000:2.0:1790740354.457483:0:10416:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc86ac2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7bed19f2-4c98-4684-89e7-a6871565665d+12:2402:x1877727000985728:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790740354.457499:0:10416:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740354.457505:0:10416:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b97c2dc8/0xb25dda4f4e92e22d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d64 expref: 12 pid: 8453 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.457520:0:10416:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b97c2dc8/0xb25dda4f4e92e22d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d64 expref: 12 pid: 8453 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.457545:0:10416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790740354.457550:0:10416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790740354.457556:0:10416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000092e4a354/0xb25dda4f4e92e479 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.457567:0:10416:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092e4a354/0xb25dda4f4e92e479 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.457589:0:10416:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740354.457637:0:10416:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc86ac2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7bed19f2-4c98-4684-89e7-a6871565665d+12:2402:x1877727000985728:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 155us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740354.457646:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 73 00010000:00010000:1.0:1790740354.457974:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b97c2dc8/0xb25dda4f4e92e22d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d64 expref: 11 pid: 8453 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740354.458002:0:9806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db845c2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9806:1877727022030208:192.168.204.3@tcp:104: 00010000:00010000:1.0:1790740354.458024:0:9806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000092e4a354/0xb25dda4f4e92e479 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.458067:0:9806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000092e4a354/0xb25dda4f4e92e479 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.458075:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092e4a354/0xb25dda4f4e92e479 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.458086:0:9806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092e4a354/0xb25dda4f4e92e479 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.458094:0:9806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092e4a354/0xb25dda4f4e92e479 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.458114:0:9806:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790740354.458317:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb6f3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3640:x1877727022029952:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8592us (9701us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1790740354.458326:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790740354.458488:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000985600 00000100:00100000:1.0:1790740354.458493:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000985600 00010000:00010000:2.0:1790740354.459085:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790740354.459094:0:6523:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092e4a354/0xb25dda4f4e92e479 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.459103:0:6523:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc45000 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:2.0:1790740354.459108:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092e4a354/0xb25dda4f4e92e479 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.459117:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092e4a354/0xb25dda4f4e92e479 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.459134:0:6523:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092e4a354/0xb25dda4f4e92e479 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.459143:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092e4a354/0xb25dda4f4e92e479 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.459166:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740354.459167:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740354.459169:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740354.460448:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 51 00000004:00080000:1.0:1790740354.460650:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98db845c2a00/2, rc 0, transno 4294967311 00000100:00100000:1.0:1790740354.460661:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db845c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022029952:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1790740354.460920:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bed19f2-4c98-4684-89e7-a6871565665d+11:2403:x1877727000985600:12345-192.168.204.3@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1790740354.462442:0:8446:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:1.0:1790740354.462459:0:8446:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:2.0:1790740354.462678:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bed19f2-4c98-4684-89e7-a6871565665d+6:2403:x1877727000985600:12345-192.168.204.3@tcp:16:lhsmtool_posix.0 Request processed in 2214us (5513us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740354.462689:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 51 00000100:00100000:0.0:1790740354.466317:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740354.466414:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000985984 00000100:00100000:1.0:1790740354.466424:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000985984 00000100:00100000:1.0:1790740354.466517:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 137 00000100:00100000:1.0:1790740354.466528:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+16:11407:x1877727000985984:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790740354.466591:0:7760:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740354.466619:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44200/0xb25dda4f4e92e464 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23dfe expref: 16 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.466642:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98dcaec70c00) 00010000:00010000:1.0:1790740354.466646:0:7760:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790740354.466679:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92e487 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.466695:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92e487 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.466704:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92e487 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790740354.468380:0:7760:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000df340f5e reply state 00000000231b3ecb transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92e487 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.468406:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92e487 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.468416:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98dcaec70c00) 00010000:00010000:1.0:1790740354.468419:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790740354.468436:0:7760:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790740354.468971:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+17:11407:x1877727000985984:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 Request processed in 2439us (2719us total) trans 4294967403 rc 0/0 00000100:00100000:1.0:1790740354.468979:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 137 00000100:00100000:0.0:1790740354.476608:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740354.477212:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000986112 00000100:00100000:2.0:1790740354.477224:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000986112 00000100:00100000:2.0:1790740354.477287:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 52 00000100:00100000:2.0:1790740354.477317:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bed19f2-4c98-4684-89e7-a6871565665d+6:2402:x1877727000986112:12345-192.168.204.3@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1790740354.477491:0:8454:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1790740354.477495:0:8454:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1790740354 -> 1790740353 00002000:00010000:2.0:1790740354.477498:0:8454:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1790740353 00002000:00010000:2.0:1790740354.477501:0:8454:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1790740354 -> 1790740353 00002000:00010000:2.0:1790740354.477502:0:8454:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1790740354.477568:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bed19f2-4c98-4684-89e7-a6871565665d+7:2402:x1877727000986112:12345-192.168.204.3@tcp:2:lhsmtool_posix.0 Request processed in 254us (972us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1790740354.477581:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 52 00000100:00100000:2.0:1790740354.481534:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740354.481873:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000986368 00000100:00100000:0.0:1790740354.481883:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000986368 00000100:00100000:0.0:1790740354.481944:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 138 00000100:00100000:0.0:1790740354.481955:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+17:11407:x1877727000986368:12345-192.168.204.3@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1790740354.482046:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e48e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.482083:0:13222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92e448 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23df0 expref: 17 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.482094:0:13222:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e48e lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.482139:0:13222:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92e448 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23df0 expref: 17 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.482154:0:13222:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92e448 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23df0 expref: 17 pid: 6536 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740354.482171:0:13222:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfc75c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13222:1877727022030336:192.168.204.3@tcp:104: 00000100:00100000:0.0:1790740354.482613:0:13222:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83d05480 going to sleep for 11 seconds 00000100:00100000:0.0:1790740354.485643:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740354.485721:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000986496 00000100:00100000:2.0:1790740354.485730:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000986496 00010000:00010000:2.0:1790740354.485959:0:6522:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92e448 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23df0 expref: 18 pid: 6536 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740354.486064:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 74 00000100:00100000:2.0:1790740354.486076:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7bed19f2-4c98-4684-89e7-a6871565665d+18:2402:x1877727000986496:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790740354.486093:0:6522:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740354.486100:0:6522:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92e448 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23df0 expref: 18 pid: 6536 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.486113:0:6522:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92e448 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23df0 expref: 18 pid: 6536 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.486135:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98dcaec70c00) 00010000:00010000:2.0:1790740354.486141:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e48e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.486167:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e48e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.486175:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e48e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.486197:0:6522:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740354.486276:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7bed19f2-4c98-4684-89e7-a6871565665d+18:2402:x1877727000986496:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 202us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740354.486284:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 74 00010000:00010000:3.0:1790740354.486708:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92e448 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23df0 expref: 17 pid: 6536 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740354.486727:0:13222:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfc75c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13222:1877727022030336:192.168.204.3@tcp:104: 00010000:00010000:3.0:1790740354.486776:0:13222:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e48e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740354.486795:0:13222:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e48e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740354.486801:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e48e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740354.486850:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e48e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740354.486857:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e48e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740354.486865:0:13222:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e48e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740354.486872:0:13222:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf061a00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740354.486877:0:13222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e48e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740354.486885:0:13222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e48e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740354.486895:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98dcaec70c00) 00010000:00010000:3.0:1790740354.486898:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1790740354.486902:0:13222:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e48e lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740354.486907:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e48e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740354.486979:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+16:11407:x1877727000986368:12345-192.168.204.3@tcp:55:lhsmtool_posix.0 Request processed in 5026us (5454us total) trans 0 rc -22/-22 00000100:00100000:3.0:1790740354.486986:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 138 00000100:00100000:1.0:1790740354.490767:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740354.490870:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000986624 00000100:00100000:3.0:1790740354.490881:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000986624 00000100:00100000:3.0:1790740354.490942:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 53 00000100:00100000:3.0:1790740354.490953:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bed19f2-4c98-4684-89e7-a6871565665d+7:2403:x1877727000986624:12345-192.168.204.3@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1790740354.491000:0:8451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5fd727f/0xb25dda4f4e92e495 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740354.491024:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009e7c6367/0xb25dda4f4e92e472 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e0c expref: 7 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740354.491057:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790740354.491062:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790740354.491067:0:8451:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5fd727f/0xb25dda4f4e92e495 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740354.491109:0:8451:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009e7c6367/0xb25dda4f4e92e472 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e0c expref: 7 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740354.491123:0:8451:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009e7c6367/0xb25dda4f4e92e472 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e0c expref: 7 pid: 8454 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740354.491138:0:8451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd552680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8451:1877727022030464:192.168.204.3@tcp:104: 00000100:00100000:3.0:1790740354.491231:0:8451:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb62b0180 going to sleep for 11 seconds 00000100:00100000:1.0:1790740354.495176:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740354.495351:0:9550:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000986752 00000100:00100000:2.0:1790740354.495361:0:9550:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000986752 00010000:00010000:2.0:1790740354.495402:0:9550:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009e7c6367/0xb25dda4f4e92e472 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e0c expref: 8 pid: 8454 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740354.495441:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 75 00000100:00100000:2.0:1790740354.495450:0:9550:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7bed19f2-4c98-4684-89e7-a6871565665d+8:2403:x1877727000986752:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790740354.495465:0:9550:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740354.495487:0:9550:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009e7c6367/0xb25dda4f4e92e472 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e0c expref: 8 pid: 8454 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.495501:0:9550:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009e7c6367/0xb25dda4f4e92e472 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e0c expref: 8 pid: 8454 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.495527:0:9550:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790740354.495532:0:9550:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790740354.495538:0:9550:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5fd727f/0xb25dda4f4e92e495 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.495563:0:9550:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5fd727f/0xb25dda4f4e92e495 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.495585:0:9550:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740354.495636:0:9550:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7bed19f2-4c98-4684-89e7-a6871565665d+8:2403:x1877727000986752:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 186us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740354.495643:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 75 00010000:00010000:3.0:1790740354.496015:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e7c6367/0xb25dda4f4e92e472 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e0c expref: 7 pid: 8454 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740354.496055:0:8451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd552680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8451:1877727022030464:192.168.204.3@tcp:104: 00010000:00010000:3.0:1790740354.496078:0:8451:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5fd727f/0xb25dda4f4e92e495 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740354.496090:0:8451:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5fd727f/0xb25dda4f4e92e495 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740354.496097:0:8451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5fd727f/0xb25dda4f4e92e495 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740354.496118:0:8451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5fd727f/0xb25dda4f4e92e495 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740354.496127:0:8451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5fd727f/0xb25dda4f4e92e495 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740354.496137:0:8451:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5fd727f/0xb25dda4f4e92e495 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740354.496144:0:8451:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc9e00 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:3.0:1790740354.496148:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5fd727f/0xb25dda4f4e92e495 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740354.496171:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5fd727f/0xb25dda4f4e92e495 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740354.496184:0:8451:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5fd727f/0xb25dda4f4e92e495 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740354.496192:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5fd727f/0xb25dda4f4e92e495 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740354.496245:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bed19f2-4c98-4684-89e7-a6871565665d+6:2403:x1877727000986624:12345-192.168.204.3@tcp:1:lhsmtool_posix.0 Request processed in 5293us (5496us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740354.496265:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 53 00000100:00100000:3.0:1790740354.500417:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740354.500626:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000987008 00000100:00100000:1.0:1790740354.500639:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000987008 00000100:00100000:1.0:1790740354.500705:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 139 00000100:00100000:1.0:1790740354.500715:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+16:11407:x1877727000987008:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1790740354.500810:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e49c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.500838:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e38b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23db8 expref: 16 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.500849:0:6537:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e49c lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.500887:0:6537:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e38b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23db8 expref: 16 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.500901:0:6537:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e38b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23db8 expref: 16 pid: 13222 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740354.500917:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfd01f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6537:1877727022030592:192.168.204.3@tcp:104: 00000100:00100000:1.0:1790740354.501002:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82e52240 going to sleep for 11 seconds 00000100:00100000:0.0:1790740354.505439:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740354.505635:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000987136 00000100:00100000:3.0:1790740354.505644:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000987136 00010000:00010000:3.0:1790740354.505682:0:6521:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e38b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23db8 expref: 17 pid: 13222 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740354.505721:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 76 00000100:00100000:3.0:1790740354.505730:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7bed19f2-4c98-4684-89e7-a6871565665d+17:2403:x1877727000987136:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790740354.505752:0:6521:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740354.505758:0:6521:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e38b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23db8 expref: 17 pid: 13222 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740354.505772:0:6521:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e38b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23db8 expref: 17 pid: 13222 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740354.505810:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98dcaec70600) 00010000:00010000:3.0:1790740354.505816:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92e3ed lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ddb expref: 17 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740354.505985:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e49c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740354.505993:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e49c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740354.506000:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e49c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740354.506020:0:6521:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740354.506136:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7bed19f2-4c98-4684-89e7-a6871565665d+17:2403:x1877727000987136:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 406us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740354.506143:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 76 00010000:00010000:1.0:1790740354.506979:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e38b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23db8 expref: 16 pid: 13222 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740354.507014:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfd01f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6537:1877727022030592:192.168.204.3@tcp:104: 00010000:00010000:1.0:1790740354.507086:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e49c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.507096:0:6537:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e49c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.507102:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e49c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.507306:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e4a3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.507318:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e456 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23df7 expref: 16 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.507327:0:6537:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e4a3 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.507357:0:6537:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e456 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23df7 expref: 16 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.507370:0:6537:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e456 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23df7 expref: 16 pid: 6535 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740354.507384:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfd01f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6537:1877727022030720:192.168.204.3@tcp:104: 00000100:00100000:1.0:1790740354.507449:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82e52b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790740354.512539:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfd01f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6537:1877727022030720:192.168.204.3@tcp:104: 00010000:00010000:1.0:1790740354.512590:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e4a3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740354.515612:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740354.515894:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000987264 00000100:00100000:0.0:1790740354.515905:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000987264 00010000:00010000:0.0:1790740354.515950:0:6522:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e456 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23df7 expref: 17 pid: 6535 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740354.515994:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 77 00000100:00100000:0.0:1790740354.516004:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7bed19f2-4c98-4684-89e7-a6871565665d+17:2403:x1877727000987264:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790740354.516019:0:6522:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740354.516027:0:6522:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e456 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23df7 expref: 17 pid: 6535 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.516116:0:6522:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e456 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23df7 expref: 17 pid: 6535 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.516138:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e456 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23df7 expref: 17 pid: 6535 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.516158:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98dcaec70c00) 00010000:00010000:0.0:1790740354.516163:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e4a3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.516173:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e4a3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.516181:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e4a3 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.516204:0:6522:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740354.516273:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7bed19f2-4c98-4684-89e7-a6871565665d+16:2403:x1877727000987264:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 271us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740354.516280:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 77 00010000:00010000:1.0:1790740354.516874:0:6537:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e4a3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.516883:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e4a3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790740354.516996:0:6537:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:1.0:1790740354.517160:0:6537:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:1.0:1790740354.517198:0:6537:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:1.0:1790740354.517400:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfd01f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6537:1877727022030848:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1790740354.517459:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740354.517680:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82e52cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790740354.520377:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022030848 00000100:00100000:3.0:1790740354.520395:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022030848 00000100:00100000:0.0:1790740354.520693:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1790740354.520705:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfd00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6537:x1877727022030848:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1790740354.520890:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfd00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6537:x1877727022030848:12345-0@lo:1000:mdt00_002.0 Request processed in 186us (3429us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740354.520897:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1790740354.520972:0:6537:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:1.0:1790740354.520979:0:6537:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967311 00000004:00080000:1.0:1790740354.521002:0:6537:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98db845c2300, transno 4294967310 00000004:00080000:1.0:1790740354.521022:0:6537:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98db845c2a00, transno 4294967311 00000100:00100000:1.0:1790740354.521048:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfd01f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6537:1877727022030848:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1790740354.521209:0:6537:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:1.0:1790740354.521303:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfd01f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6537:1877727022030976:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1790740354.521350:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740354.522085:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82e52f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790740354.522229:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022030976 00000100:00100000:2.0:1790740354.522238:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022030976 00000100:00100000:2.0:1790740354.522384:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1790740354.522393:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6537:x1877727022030976:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1790740354.522698:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6537:x1877727022030976:12345-0@lo:1000:mdt00_002.0 Request processed in 306us (1347us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1790740354.522707:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1790740354.523218:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfd01f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6537:1877727022030976:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1790740354.523347:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e4a3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.523553:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e4a3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.523574:0:6537:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e4a3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.523580:0:6537:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc45200 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740354.523585:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e4a3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.523592:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e4a3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.523607:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98dcaec70c00) 00010000:00010000:1.0:1790740354.523611:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790740354.523615:0:6537:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e4a3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.523621:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e4a3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.523647:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e3e6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.523654:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e3e6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.523659:0:6537:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e3e6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.523664:0:6537:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc9800 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740354.523667:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e3e6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.523681:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e3e6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.523689:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98dcaec70600) 00010000:00010000:1.0:1790740354.523691:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790740354.523698:0:6537:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92e3ed lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ddb expref: 19 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.523710:0:6537:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92e3ed lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ddb expref: 19 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.523719:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92e3ed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ddb expref: 19 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.523983:0:6537:0:(ldlm_lockd.c:1085:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92e3ed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ddb expref: 19 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740354.523999:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfc13b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6537:1877727022031104:192.168.204.3@tcp:105: 00000100:00100000:1.0:1790740354.524351:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82e52f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790740354.532839:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfc13b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6537:1877727022031104:192.168.204.3@tcp:105: 00010000:00010000:1.0:1790740354.532874:0:6537:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e3e6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.532886:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e3e6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.532923:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92e4aa lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.532952:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92e4aa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.532964:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92e4aa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.532975:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92e4aa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.532981:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92e4aa lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.532988:0:6537:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92e4aa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.532993:0:6537:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc45e00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740354.532997:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92e4aa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.533003:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92e4aa lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.533013:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98dcaec70600) 00010000:00010000:1.0:1790740354.533016:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740354.533020:0:6537:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92e4aa lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.533026:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92e4aa lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740354.534224:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00010000:00010000:1.0:1790740354.540787:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e49c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.540817:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e49c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.540835:0:6537:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e49c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.540842:0:6537:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc44c00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740354.540847:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e49c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.540855:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e49c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.540872:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98dcaec70600) 00010000:00010000:1.0:1790740354.540878:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790740354.540882:0:6537:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e49c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740354.540888:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e49c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740354.541213:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000987392 00000100:00100000:2.0:1790740354.541225:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000987392 00000100:00100000:2.0:1790740354.541286:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 31 00000100:00100000:2.0:1790740354.541295:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+20:11406:x1877727000987392:12345-192.168.204.3@tcp:49:lfs.0 00000100:00100000:2.0:1790740354.541432:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+20:11406:x1877727000987392:12345-192.168.204.3@tcp:49:lfs.0 Request processed in 138us (7216us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740354.541439:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 31 00000100:00100000:1.0:1790740354.542502:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+19:11407:x1877727000987008:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 Request processed in 41782us (42088us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1790740354.542514:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 139 00000020:00080000:1.0:1790740354.542519:0:6537:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1790740354.544375:0:13821:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790740354.544384:0:13821:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790740354.545651:0:13821:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1790740354.545668:0:13821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790740354.547669:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740354.547713:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740354.547748:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000987904 00000100:00100000:3.0:1790740354.547939:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000987904 00000100:00100000:2.0:1790740354.547952:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000987648 00000100:00100000:2.0:1790740354.547956:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000987648 00000100:00100000:3.0:1790740354.547998:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 140 00000100:00100000:2.0:1790740354.547998:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 32 00000100:00100000:3.0:1790740354.548008:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+20:11406:x1877727000987904:12345-192.168.204.3@tcp:58:lfs.0 00000100:00100000:2.0:1790740354.548008:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc9925cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+20:11407:x1877727000987648:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 00010000:00010000:1.0:1790740354.548191:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1790740354.548434:0:6539:0:(mdd_object.c:4180:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1790740354.548468:0:6535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1790740354.548543:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+21:11406:x1877727000987904:12345-192.168.204.3@tcp:58:lfs.0 Request processed in 536us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740354.548553:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 140 00000001:00080000:2.0:1790740354.549180:0:6539:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:2.0:1790740354.549236:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92e4b1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.549429:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92e4b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.549442:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92e4b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.549450:0:6539:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92e4b1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.549455:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92e4b1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.549461:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92e4b1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.550260:0:6539:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790740354.550379:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc9925cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+21:11407:x1877727000987648:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 Request processed in 2369us (2718us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1790740354.550388:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 32 00000020:00080000:2.0:1790740354.550394:0:6539:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790740354.556815:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790740354.556838:0:6524:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92e4b1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.556866:0:6524:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f32000 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:0.0:1790740354.556871:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92e4b1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.556881:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92e4b1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.556899:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98dcaec70c00) 00010000:00010000:0.0:1790740354.556902:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790740354.556908:0:6524:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92e4b1 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.556914:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92e4b1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.556934:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740354.556936:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740354.556938:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740354.600601:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740354.600725:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000988032 00000100:00100000:0.0:1790740354.600736:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000988032 00000100:00100000:0.0:1790740354.600815:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 141 00000100:00100000:0.0:1790740354.600836:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+21:11409:x1877727000988032:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:0.0:1790740354.600864:0:13222:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740354.600887:0:13222:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e4b8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23e13 expref: -99 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.600957:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060a00/0xb25dda4f4e92e4bf lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.600973:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060a00/0xb25dda4f4e92e4bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.601002:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060a00/0xb25dda4f4e92e4bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.601018:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060200/0xb25dda4f4e92e4c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.601026:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060200/0xb25dda4f4e92e4c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.601081:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060200/0xb25dda4f4e92e4c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.601157:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061200/0xb25dda4f4e92e4cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.601168:0:13222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e3d8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23dd4 expref: 22 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.601177:0:13222:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061200/0xb25dda4f4e92e4cd lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.601209:0:13222:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e3d8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23dd4 expref: 22 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.601225:0:13222:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e3d8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23dd4 expref: 22 pid: 6537 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740354.601239:0:13222:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfc77b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13222:1877727022031232:192.168.204.3@tcp:104: 00000100:00100000:0.0:1790740354.601344:0:13222:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83d05840 going to sleep for 11 seconds 00000100:00100000:3.0:1790740354.606130:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740354.606240:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000988288 00000100:00100000:2.0:1790740354.606261:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000988288 00000100:00100000:2.0:1790740354.606330:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 33 00000100:00100000:2.0:1790740354.606340:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+23:10783:x1877727000988288:12345-192.168.204.3@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1790740354.606608:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+24:10783:x1877727000988288:12345-192.168.204.3@tcp:35:ldlm_bl.0 Request processed in 269us (488us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1790740354.606617:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 33 00000100:00100000:0.0:1790740354.607439:0:13222:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfc77b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13222:1877727022031232:192.168.204.3@tcp:104: 00010000:00010000:0.0:1790740354.607469:0:13222:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061200/0xb25dda4f4e92e4cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740354.610139:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740354.610464:0:10416:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000988416 00000100:00100000:2.0:1790740354.610483:0:10416:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000988416 00010000:00010000:2.0:1790740354.610522:0:10416:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e3d8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23dd4 expref: 24 pid: 6537 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740354.610561:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 78 00000100:00100000:2.0:1790740354.610570:0:10416:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7bed19f2-4c98-4684-89e7-a6871565665d+24:2403:x1877727000988416:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790740354.610583:0:10416:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740354.610589:0:10416:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e3d8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23dd4 expref: 24 pid: 6537 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.610602:0:10416:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e3d8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23dd4 expref: 24 pid: 6537 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.610624:0:10416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e3d8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23dd4 expref: 24 pid: 6537 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.610640:0:10416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98dcaec70600) 00010000:00010000:2.0:1790740354.610646:0:10416:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061200/0xb25dda4f4e92e4cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.610655:0:10416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061200/0xb25dda4f4e92e4cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.610663:0:10416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061200/0xb25dda4f4e92e4cd lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740354.610709:0:10416:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740354.610770:0:10416:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7bed19f2-4c98-4684-89e7-a6871565665d+23:2403:x1877727000988416:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 200us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740354.610777:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 78 00010000:00010000:0.0:1790740354.610888:0:13222:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061200/0xb25dda4f4e92e4cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.610897:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061200/0xb25dda4f4e92e4cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790740354.610952:0:13222:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1790740354.610957:0:13222:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790740354.610977:0:13222:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061200/0xb25dda4f4e92e4cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.610991:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061200/0xb25dda4f4e92e4cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.611001:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060a00/0xb25dda4f4e92e4bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.611007:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060a00/0xb25dda4f4e92e4bf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.611014:0:13222:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060a00/0xb25dda4f4e92e4bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.611020:0:13222:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf060a00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:0.0:1790740354.611024:0:13222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060a00/0xb25dda4f4e92e4bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.611062:0:13222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060a00/0xb25dda4f4e92e4bf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.611091:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98dcaec70300) 00010000:00010000:0.0:1790740354.611093:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740354.611098:0:13222:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060a00/0xb25dda4f4e92e4bf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.611103:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060a00/0xb25dda4f4e92e4bf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.611114:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060200/0xb25dda4f4e92e4c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.611120:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060200/0xb25dda4f4e92e4c6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.611125:0:13222:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060200/0xb25dda4f4e92e4c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.611130:0:13222:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf060200 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:0.0:1790740354.611133:0:13222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060200/0xb25dda4f4e92e4c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.611138:0:13222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060200/0xb25dda4f4e92e4c6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.611145:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98db82949200) 00010000:00010000:0.0:1790740354.611147:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740354.611150:0:13222:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060200/0xb25dda4f4e92e4c6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.611155:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060200/0xb25dda4f4e92e4c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.611202:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e4b8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e13 expref: 23 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.611218:0:13222:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061200/0xb25dda4f4e92e4cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e13 expref: 22 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740354.611225:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98dcaec70600) 00010000:00010000:0.0:1790740354.611227:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790740354.611230:0:13222:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaf061200, rc 0) 00000100:00100000:0.0:1790740354.611274:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+22:11409:x1877727000988032:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 10442us (10687us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740354.611282:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 141 00000100:00100000:2.0:1790740354.666728:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfc12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022031360:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790740354.666814:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740354.667781:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022031360 00000100:00100000:0.0:1790740354.667791:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022031360 00000100:00100000:0.0:1790740354.667859:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1790740354.667869:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022031360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790740354.667912:0:7846:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1790740354.667979:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022031360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (1166us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740354.667987:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1790740354.669913:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfc12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022031360:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790740355.178241:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfc12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022031488:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790740355.178327:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740355.178397:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022031488 00000100:00100000:1.0:1790740355.178405:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022031488 00000100:00100000:1.0:1790740355.178460:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1790740355.178469:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022031488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790740355.178491:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:1.0:1790740355.178536:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022031488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740355.178542:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:1.0:1790740355.178562:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790740355.178604:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfc12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022031488:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790740355.181049:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022031616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790740355.181117:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740355.181200:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022031616 00000100:00100000:2.0:1790740355.181208:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022031616 00000100:00100000:2.0:1790740355.181254:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1790740355.181264:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1877727022031616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790740355.181288:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:2.0:1790740355.181333:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1877727022031616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740355.181341:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1790740355.181837:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022031616:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1790740355.440997:0:14333:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790740355.441010:0:14333:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790740355.441070:0:14333:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1790740355.441077:0:14333:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1790740355.562787:0:13821:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790740355.562796:0:13821:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790740355.562846:0:13821:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1790740355.562852:0:13821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790740355.562997:0:13821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfc12a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13821:1877727022031744:192.168.204.3@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790740355.563116:0:13821:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82e52f00 going to sleep for 11 seconds 00010000:00010000:2.0:1790740355.569233:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740355.572525:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740355.572614:0:13821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfc12a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13821:1877727022031744:192.168.204.3@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790740355.573134:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000988544 00000100:00100000:0.0:1790740355.573153:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000988544 00000100:00100000:0.0:1790740355.573217:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 142 00000100:00100000:0.0:1790740355.573227:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+22:11421:x1877727000988544:12345-192.168.204.3@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790740355.573263:0:6537:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790740355.573383:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+22:11421:x1877727000988544:12345-192.168.204.3@tcp:53:lhsmtool_posix.0 Request processed in 157us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740355.573392:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 142 00000100:00100000:1.0:1790740355.580071:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740355.580159:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000988800 00000100:00100000:2.0:1790740355.580171:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000988800 00000100:00100000:2.0:1790740355.580230:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 143 00000100:00100000:2.0:1790740355.580239:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+22:11421:x1877727000988800:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790740355.580260:0:7760:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740355.580280:0:7760:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92e4d4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23e1a expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740355.580400:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33400/0xb25dda4f4e92e4db lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740355.580486:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33400/0xb25dda4f4e92e4db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740355.580501:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33400/0xb25dda4f4e92e4db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740355.580513:0:7760:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1790740355.580716:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92e4d4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e1a expref: 25 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740355.580733:0:7760:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33400/0xb25dda4f4e92e4db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e1a expref: 24 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740355.580742:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98dcaec70600) 00010000:00010000:2.0:1790740355.580745:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790740355.580865:0:7760:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f33400, rc 0) 00000100:00100000:2.0:1790740355.581265:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+24:11421:x1877727000988800:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 1025us (1204us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1790740355.581274:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 143 00000100:00100000:1.0:1790740355.597202:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740355.597307:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740355.597460:0:6520:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000989184 00000100:00100000:2.0:1790740355.597472:0:6520:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000989184 00000100:00100000:2.0:1790740355.597555:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 10 00000100:00100000:2.0:1790740355.597565:0:6520:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaef89f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7bed19f2-4c98-4684-89e7-a6871565665d+24:2402:x1877727000989184:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790740355.597581:0:6520:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740355.597616:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33400/0xb25dda4f4e92e4db lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e1a expref: 24 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740355.597635:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98dcaec70600) 00010000:00010000:2.0:1790740355.597640:0:6520:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740355.597697:0:6520:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaef89f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7bed19f2-4c98-4684-89e7-a6871565665d+23:2402:x1877727000989184:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 133us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740355.597706:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 10 00000100:00100000:0.0:1790740355.597979:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000989056 00000100:00100000:0.0:1790740355.597985:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000989056 00000100:00100000:0.0:1790740355.598101:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 144 00000100:00100000:0.0:1790740355.598111:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaef89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+23:11421:x1877727000989056:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1790740355.598189:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e4e9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740355.598204:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e4e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740355.598214:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e4e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740355.598374:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e4e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740355.598382:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e4e9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740355.598389:0:13222:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e4e9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740355.598394:0:13222:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf061c00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:0.0:1790740355.598407:0:13222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e4e9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740355.598415:0:13222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e4e9 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740355.598423:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98dcaec70600) 00010000:00010000:0.0:1790740355.598426:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790740355.598430:0:13222:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e4e9 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740355.598436:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e4e9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740355.599761:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaef89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+24:11421:x1877727000989056:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 Request processed in 1643us (2562us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1790740355.599773:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 144 00000040:00080000:2.0:1790740355.604081:0:13821:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790740355.604093:0:13821:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790740355.604565:0:13821:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1790740355.604574:0:13821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790740355.610137:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740355.610458:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000989440 00000100:00100000:3.0:1790740355.610470:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000989440 00000100:00100000:3.0:1790740355.610529:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 34 00000100:00100000:3.0:1790740355.610539:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+24:11421:x1877727000989440:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790740355.610817:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+25:11421:x1877727000989440:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 Request processed in 278us (688us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1790740355.610824:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 34 00000100:00100000:0.0:1790740356.505548:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740356.505594:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740356.505637:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740356.505678:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740356.505705:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740356.505724:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740356.505746:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740356.505791:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000989696 00000100:00100000:0.0:1790740356.505804:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000989696 00000100:00100000:0.0:1790740356.505877:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000990208 00000100:00100000:0.0:1790740356.505880:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000990208 00000100:00100000:0.0:1790740356.505894:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000989824 00000100:00100000:0.0:1790740356.505896:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000989824 00000100:00100000:0.0:1790740356.505933:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000990336 00000100:00100000:0.0:1790740356.505936:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000990336 00000100:00100000:0.0:1790740356.505955:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 299 00000100:00100000:0.0:1790740356.505966:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+25:2404:x1877727000989696:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1790740356.506136:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+25:2404:x1877727000989696:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 172us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740356.506145:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 299 00000100:00100000:0.0:1790740356.506167:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 300 00000100:00100000:0.0:1790740356.506175:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2404:x1877727000990208:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740356.506738:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 301 00000100:00100000:3.0:1790740356.506753:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84524e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+5:2404:x1877727000989824:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740356.506803:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84524e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+5:2404:x1877727000989824:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 56us (1097us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740356.506810:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 301 00000100:00100000:3.0:1790740356.506830:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 302 00000100:00100000:3.0:1790740356.506836:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2404:x1877727000990336:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740356.506859:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2404:x1877727000990336:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 24us (1113us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740356.506866:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 302 00000100:00100000:3.0:1790740356.506906:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000989568 00000100:00100000:3.0:1790740356.506912:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000989568 00000100:00100000:3.0:1790740356.506949:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 384 00000100:00100000:3.0:1790740356.506956:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:2404:x1877727000989568:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740356.506985:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:2404:x1877727000989568:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 30us (1306us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740356.506992:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 384 00000100:00100000:2.0:1790740356.507763:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000989952 00000100:00100000:2.0:1790740356.507772:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000989952 00000100:00100000:2.0:1790740356.507826:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000990080 00000100:00100000:2.0:1790740356.507829:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000990080 00000100:00100000:2.0:1790740356.507853:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 120 00000100:00100000:2.0:1790740356.507861:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bed19f2-4c98-4684-89e7-a6871565665d+6:2404:x1877727000989952:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1790740356.507907:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bed19f2-4c98-4684-89e7-a6871565665d+6:2404:x1877727000989952:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 48us (2312us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740356.507914:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 120 00000100:00100000:2.0:1790740356.507929:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 121 00000100:00100000:2.0:1790740356.507935:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bed19f2-4c98-4684-89e7-a6871565665d+7:2404:x1877727000990080:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1790740356.507961:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bed19f2-4c98-4684-89e7-a6871565665d+7:2404:x1877727000990080:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 26us (2236us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740356.507967:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 121 00000100:00080000:1.0:1790740356.508244:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790740356.508251:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790740356.508254:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790740356.508257:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790740356.513602:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2404:x1877727000990208:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 28us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740356.513656:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 300 00010000:00010000:1.0:1790740356.586657:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790740356.651755:0:13821:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790740356.651771:0:13821:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790740356.651806:0:13821:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1790740356.651818:0:13821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790740356.714870:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022031872:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790740356.714981:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740356.715089:0:10118:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022031872 00000100:00100000:2.0:1790740356.715099:0:10118:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022031872 00000100:00100000:2.0:1790740356.715171:0:10118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1790740356.715180:0:10118:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1877727022031872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790740356.715234:0:10118:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790740356.715290:0:10118:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1877727022031872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740356.715297:0:10118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:2.0:1790740356.715323:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790740356.715372:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022031872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790740356.715515:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790740356.715526:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022032000:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790740356.715561:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740356.716873:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaef88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877727022032256:0@lo:400:kworker.0 00000100:00100000:1.0:1790740356.716955:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740356.717012:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfceca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1877727022032768:0@lo:400:kworker.0 00000100:00100000:1.0:1790740356.717065:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740356.717081:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1877727022033280:0@lo:400:kworker.0 00000100:00100000:1.0:1790740356.717103:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740356.717137:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1790740356.717144:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83c51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022032384:0@lo:400:kworker.0 00000100:00100000:1.0:1790740356.717172:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740356.717192:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfcec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1877727022032896:0@lo:400:kworker.0 00000100:00100000:1.0:1790740356.717229:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740356.717248:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1877727022033408:0@lo:400:kworker.0 00000100:00100000:1.0:1790740356.717269:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740356.717303:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022032256 00000100:00100000:1.0:1790740356.717310:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022032256 00000100:00100000:1.0:1790740356.717373:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022032768 00000100:00100000:1.0:1790740356.717376:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022032768 00000100:00100000:1.0:1790740356.717400:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022033280 00000100:00100000:1.0:1790740356.717403:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022033280 00000100:00100000:1.0:1790740356.717417:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022032896 00000100:00100000:1.0:1790740356.717419:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022032896 00000100:00100000:1.0:1790740356.717432:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022033408 00000100:00100000:1.0:1790740356.717434:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022033408 00000100:00100000:0.0:1790740356.718589:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaef8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3639:1877727022032128:0@lo:400:kworker.0 00000100:00100000:0.0:1790740356.718685:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740356.720880:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfcee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877727022032512:0@lo:400:kworker.0 00000100:00100000:2.0:1790740356.720981:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740356.726308:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022032512 00000100:00100000:1.0:1790740356.726330:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022032512 00000100:00100000:1.0:1790740356.726407:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1790740356.726418:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877727022032256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740356.727568:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfced500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022032640:0@lo:400:kworker.0 00000100:00100000:0.0:1790740356.727700:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740356.727739:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022033152:0@lo:400:kworker.0 00000100:00100000:0.0:1790740356.727767:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740356.727868:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022032384 00000100:00100000:0.0:1790740356.727876:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022032384 00000100:00100000:1.0:1790740356.728313:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877727022032256:12345-0@lo:400:kworker.0 Request processed in 780us (10242us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740356.728327:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1790740356.728369:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1790740356.728382:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc867d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877727022032768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740356.728440:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc867d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877727022032768:12345-0@lo:400:kworker.0 Request processed in 64us (11375us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740356.730395:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022032640 00000100:00100000:0.0:1790740356.730416:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022032640 00000100:00100000:1.0:1790740356.730709:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1790740356.730748:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1790740356.730762:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc867d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877727022033280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740356.730888:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc867d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877727022033280:12345-0@lo:400:kworker.0 Request processed in 131us (13783us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740356.730894:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1790740356.730907:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1790740356.730914:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc867d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877727022032896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740356.730946:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc867d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877727022032896:12345-0@lo:400:kworker.0 Request processed in 33us (13717us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740356.730951:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1790740356.730963:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1790740356.730969:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc867d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877727022033408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740356.730999:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc867d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877727022033408:12345-0@lo:400:kworker.0 Request processed in 30us (13729us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740356.731005:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1790740356.731017:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1790740356.731024:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877727022032512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740356.731074:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877727022032512:12345-0@lo:400:kworker.0 Request processed in 51us (10094us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740356.731080:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1790740356.731133:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1790740356.731142:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc867d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022032384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740356.731178:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc867d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022032384:12345-0@lo:400:kworker.0 Request processed in 38us (14006us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740356.731184:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1790740356.731565:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022033152 00000100:00100000:2.0:1790740356.731573:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022033152 00000100:00100000:2.0:1790740356.731650:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1790740356.731660:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3639:x1877727022033152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740356.731714:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3639:x1877727022033152:12345-0@lo:400:kworker.0 Request processed in 57us (3945us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740356.731721:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1790740356.731746:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022032000 00000100:00100000:2.0:1790740356.731750:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022032000 00000100:00100000:2.0:1790740356.731794:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1790740356.731801:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022032000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790740356.731823:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790740356.731861:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022032000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (16298us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740356.731877:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1790740356.731911:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022032128 00000100:00100000:2.0:1790740356.731915:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022032128 00000100:00100000:2.0:1790740356.731945:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1790740356.731952:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3639:x1877727022032128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740356.731987:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3639:x1877727022032128:12345-0@lo:400:kworker.0 Request processed in 36us (13303us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740356.731993:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00080000:2.0:1790740356.732052:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790740356.732058:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790740356.732061:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790740356.732065:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790740356.732133:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfcee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877727022032512:0@lo:400:kworker.0 00000100:00100000:2.0:1790740356.732149:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022033024:0@lo:400:kworker.0 00000100:00100000:2.0:1790740356.732189:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740356.732236:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022033536:0@lo:400:kworker.0 00000100:00100000:2.0:1790740356.732262:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740356.732607:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83c51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022032384:0@lo:400:kworker.0 00010000:00080000:2.0:1790740356.732630:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcbfcec000 x1877727022032896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740356.732642:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfcec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1877727022032896:0@lo:400:kworker.0 00010000:00080000:2.0:1790740356.732657:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcbd5fdc00 x1877727022033408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740356.732666:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1877727022033408:0@lo:400:kworker.0 00000100:00100000:2.0:1790740356.732694:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaef88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877727022032256:0@lo:400:kworker.0 00000100:00100000:2.0:1790740356.732710:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfceca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1877727022032768:0@lo:400:kworker.0 00000100:00100000:2.0:1790740356.732725:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1877727022033280:0@lo:400:kworker.0 00000100:00100000:3.0:1790740356.733140:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaef8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3639:1877727022032128:0@lo:400:kworker.0 00000100:00100000:3.0:1790740356.733181:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022033152:0@lo:400:kworker.0 00000100:00100000:3.0:1790740356.734161:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022032000:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790740356.735091:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022033024 00000100:00100000:1.0:1790740356.735106:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022033024 00000100:00100000:1.0:1790740356.735172:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022033536 00000100:00100000:1.0:1790740356.735176:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022033536 00000100:00100000:0.0:1790740356.736400:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1790740356.736421:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022032640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740356.736582:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022032640:12345-0@lo:400:kworker.0 Request processed in 170us (8883us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740356.736591:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1790740356.739348:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1790740356.739383:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022033024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740356.740138:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022033024:12345-0@lo:400:kworker.0 Request processed in 769us (7944us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740356.740150:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1790740356.740184:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1790740356.740194:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3638:x1877727022033536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740356.740250:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3638:x1877727022033536:12345-0@lo:400:kworker.0 Request processed in 59us (7988us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740356.740256:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1790740356.741140:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfced500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022032640:0@lo:400:kworker.0 00000100:00100000:0.0:1790740356.748392:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022033024:0@lo:400:kworker.0 00000100:00100000:0.0:1790740356.748422:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022033536:0@lo:400:kworker.0 00000040:00080000:0.0:1790740356.907561:0:13823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790740357.610416:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790740357.652697:0:14385:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790740357.652710:0:14385:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790740357.652746:0:14385:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1790740357.652754:0:14385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790740357.746652:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc81324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022033664:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790740357.746779:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740357.747027:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022033664 00000100:00100000:1.0:1790740357.747069:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022033664 00000100:00100000:1.0:1790740357.747131:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1790740357.747141:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022033664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790740357.747199:0:6541:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790740357.747263:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022033664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 122us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740357.747270:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1790740357.747473:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc81324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022033664:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790740358.001062:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740358.001414:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000990592 00000100:00100000:0.0:1790740358.001429:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000990592 00000100:00100000:0.0:1790740358.001531:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 145 00000100:00100000:0.0:1790740358.001545:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc81325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+25:11442:x1877727000990592:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:0.0:1790740358.001576:0:6535:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740358.001608:0:6535:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060a00/0xb25dda4f4e92e4f0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23e21 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740358.001772:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060200/0xb25dda4f4e92e4f7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740358.001791:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060200/0xb25dda4f4e92e4f7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740358.001827:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060200/0xb25dda4f4e92e4f7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790740358.001844:0:6535:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1790740358.002004:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060a00/0xb25dda4f4e92e4f0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e21 expref: 28 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740358.002073:0:6535:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060200/0xb25dda4f4e92e4f7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e21 expref: 27 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740358.002084:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98dcaec70600) 00010000:00010000:0.0:1790740358.002087:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1790740358.002091:0:6535:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaf060200, rc 0) 00000100:00080000:1.0:1790740358.002705:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790740358.002870:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc81325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+27:11442:x1877727000990592:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 1324us (1833us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1790740358.002879:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 145 00000100:00100000:3.0:1790740358.021006:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740358.025376:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000990720 00000100:00100000:3.0:1790740358.025392:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000990720 00000100:00100000:3.0:1790740358.025473:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 146 00000100:00100000:3.0:1790740358.025486:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+27:11442:x1877727000990720:12345-192.168.204.3@tcp:54:lfs.0 00010000:00010000:3.0:1790740358.025583:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92e505 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740358.025608:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92e505 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740358.025640:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92e505 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740358.025698:0:7760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92e505 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740358.025706:0:7760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92e505 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740358.025714:0:7760:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92e505 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740358.025720:0:7760:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc8c00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740358.025725:0:7760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92e505 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740358.025734:0:7760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92e505 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740358.025748:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98dcaec70600) 00010000:00010000:3.0:1790740358.025761:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790740358.025768:0:7760:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92e505 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740358.025775:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8c00/0xb25dda4f4e92e505 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740358.025877:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+27:11442:x1877727000990720:12345-192.168.204.3@tcp:54:lfs.0 Request processed in 395us (4888us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740358.025887:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 146 00000100:00100000:1.0:1790740358.168508:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740358.168613:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000990848 00000100:00100000:3.0:1790740358.168645:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000990848 00000100:00100000:3.0:1790740358.168741:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 54 00000100:00100000:3.0:1790740358.168765:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc81326d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bed19f2-4c98-4684-89e7-a6871565665d+6:2404:x1877727000990848:12345-192.168.204.3@tcp:101:cat.0 00010000:00010000:3.0:1790740358.168790:0:8454:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740358.168818:0:8454:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be556e7d/0xb25dda4f4e92e50c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23e28 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790740358.168849:0:8454:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6abc8781, atime: 0x6abc8781, ctime: 0x6abc8781, blocks: 0x8 00010000:00010000:3.0:1790740358.168876:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1790740358.168883:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790740358.168895:0:8454:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be556e7d/0xb25dda4f4e92e50c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e28 expref: 7 pid: 8454 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740358.168919:0:8454:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000be556e7d/0xb25dda4f4e92e50c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e28 expref: 7 pid: 8454 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740358.168935:0:8454:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc8c00, rc 0) 00000100:00100000:3.0:1790740358.169024:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc81326d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bed19f2-4c98-4684-89e7-a6871565665d+7:2404:x1877727000990848:12345-192.168.204.3@tcp:101:cat.0 Request processed in 273us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740358.169059:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 54 00000100:00080000:1.0:1790740358.169314:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790740358.175291:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740358.175422:0:8459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000990976 00000100:00100000:2.0:1790740358.175439:0:8459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000990976 00002000:00100000:2.0:1790740358.175521:0:8459:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff98dc81324700 x1877727000990976/t0(0) o3->7bed19f2-4c98-4684-89e7-a6871565665d@192.168.204.3@tcp:414/0 lens 488/0 e 0 to 0 dl 1790740369 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790740358.175537:0:8459:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98dc81324700 with x1877727000990976 ext(0->4095) 00002000:00010000:2.0:1790740358.175546:0:8459:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98dc81324700 00000100:00100000:2.0:1790740358.175590:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 3 00000100:00100000:2.0:1790740358.175602:0:8459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc81324700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7bed19f2-4c98-4684-89e7-a6871565665d+7:2402:x1877727000990976:12345-192.168.204.3@tcp:3:cat.0 00000100:00100000:2.0:1790740358.175914:0:8459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc81324700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7bed19f2-4c98-4684-89e7-a6871565665d+7:2402:x1877727000990976:12345-192.168.204.3@tcp:3:cat.0 Request processed in 313us (638us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1790740358.175924:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 3 00002000:00100000:2.0:1790740358.175933:0:8459:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff98dc81324700 x1877727000990976/t0(0) o3->7bed19f2-4c98-4684-89e7-a6871565665d@192.168.204.3@tcp:414/0 lens 488/4536 e 0 to 0 dl 1790740369 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790740358.175941:0:8459:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98dc81324700 with x1877727000990976 ext(0->4095) 00002000:00010000:2.0:1790740358.175945:0:8459:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98dc81324700 00010000:00010000:2.0:1790740358.635322:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1790740358.766063:0:9531:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:2.0:1790740358.766088:0:9531:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00010000:00010000:2.0:1790740359.658546:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740359.788194:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc884b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022033792:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790740359.788288:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740359.788422:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022033792 00000100:00100000:1.0:1790740359.788432:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022033792 00000100:00100000:1.0:1790740359.788488:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1790740359.788496:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc884b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022033792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790740359.788540:0:6540:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1790740359.788590:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc884b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022033792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740359.788596:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1790740359.788650:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc884b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022033792:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790740360.298592:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022033920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790740360.298703:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740360.298955:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790740360.298967:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022034048:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790740360.298999:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740360.299398:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022033920 00000100:00100000:2.0:1790740360.299409:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022033920 00000100:00100000:2.0:1790740360.299499:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022034048 00000100:00100000:2.0:1790740360.299503:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022034048 00000100:00100000:2.0:1790740360.299525:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1790740360.299536:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc884b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1877727022033920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790740360.299577:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1790740360.299639:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc884b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1877727022033920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740360.299647:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1790740360.299677:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1790740360.299685:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022034048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790740360.299695:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00080000:0.0:1790740360.299804:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790740360.301318:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022034048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1623us (2307us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740360.301332:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1790740360.301543:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022033920:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790740360.301933:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022034048:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1790740360.682289:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790740360.813715:0:6514:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:1.0:1790740360.813775:0:6514:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98db82e52cc0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1790740360.813782:0:6514:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98dc84c20200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98db82e523c0 00000020:00080000:1.0:1790740360.813786:0:6514:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98dc84c20f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98dc901dea00 00000020:00080000:1.0:1790740360.813824:0:6514:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1790740360.813939:0:6567:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1790740360.814091:0:6567:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:3.0:1790740360.823928:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92e487 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740360.823954:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92e487 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740360.823964:0:3624:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92e487 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740360.824008:0:3624:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc45a00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740360.824015:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92e487 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740360.824024:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92e487 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740360.824086:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98dcaec70c00) 00010000:00010000:3.0:1790740360.824089:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740360.824095:0:3624:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92e487 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740360.824102:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92e487 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790740360.827913:0:8446:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:3.0:1790740360.827935:0:8446:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000100:00100000:3.0:1790740361.628766:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740361.628986:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740361.629013:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740361.629059:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740361.629078:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740361.629096:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740361.629178:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740361.629208:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000991360 00000100:00100000:3.0:1790740361.629218:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000991360 00000100:00100000:3.0:1790740361.629273:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000991872 00000100:00100000:3.0:1790740361.629276:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000991872 00000100:00100000:3.0:1790740361.629289:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000991232 00000100:00100000:3.0:1790740361.629292:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000991232 00000100:00100000:3.0:1790740361.629318:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000991744 00000100:00100000:3.0:1790740361.629321:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000991744 00000100:00100000:3.0:1790740361.629336:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 309 00000100:00100000:3.0:1790740361.629345:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb8138000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+5:2405:x1877727000991360:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740361.629417:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb8138000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+5:2405:x1877727000991360:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 73us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740361.629424:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 309 00000100:00100000:3.0:1790740361.629441:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 310 00000100:00100000:3.0:1790740361.629447:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2405:x1877727000991872:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740361.629472:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2405:x1877727000991872:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 25us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740361.629477:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 310 00000100:00100000:3.0:1790740361.629488:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 311 00000100:00100000:3.0:1790740361.629493:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82333800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+13:2405:x1877727000991232:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740361.629516:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82333800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+13:2405:x1877727000991232:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 22us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740361.629521:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 311 00000100:00100000:3.0:1790740361.629532:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 312 00000100:00100000:3.0:1790740361.629539:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2405:x1877727000991744:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740361.629560:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2405:x1877727000991744:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 22us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740361.629567:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 312 00000100:00100000:3.0:1790740361.629586:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000991616 00000100:00100000:3.0:1790740361.629589:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000991616 00000100:00100000:0.0:1790740361.629721:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000991104 00000100:00100000:0.0:1790740361.629726:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000991104 00000100:00100000:0.0:1790740361.633829:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 386 00000100:00100000:0.0:1790740361.633849:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dca0c41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:2405:x1877727000991104:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1790740361.633941:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dca0c41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:2405:x1877727000991104:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 100us (5183us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740361.633949:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 386 00000100:00100000:3.0:1790740361.636822:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000991488 00000100:00100000:3.0:1790740361.636851:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000991488 00000100:00100000:3.0:1790740361.636940:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 125 00000100:00100000:3.0:1790740361.636950:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82332d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7bed19f2-4c98-4684-89e7-a6871565665d+5:2405:x1877727000991616:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740361.637056:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82332d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7bed19f2-4c98-4684-89e7-a6871565665d+5:2405:x1877727000991616:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 108us (8041us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740361.637065:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 125 00000100:00100000:3.0:1790740361.637083:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 126 00000100:00100000:3.0:1790740361.637090:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7bed19f2-4c98-4684-89e7-a6871565665d+6:2405:x1877727000991488:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740361.637129:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7bed19f2-4c98-4684-89e7-a6871565665d+6:2405:x1877727000991488:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 39us (8032us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740361.637135:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 126 00000100:00080000:3.0:1790740361.637157:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790740361.637161:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790740361.637163:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790740361.637166:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1790740361.717243:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740361.834562:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877727022034560:0@lo:400:kworker.0 00000100:00100000:1.0:1790740361.834648:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740361.834726:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022035072:0@lo:400:kworker.0 00000100:00100000:1.0:1790740361.834751:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740361.834772:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022035584:0@lo:400:kworker.0 00000100:00100000:1.0:1790740361.834807:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740361.834839:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1790740361.834845:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727022034176:0@lo:400:kworker.0 00000100:00100000:1.0:1790740361.834873:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740361.834896:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022034688:0@lo:400:kworker.0 00000100:00100000:1.0:1790740361.834931:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740361.834950:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022035200:0@lo:400:kworker.0 00000100:00100000:1.0:1790740361.834968:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740361.834981:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022035712:0@lo:400:kworker.0 00000100:00100000:1.0:1790740361.834999:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740361.835020:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022034432:0@lo:400:kworker.0 00000100:00100000:1.0:1790740361.835059:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740361.835073:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022034688 00000100:00100000:1.0:1790740361.835075:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1877727022034944:0@lo:400:kworker.0 00000100:00100000:2.0:1790740361.835080:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022034688 00000100:00100000:1.0:1790740361.835093:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740361.835105:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1877727022035456:0@lo:400:kworker.0 00000100:00100000:2.0:1790740361.835119:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022034432 00000100:00100000:2.0:1790740361.835122:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022034432 00000100:00100000:1.0:1790740361.835124:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740361.835138:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1790740361.835138:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1790740361.835143:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877727022034304:0@lo:400:kworker.0 00000100:00100000:2.0:1790740361.835147:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84491f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022034688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740361.835160:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740361.835172:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1877727022034816:0@lo:400:kworker.0 00000100:00100000:1.0:1790740361.835197:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740361.835203:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84491f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022034688:12345-0@lo:400:kworker.0 Request processed in 57us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740361.835209:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1877727022035328:0@lo:400:kworker.0 00000100:00100000:2.0:1790740361.835210:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1790740361.835227:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1790740361.835228:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740361.835233:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84491880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022034432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740361.835236:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022035840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790740361.835254:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740361.835256:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84491880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022034432:12345-0@lo:400:kworker.0 Request processed in 24us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740361.835284:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1790740361.835284:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022034432:0@lo:400:kworker.0 00000100:00100000:2.0:1790740361.835302:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022034176 00000100:00100000:2.0:1790740361.835306:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022034176 00000100:00100000:2.0:1790740361.835330:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1790740361.835336:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99055c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3638:x1877727022034176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740361.835369:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99055c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3638:x1877727022034176:12345-0@lo:400:kworker.0 Request processed in 33us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740361.835375:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1790740361.835405:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022035840 00000100:00100000:2.0:1790740361.835408:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022035840 00000100:00100000:2.0:1790740361.835440:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1790740361.835444:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022034560 00000100:00100000:2.0:1790740361.835447:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022035840:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790740361.835449:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022034560 00000100:00100000:0.0:1790740361.835467:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022034944 00002000:00000024:2.0:1790740361.835468:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790740361.835470:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022034944 00000100:00100000:0.0:1790740361.835480:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022035456 00000100:00100000:0.0:1790740361.835482:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022035456 00000100:00100000:0.0:1790740361.835492:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022034304 00000100:00100000:0.0:1790740361.835494:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022034304 00000100:00100000:2.0:1790740361.835496:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022035840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740361.835502:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1790740361.835504:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022034816 00000100:00100000:0.0:1790740361.835506:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022034816 00000100:00100000:0.0:1790740361.835518:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022035328 00000100:00100000:0.0:1790740361.835519:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022035328 00000100:00100000:2.0:1790740361.835530:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727022034176:0@lo:400:kworker.0 00000100:00100000:0.0:1790740361.835531:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1790740361.835537:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc884b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877727022034560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740361.835540:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022034688:0@lo:400:kworker.0 00000100:00100000:0.0:1790740361.835578:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc884b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877727022034560:12345-0@lo:400:kworker.0 Request processed in 41us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740361.835585:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1790740361.835593:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877727022034560:0@lo:400:kworker.0 00000100:00100000:0.0:1790740361.835597:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1790740361.835603:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84490a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1877727022034944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740361.835629:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84490a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1877727022034944:12345-0@lo:400:kworker.0 Request processed in 27us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740361.835635:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1790740361.835646:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1790740361.835651:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84490700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1877727022035456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740361.835677:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84490700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1877727022035456:12345-0@lo:400:kworker.0 Request processed in 26us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740361.835704:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1790740361.835716:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1790740361.835721:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84490000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877727022034304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740361.835751:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84490000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877727022034304:12345-0@lo:400:kworker.0 Request processed in 30us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740361.835756:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1790740361.835767:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1790740361.835773:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84493480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1877727022034816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740361.835798:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84493480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1877727022034816:12345-0@lo:400:kworker.0 Request processed in 26us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740361.835803:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1790740361.835814:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1790740361.835819:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84491c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1877727022035328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740361.835822:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022035072 00000100:00100000:3.0:1790740361.835825:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022035072 00000100:00100000:3.0:1790740361.835844:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022035584 00000100:00100000:0.0:1790740361.835844:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84491c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1877727022035328:12345-0@lo:400:kworker.0 Request processed in 26us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740361.835846:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022035584 00000100:00100000:0.0:1790740361.835850:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1790740361.835857:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022035200 00000100:00100000:3.0:1790740361.835859:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022035200 00000100:00100000:3.0:1790740361.835869:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022035712 00000100:00100000:3.0:1790740361.835871:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022035712 00000100:00100000:0.0:1790740361.835876:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1790740361.835882:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1790740361.835882:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc884b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022035072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740361.835887:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84491500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022035584:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1790740361.835936:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db844c3100 x1877727022034944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740361.835946:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1877727022034944:0@lo:400:kworker.0 00010000:00080000:1.0:1790740361.835956:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db844c1180 x1877727022035456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740361.835963:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1877727022035456:0@lo:400:kworker.0 00000100:00100000:1.0:1790740361.835979:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877727022034304:0@lo:400:kworker.0 00000100:00100000:1.0:1790740361.835986:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1877727022034816:0@lo:400:kworker.0 00000100:00100000:1.0:1790740361.835993:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1877727022035328:0@lo:400:kworker.0 00000100:00100000:1.0:1790740361.836000:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1790740361.836004:0:3641:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:1.0:1790740361.836018:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98db845c1c00, transno 4294967305 00000100:00100000:1.0:1790740361.836050:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022035840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790740361.836193:0:8453:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1790740361.836201:0:8453:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1790740361.836216:0:8454:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1790740361.836229:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1790740361.836236:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022035200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740361.836375:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790740361.836385:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022035968:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790740361.837128:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84491500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022035584:12345-0@lo:400:kworker.0 Request processed in 1235us (2314us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740361.837150:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1790740361.837174:0:9806:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1790740361.837181:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1790740361.837188:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022035712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740361.837227:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022035712:12345-0@lo:400:kworker.0 Request processed in 41us (2228us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740361.837233:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:3.0:1790740361.837262:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790740361.837444:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790740361.837447:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790740361.837522:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022035712:0@lo:400:kworker.0 00000100:00100000:3.0:1790740361.837760:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022035584:0@lo:400:kworker.0 00000100:00100000:1.0:1790740361.841317:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022035200:12345-0@lo:400:kworker.0 Request processed in 5068us (6333us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740361.841336:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1790740361.843113:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:3.0:1790740361.843124:0:3638:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:3.0:1790740361.843153:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022035200:0@lo:400:kworker.0 00000100:00100000:0.0:1790740361.845496:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc884b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022035072:12345-0@lo:400:kworker.0 Request processed in 9606us (10736us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740361.845513:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1790740361.847197:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022035072:0@lo:400:kworker.0 00000100:00100000:2.0:1790740361.854444:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740361.857161:0:10118:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022035968 00000100:00100000:0.0:1790740361.857178:0:10118:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022035968 00000100:00100000:0.0:1790740361.857245:0:10118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1790740361.857255:0:10118:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022035968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790740361.857370:0:10118:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790740361.857462:0:10118:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022035968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 209us (3025us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740361.857470:0:10118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1790740361.857581:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022035968:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1790740362.730336:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740362.862247:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022036096:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790740362.862325:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740362.863266:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022036096 00000100:00100000:2.0:1790740362.863277:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022036096 00000100:00100000:2.0:1790740362.863353:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1790740362.863362:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022036096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790740362.863412:0:7846:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790740362.863482:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022036096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 121us (1156us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740362.863490:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1790740362.863545:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022036096:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1790740363.754442:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740363.945703:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740363.945806:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000992000 00000100:00100000:3.0:1790740363.945825:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000992000 00000100:00100000:3.0:1790740363.945934:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 147 00000100:00080000:0.0:1790740363.946398:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790740363.951491:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+13:11086:x1877727000992000:12345-192.168.204.3@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1790740363.951734:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+13:11086:x1877727000992000:12345-192.168.204.3@tcp:60:lhsmtool_posix.0 Request processed in 5785us (6034us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740363.951772:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 147 00000100:00100000:3.0:1790740363.964527:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740363.964766:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000992128 00000100:00100000:1.0:1790740363.964789:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000992128 00000100:00100000:1.0:1790740363.964876:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 148 00000100:00100000:1.0:1790740363.964887:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+5:11086:x1877727000992128:12345-192.168.204.3@tcp:60:lhsmtool_posix.0 00000100:00080000:0.0:1790740363.965136:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790740363.965398:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+5:11086:x1877727000992128:12345-192.168.204.3@tcp:60:lhsmtool_posix.0 Request processed in 512us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740363.965407:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 148 00000100:00100000:0.0:1790740363.973549:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740363.973657:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000992384 00000100:00100000:3.0:1790740363.973667:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000992384 00000100:00100000:3.0:1790740363.973730:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 35 00000100:00100000:3.0:1790740363.973742:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+13:11086:x1877727000992384:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790740363.973994:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+14:11086:x1877727000992384:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 Request processed in 255us (455us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1790740363.974002:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 35 00010000:00010000:3.0:1790740364.778547:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740364.906366:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84492300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022036224:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790740364.906445:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740364.906860:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022036224 00000100:00100000:1.0:1790740364.906870:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022036224 00000100:00100000:1.0:1790740364.906930:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1790740364.907082:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022036224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790740364.907122:0:6540:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1790740364.907241:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022036224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 293us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740364.907250:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1790740364.912312:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84492300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022036224:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790740365.418530:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790740365.418554:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84492680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022036352:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790740365.418643:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740365.418724:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022036352 00000100:00100000:1.0:1790740365.418732:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022036352 00000100:00100000:1.0:1790740365.418788:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1790740365.418798:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022036352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790740365.418842:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00080000:0.0:1790740365.419070:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790740365.419230:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022036352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 433us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740365.419238:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1790740365.420096:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84492680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022036352:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790740365.422235:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790740365.422258:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022036480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790740365.422328:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740365.422389:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022036480 00000100:00100000:2.0:1790740365.422397:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022036480 00000100:00100000:2.0:1790740365.422453:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1790740365.422461:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaf15e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727022036480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790740365.422484:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1790740365.422526:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaf15e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727022036480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740365.422534:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1790740365.422785:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022036480:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790740365.422805:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790740365.802823:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790740366.142496:0:13823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:2.0:1790740366.331010:0:14583:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 23:52:44 (1790740364) 00000001:00080000:1.0:1790740366.448627:0:6514:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:1.0:1790740366.448645:0:6514:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1790740366.448727:0:6567:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1790740366.448739:0:6567:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1790740366.747182:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740366.747233:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740366.747269:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740366.747293:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740366.747318:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740366.747338:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740366.747363:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740366.747392:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000992768 00000100:00100000:0.0:1790740366.747403:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000992768 00000100:00100000:0.0:1790740366.747465:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000993280 00000100:00100000:0.0:1790740366.747469:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000993280 00000100:00100000:0.0:1790740366.747482:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000992640 00000100:00100000:0.0:1790740366.747484:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000992640 00000100:00100000:0.0:1790740366.747497:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000993152 00000100:00100000:0.0:1790740366.747500:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000993152 00000100:00100000:0.0:1790740366.747524:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 319 00000100:00100000:0.0:1790740366.747550:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+5:2404:x1877727000992768:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1790740366.747649:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+5:2404:x1877727000992768:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 101us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740366.747658:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 319 00000100:00100000:0.0:1790740366.747678:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 320 00000100:00100000:0.0:1790740366.747685:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2404:x1877727000993280:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1790740366.747712:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2404:x1877727000993280:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 28us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740366.747718:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 320 00000100:00100000:0.0:1790740366.747730:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 321 00000100:00100000:0.0:1790740366.747736:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+13:2404:x1877727000992640:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1790740366.747763:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+13:2404:x1877727000992640:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 27us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740366.747769:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 321 00000100:00100000:0.0:1790740366.747781:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 322 00000100:00100000:0.0:1790740366.747787:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2404:x1877727000993152:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1790740366.747809:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2404:x1877727000993152:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 23us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740366.747815:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 322 00000100:00080000:0.0:1790740366.747841:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790740366.747844:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790740366.748175:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000993024 00000100:00100000:3.0:1790740366.748181:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000993024 00000100:00100000:3.0:1790740366.748225:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000992896 00000100:00100000:3.0:1790740366.748228:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000992896 00000100:00100000:3.0:1790740366.748249:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 131 00000100:00100000:3.0:1790740366.748256:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bed19f2-4c98-4684-89e7-a6871565665d+5:2404:x1877727000993024:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740366.748294:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bed19f2-4c98-4684-89e7-a6871565665d+5:2404:x1877727000993024:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 39us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740366.748301:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 131 00000100:00100000:3.0:1790740366.748316:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 132 00000100:00100000:3.0:1790740366.748322:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bed19f2-4c98-4684-89e7-a6871565665d+6:2404:x1877727000992896:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740366.748347:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bed19f2-4c98-4684-89e7-a6871565665d+6:2404:x1877727000992896:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 26us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740366.748353:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 132 00000100:00100000:2.0:1790740366.748540:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000992512 00000100:00100000:2.0:1790740366.748545:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000992512 00000100:00100000:2.0:1790740366.748597:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 388 00000100:00100000:2.0:1790740366.748606:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99057c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:2404:x1877727000992512:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1790740366.748645:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99057c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:2404:x1877727000992512:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 40us (1477us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740366.748651:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 388 00000100:00080000:0.0:1790740366.749680:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790740366.749687:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1790740366.826284:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790740366.890945:0:13821:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790740366.890959:0:13821:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790740366.891124:0:13821:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1790740366.891132:0:13821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790740366.954457:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022036608:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790740366.954544:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740366.954577:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84493b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877727022036864:0@lo:400:kworker.0 00000100:00100000:3.0:1790740366.954616:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84491180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877727022037120:0@lo:400:kworker.0 00000100:00100000:1.0:1790740366.954622:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740366.954638:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740366.954638:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84493100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1877727022037376:0@lo:400:kworker.0 00000100:00100000:3.0:1790740366.954651:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84492300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022037632:0@lo:400:kworker.0 00000100:00100000:1.0:1790740366.954656:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740366.954668:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb81b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1877727022037888:0@lo:400:kworker.0 00000100:00100000:3.0:1790740366.954672:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740366.954685:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022038144:0@lo:400:kworker.0 00000100:00100000:1.0:1790740366.954686:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740366.954703:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740366.954707:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1790740366.954712:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022036992:0@lo:400:kworker.0 00000100:00100000:3.0:1790740366.954717:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1790740366.954721:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84493800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727022036736:0@lo:400:kworker.0 00000100:00100000:1.0:1790740366.954733:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740366.954746:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740366.954750:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84492680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1877727022037504:0@lo:400:kworker.0 00000100:00100000:3.0:1790740366.954765:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84492a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022037248:0@lo:400:kworker.0 00000100:00100000:1.0:1790740366.954769:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740366.954783:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb81b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1877727022038016:0@lo:400:kworker.0 00000100:00100000:3.0:1790740366.954784:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740366.954799:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db845c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022037760:0@lo:400:kworker.0 00000100:00100000:1.0:1790740366.954801:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740366.954818:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740366.954825:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022036608 00000100:00100000:1.0:1790740366.954832:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022036608 00000100:00100000:3.0:1790740366.954833:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022038272:0@lo:400:kworker.0 00000100:00100000:3.0:1790740366.954851:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740366.954874:0:14497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022037632 00000100:00100000:3.0:1790740366.954877:0:14497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022037632 00000100:00100000:1.0:1790740366.954880:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1790740366.954887:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82330a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022036608:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790740366.954899:0:14497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022038144 00000100:00100000:3.0:1790740366.954902:0:14497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022038144 00000100:00100000:3.0:1790740366.954912:0:14497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022037760 00002000:00000024:1.0:1790740366.954914:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790740366.954919:0:14497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022037760 00000100:00100000:3.0:1790740366.954931:0:14497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022038272 00000100:00100000:3.0:1790740366.954933:0:14497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022038272 00000100:00100000:3.0:1790740366.954946:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1790740366.954952:0:14497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfd01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022037632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740366.954954:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82330a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3638:x1877727022036608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740366.954966:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1790740366.954996:0:14497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfd01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022037632:12345-0@lo:400:kworker.0 Request processed in 44us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740366.955000:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022036992 00000100:00100000:3.0:1790740366.955002:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1790740366.955003:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022036992 00000100:00100000:3.0:1790740366.955014:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1790740366.955020:0:14497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfd01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022038144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740366.955022:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022037248 00000100:00100000:1.0:1790740366.955024:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022037248 00000100:00100000:1.0:1790740366.955054:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1790740366.955060:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022036992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740366.955063:0:14497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfd01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022038144:12345-0@lo:400:kworker.0 Request processed in 44us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740366.955068:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1790740366.955079:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1790740366.955085:0:14497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaef88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022037760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740366.955095:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022036992:12345-0@lo:400:kworker.0 Request processed in 35us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740366.955101:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1790740366.955108:0:14497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaef88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022037760:12345-0@lo:400:kworker.0 Request processed in 25us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740366.955112:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1790740366.955114:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1790740366.955122:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1790740366.955128:0:14497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaef8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022038272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740366.955132:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022037248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740366.955160:0:14497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaef8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022038272:12345-0@lo:400:kworker.0 Request processed in 32us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740366.955160:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022037248:12345-0@lo:400:kworker.0 Request processed in 27us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740366.955167:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1790740366.955167:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1790740366.955188:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022036864 00000100:00100000:3.0:1790740366.955192:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022036864 00000100:00100000:1.0:1790740366.955204:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022036992:0@lo:400:kworker.0 00000100:00100000:3.0:1790740366.955207:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022037120 00000100:00100000:3.0:1790740366.955209:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022037120 00000100:00100000:3.0:1790740366.955226:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022037376 00000100:00100000:3.0:1790740366.955229:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022037376 00000100:00100000:3.0:1790740366.955240:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022037888 00000100:00100000:3.0:1790740366.955243:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022037888 00000100:00100000:3.0:1790740366.955252:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022037504 00000100:00100000:1.0:1790740366.955252:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022036736 00000100:00100000:3.0:1790740366.955255:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022037504 00000100:00100000:1.0:1790740366.955255:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022036736 00000100:00100000:3.0:1790740366.955265:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022038016 00000100:00100000:3.0:1790740366.955267:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022038016 00000100:00100000:1.0:1790740366.955274:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1790740366.955279:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1790740366.955280:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99057850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3638:x1877727022036736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740366.955284:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877727022036864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740366.955309:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99057850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3638:x1877727022036736:12345-0@lo:400:kworker.0 Request processed in 29us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740366.955314:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877727022036864:12345-0@lo:400:kworker.0 Request processed in 30us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740366.955316:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1790740366.955319:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1790740366.955330:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1790740366.955335:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfd03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877727022037120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740366.955361:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfd03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877727022037120:12345-0@lo:400:kworker.0 Request processed in 26us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740366.955365:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84493b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877727022036864:0@lo:400:kworker.0 00000100:00100000:3.0:1790740366.955366:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1790740366.955378:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1790740366.955384:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877727022037376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740366.955400:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84493800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727022036736:0@lo:400:kworker.0 00000100:00100000:3.0:1790740366.955415:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877727022037376:12345-0@lo:400:kworker.0 Request processed in 32us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740366.955416:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84492a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022037248:0@lo:400:kworker.0 00000100:00100000:3.0:1790740366.955421:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1790740366.955424:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db845c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022037760:0@lo:400:kworker.0 00000100:00100000:3.0:1790740366.955432:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1790740366.955432:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022038272:0@lo:400:kworker.0 00000100:00100000:3.0:1790740366.955438:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877727022037888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740366.955440:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84491180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877727022037120:0@lo:400:kworker.0 00000100:00100000:1.0:1790740366.955448:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84492300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022037632:0@lo:400:kworker.0 00000100:00100000:1.0:1790740366.955456:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022038144:0@lo:400:kworker.0 00000100:00100000:3.0:1790740366.955461:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877727022037888:12345-0@lo:400:kworker.0 Request processed in 25us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740366.955468:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022036608:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790740366.955475:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1790740366.955486:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1790740366.955491:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877727022037504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740366.955514:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84493100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1877727022037376:0@lo:400:kworker.0 00000100:00100000:3.0:1790740366.955517:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877727022037504:12345-0@lo:400:kworker.0 Request processed in 27us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740366.955522:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb81b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1877727022037888:0@lo:400:kworker.0 00000100:00100000:3.0:1790740366.955523:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1790740366.955534:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00010000:00080000:1.0:1790740366.955539:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db84492680 x1877727022037504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740366.955540:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877727022038016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740366.955549:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84492680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1877727022037504:0@lo:400:kworker.0 00000100:00100000:3.0:1790740366.955563:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877727022038016:12345-0@lo:400:kworker.0 Request processed in 24us (761us total) trans 0 rc 0/0 00010000:00080000:1.0:1790740366.955565:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcb81b4a80 x1877727022038016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740366.955569:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1790740366.955573:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb81b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1877727022038016:0@lo:400:kworker.0 00000100:00080000:0.0:1790740366.955686:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790740366.955698:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790740366.955701:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790740366.960446:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790740366.964491:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022038400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790740366.964579:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740366.964737:0:10118:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022038400 00000100:00100000:2.0:1790740366.964749:0:10118:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022038400 00000100:00100000:2.0:1790740366.964820:0:10118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1790740366.964830:0:10118:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022038400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790740366.964856:0:10118:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790740366.964916:0:10118:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022038400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740366.964924:0:10118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1790740366.965634:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022038400:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790740367.851027:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740367.978550:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790740367.978586:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022038528:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790740367.978662:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740367.979067:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022038528 00000100:00100000:0.0:1790740367.979077:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022038528 00000100:00100000:0.0:1790740367.979133:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1790740367.979143:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaef8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727022038528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790740367.979179:0:6541:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1790740367.979243:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaef8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727022038528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740367.979251:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1790740367.979387:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022038528:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790740368.044207:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740368.044302:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000993536 00000100:00100000:3.0:1790740368.044313:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000993536 00000100:00100000:3.0:1790740368.044401:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 149 00000100:00100000:3.0:1790740368.044412:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+13:12161:x1877727000993536:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790740368.044432:0:6537:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740368.044456:0:6537:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e513 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23e2f expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740368.044549:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e51a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740368.044604:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e51a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740368.044617:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e51a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740368.044634:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e521 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740368.044641:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e521 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740368.044647:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e521 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740368.044756:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e528 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740368.044766:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e528 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740368.044773:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e528 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740368.044783:0:6537:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1790740368.044858:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e51a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740368.044866:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e51a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740368.044872:0:6537:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e51a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740368.044885:0:6537:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc8200 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740368.044890:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e51a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740368.044898:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e51a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740368.044910:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98dc985be500) 00010000:00010000:3.0:1790740368.044913:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740368.044918:0:6537:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e51a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740368.044923:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e51a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740368.044938:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e521 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740368.044944:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e521 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740368.044949:0:6537:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e521 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740368.044954:0:6537:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc8a00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740368.044956:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e521 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740368.044962:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e521 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740368.044980:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff98dcaf04c000) 00010000:00010000:3.0:1790740368.044982:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740368.044985:0:6537:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e521 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740368.044991:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e521 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740368.045301:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e513 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e2f expref: 16 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740368.045317:0:6537:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e528 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e2f expref: 15 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740368.045324:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98db82949800) 00010000:00010000:3.0:1790740368.045326:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740368.045328:0:6537:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc9800, rc 0) 00000100:00100000:3.0:1790740368.045398:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+15:12161:x1877727000993536:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 988us (1200us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1790740368.045407:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 149 00000100:00080000:0.0:1790740368.045945:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790740368.059303:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740368.059639:0:10416:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000993664 00000100:00100000:1.0:1790740368.059650:0:10416:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000993664 00000100:00100000:1.0:1790740368.059720:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 11 00000100:00100000:1.0:1790740368.059732:0:10416:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc86ac0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7bed19f2-4c98-4684-89e7-a6871565665d+15:2404:x1877727000993664:12345-192.168.204.3@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1790740368.059854:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00010000:00010000:1.0:1790740368.059857:0:10416:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790740368.059888:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000993792 00000100:00100000:2.0:1790740368.059894:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000993792 00010000:00010000:1.0:1790740368.059903:0:10416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e528 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e2f expref: 16 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740368.059927:0:10416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98db82949800) 00010000:00010000:1.0:1790740368.059933:0:10416:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740368.059935:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 150 00000100:00100000:2.0:1790740368.059957:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+15:12161:x1877727000993792:12345-192.168.204.3@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1790740368.059992:0:10416:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc86ac0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7bed19f2-4c98-4684-89e7-a6871565665d+15:2404:x1877727000993664:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 262us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740368.060001:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 11 00000100:00100000:2.0:1790740368.060070:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+14:12161:x1877727000993792:12345-192.168.204.3@tcp:59:lhsmtool_posix.0 Request processed in 126us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740368.060084:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 150 00000100:00100000:1.0:1790740368.065442:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740368.065647:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000993920 00000100:00100000:0.0:1790740368.065658:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000993920 00000100:00100000:0.0:1790740368.065725:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 151 00000100:00100000:0.0:1790740368.065736:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+5:12161:x1877727000993920:12345-192.168.204.3@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1790740368.065848:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+5:12161:x1877727000993920:12345-192.168.204.3@tcp:59:lhsmtool_posix.0 Request processed in 114us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740368.065856:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 151 00000100:00080000:2.0:1790740368.066411:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:3.0:1790740368.170743:0:13823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790740368.875071:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790740368.938420:0:13821:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790740368.938430:0:13821:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790740368.939070:0:13821:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1790740368.939080:0:13821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1790740369.898611:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740370.026617:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaef88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022038656:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790740370.026687:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740370.026761:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022038656 00000100:00100000:3.0:1790740370.026769:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022038656 00000100:00100000:3.0:1790740370.026813:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1790740370.026823:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaef89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022038656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790740370.026878:0:7846:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1790740370.026927:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaef89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022038656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740370.026935:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1790740370.026990:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaef88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022038656:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790740370.141130:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740370.142142:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000994048 00000100:00100000:3.0:1790740370.142156:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000994048 00000100:00100000:3.0:1790740370.142245:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 152 00000100:00100000:3.0:1790740370.142256:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+14:12203:x1877727000994048:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:3.0:1790740370.142278:0:6537:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740370.142298:0:6537:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e536 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23e36 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740370.142363:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e53d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740370.142379:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e53d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740370.142390:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e53d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740370.142404:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e544 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740370.142411:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e544 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740370.142418:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e544 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740370.142488:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e53d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740370.142496:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e53d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740370.142502:0:6537:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e53d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740370.142508:0:6537:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc9e00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740370.142513:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e53d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740370.142520:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e53d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740370.142543:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98dcaf045a00) 00010000:00010000:3.0:1790740370.142546:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740370.142551:0:6537:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e53d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740370.142557:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e53d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740370.142569:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e544 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740370.142574:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e544 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740370.142579:0:6537:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e544 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740370.142593:0:6537:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc8200 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740370.142596:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e544 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740370.142601:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e544 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740370.142608:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff98dcaf04c000) 00010000:00010000:3.0:1790740370.142610:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740370.142613:0:6537:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e544 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740370.142617:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e544 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740370.142647:0:6537:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e536 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e36 expref: 15 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740370.142656:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98dcaf045a00) 00010000:00010000:3.0:1790740370.142659:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740370.142662:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e536 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e36 expref: 15 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740370.142671:0:6537:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc8a00, rc 0) 00000100:00100000:3.0:1790740370.142734:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+14:12203:x1877727000994048:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 481us (1613us total) trans 0 rc 301/301 00000100:00100000:3.0:1790740370.142742:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 152 00000100:00080000:2.0:1790740370.143120:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790740370.159245:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740370.161596:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000994304 00000100:00100000:0.0:1790740370.161610:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000994304 00000100:00100000:0.0:1790740370.161712:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 153 00000100:00100000:0.0:1790740370.161723:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+14:12203:x1877727000994304:12345-192.168.204.3@tcp:36:lfs.0 00010000:00010000:0.0:1790740370.161787:0:13222:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740370.161815:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92de98 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c61 expref: 14 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.161832:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98dcaf045a00) 00010000:00010000:0.0:1790740370.161857:0:13222:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790740370.161922:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060a00/0xb25dda4f4e92e54b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.161936:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060a00/0xb25dda4f4e92e54b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.161946:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060a00/0xb25dda4f4e92e54b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.162104:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e552 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.162112:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e552 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.162118:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e552 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.162661:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92e559 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.162671:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92e559 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.162678:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92e559 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790740370.162701:0:13222:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007851b7ab reply state 00000000a614ab56 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92e559 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.162712:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92e559 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.162718:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98dc887e4800) 00010000:00010000:0.0:1790740370.162721:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790740370.162724:0:13222:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1790740370.162728:0:13222:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1790740370.162735:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060a00/0xb25dda4f4e92e54b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.162742:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060a00/0xb25dda4f4e92e54b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.162749:0:13222:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060a00/0xb25dda4f4e92e54b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.162754:0:13222:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf060a00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:0.0:1790740370.162759:0:13222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060a00/0xb25dda4f4e92e54b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.162766:0:13222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060a00/0xb25dda4f4e92e54b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.162774:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98dc887e4000) 00010000:00010000:0.0:1790740370.162777:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740370.162781:0:13222:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060a00/0xb25dda4f4e92e54b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.162797:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060a00/0xb25dda4f4e92e54b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790740370.162811:0:13222:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007851b7ab reply state 00000000a614ab56 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e552 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.162819:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e552 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.162824:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff98dc887e4200) 00010000:00010000:0.0:1790740370.162826:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790740370.162828:0:13222:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1790740370.163122:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+15:12203:x1877727000994304:12345-192.168.204.3@tcp:36:lfs.0 Request processed in 1399us (3884us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1790740370.163130:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 153 00000100:00100000:3.0:1790740370.308262:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740370.308386:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000994432 00000100:00100000:1.0:1790740370.308396:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000994432 00000100:00100000:1.0:1790740370.308455:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 154 00000100:00100000:1.0:1790740370.308466:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaef88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+15:12211:x1877727000994432:12345-192.168.204.3@tcp:101:lctl.0 00010000:00010000:1.0:1790740370.308496:0:6536:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740370.308533:0:6536:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e560 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23e3d expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740370.308678:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92e567 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740370.308692:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92e567 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740370.308704:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92e567 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740370.308751:0:6536:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1790740370.308755:0:6536:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790740370.308784:0:6536:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92e567 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740370.308809:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e560 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e3d expref: 17 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740370.308828:0:6536:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92e567 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e3d expref: 16 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740370.308837:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98dc985be400) 00010000:00010000:1.0:1790740370.308839:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790740370.308842:0:6536:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcbfc45e00, rc 0) 00000100:00100000:1.0:1790740370.308907:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaef88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+16:12211:x1877727000994432:12345-192.168.204.3@tcp:101:lctl.0 Request processed in 442us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740370.308914:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 154 00000100:00100000:1.0:1790740370.370597:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740370.370706:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000994560 00000100:00100000:2.0:1790740370.370717:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000994560 00000100:00100000:2.0:1790740370.370956:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 155 00000100:00100000:2.0:1790740370.370968:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+16:12217:x1877727000994560:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:2.0:1790740370.370992:0:7760:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740370.371028:0:7760:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92e56e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23e44 expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.371117:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92e575 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.371131:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92e575 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.371142:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92e575 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.371154:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92e57c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.371183:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92e57c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.371190:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92e57c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.371275:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92e583 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.371284:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92e583 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.371290:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92e583 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740370.371330:0:7760:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1790740370.371334:0:7760:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790740370.371356:0:7760:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92e583 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.371368:0:7760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92e575 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.371375:0:7760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92e575 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.371382:0:7760:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92e575 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.371388:0:7760:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f32400 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740370.371392:0:7760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92e575 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.371406:0:7760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92e575 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.371419:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98dc985be400) 00010000:00010000:2.0:1790740370.371422:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740370.371428:0:7760:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92e575 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.371448:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92e575 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.371462:0:7760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92e57c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.371468:0:7760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92e57c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.371474:0:7760:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92e57c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.371479:0:7760:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f32e00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740370.371481:0:7760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92e57c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.371488:0:7760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92e57c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.371495:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff98dc887e4200) 00010000:00010000:2.0:1790740370.371497:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740370.371500:0:7760:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92e57c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.371515:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92e57c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.371552:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92e56e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e44 expref: 18 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.371566:0:7760:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92e583 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e44 expref: 17 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.371573:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98dc887e4800) 00010000:00010000:2.0:1790740370.371576:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1790740370.371578:0:7760:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f32200, rc 0) 00000100:00100000:2.0:1790740370.371651:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+17:12217:x1877727000994560:12345-192.168.204.3@tcp:101:bash.0 Request processed in 685us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740370.371659:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 155 00000100:00100000:3.0:1790740370.376309:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740370.376403:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000994816 00000100:00100000:0.0:1790740370.376414:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000994816 00000100:00100000:0.0:1790740370.376474:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 156 00000100:00100000:0.0:1790740370.376483:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc884b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+17:12217:x1877727000994816:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:0.0:1790740370.376504:0:13222:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740370.376535:0:13222:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060a00/0xb25dda4f4e92e58a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23e4b expref: -99 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.376639:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e591 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.376655:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e591 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.376685:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e591 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.376744:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3a00/0xb25dda4f4e92e598 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.376753:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3a00/0xb25dda4f4e92e598 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.376760:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3a00/0xb25dda4f4e92e598 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790740370.377160:0:13222:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:0.0:1790740370.377305:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3c00/0xb25dda4f4e92e59f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.377314:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3c00/0xb25dda4f4e92e59f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.377321:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3c00/0xb25dda4f4e92e59f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.377353:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e591 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.377361:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e591 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.377368:0:13222:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e591 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.377374:0:13222:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf061c00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:0.0:1790740370.377385:0:13222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e591 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.377393:0:13222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e591 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.377405:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98dc887e4800) 00010000:00010000:0.0:1790740370.377409:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740370.377413:0:13222:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e591 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.377420:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061c00/0xb25dda4f4e92e591 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790740370.377435:0:13222:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000285a00fc reply state 00000000e6cffe43 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3a00/0xb25dda4f4e92e598 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.377445:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3a00/0xb25dda4f4e92e598 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.377450:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98dc887e4000) 00010000:00010000:0.0:1790740370.377453:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790740370.377455:0:13222:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790740370.377484:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060a00/0xb25dda4f4e92e58a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e4b expref: 20 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.377499:0:13222:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3c00/0xb25dda4f4e92e59f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e4b expref: 19 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.377507:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc887e4f00) 00010000:00010000:0.0:1790740370.377509:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790740370.377528:0:13222:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaeee3c00, rc 0) 00000100:00100000:0.0:1790740370.377605:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc884b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+20:12217:x1877727000994816:12345-192.168.204.3@tcp:101:bash.0 Request processed in 1123us (1305us total) trans 4294967419 rc 0/0 00000100:00100000:0.0:1790740370.377613:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 156 00000100:00100000:3.0:1790740370.384186:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740370.384650:0:14497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000994944 00000100:00100000:0.0:1790740370.384660:0:14497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000994944 00000100:00100000:0.0:1790740370.384762:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 55 00000100:00100000:0.0:1790740370.384774:0:14497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc884b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7bed19f2-4c98-4684-89e7-a6871565665d+5:2404:x1877727000994944:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:0.0:1790740370.384906:0:14497:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740370.384931:0:14497:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007fccda41/0xb25dda4f4e92e5ad lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23e52 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1790740370.385217:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:1.0:1790740370.385264:0:14497:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790740370.385288:0:14497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1790740370.385293:0:14497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790740370.385303:0:14497:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fccda41/0xb25dda4f4e92e5ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e52 expref: 6 pid: 14497 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740370.385324:0:14497:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007fccda41/0xb25dda4f4e92e5ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e52 expref: 6 pid: 14497 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740370.385336:0:14497:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaeee2200, rc 0) 00000100:00100000:1.0:1790740370.385443:0:14497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc884b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7bed19f2-4c98-4684-89e7-a6871565665d+6:2404:x1877727000994944:12345-192.168.204.3@tcp:101:bash.0 Request processed in 671us (1265us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740370.385468:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 55 00000100:00100000:3.0:1790740370.388904:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740370.389303:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000995072 00000100:00100000:2.0:1790740370.389315:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000995072 00000100:00100000:2.0:1790740370.389414:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 56 00000100:00100000:2.0:1790740370.389424:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfcedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7bed19f2-4c98-4684-89e7-a6871565665d+6:12217:x1877727000995072:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:2.0:1790740370.389452:0:9806:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740370.389473:0:9806:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c130e9a4/0xb25dda4f4e92e5b4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23e59 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.389503:0:9806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007fccda41/0xb25dda4f4e92e5ad lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e52 expref: 7 pid: 14497 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.389541:0:9806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740370.389545:0:9806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740370.389552:0:9806:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c130e9a4/0xb25dda4f4e92e5b4 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e59 expref: 7 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.389588:0:9806:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007fccda41/0xb25dda4f4e92e5ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e52 expref: 7 pid: 14497 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.389600:0:9806:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007fccda41/0xb25dda4f4e92e5ad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e52 expref: 7 pid: 14497 timeout: 541 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740370.389615:0:9806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9806:1877727022038784:192.168.204.3@tcp:104: 00000100:00100000:2.0:1790740370.390091:0:9806:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83d059c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740370.393845:0:9806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9806:1877727022038784:192.168.204.3@tcp:104: 00010000:00010000:2.0:1790740370.393881:0:9806:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c130e9a4/0xb25dda4f4e92e5b4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e59 expref: 7 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.393904:0:9806:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f32a00, rc 0) 00000100:00100000:2.0:1790740370.393970:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfcedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7bed19f2-4c98-4684-89e7-a6871565665d+7:12217:x1877727000995072:12345-192.168.204.3@tcp:101:bash.0 Request processed in 4546us (5075us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740370.393980:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 56 00000100:00100000:1.0:1790740370.395819:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740370.396074:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000995200 00000100:00100000:0.0:1790740370.396084:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000995200 00010000:00010000:0.0:1790740370.396125:0:6522:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007fccda41/0xb25dda4f4e92e5ad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e52 expref: 7 pid: 14497 timeout: 541 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740370.396166:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 79 00000100:00100000:0.0:1790740370.396176:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7bed19f2-4c98-4684-89e7-a6871565665d+7:2402:x1877727000995200:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790740370.396191:0:6522:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740370.396212:0:6522:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007fccda41/0xb25dda4f4e92e5ad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e52 expref: 7 pid: 14497 timeout: 541 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.396225:0:6522:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007fccda41/0xb25dda4f4e92e5ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e52 expref: 7 pid: 14497 timeout: 541 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.396248:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fccda41/0xb25dda4f4e92e5ad lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e52 expref: 7 pid: 14497 timeout: 541 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.396281:0:6522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740370.396286:0:6522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740370.396295:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c130e9a4/0xb25dda4f4e92e5b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e59 expref: 6 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.396306:0:6522:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c130e9a4/0xb25dda4f4e92e5b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e59 expref: 6 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.396345:0:6522:0:(ldlm_lockd.c:1085:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c130e9a4/0xb25dda4f4e92e5b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e59 expref: 6 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740370.396360:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6522:1877727022038912:192.168.204.3@tcp:105: 00000100:00100000:0.0:1790740370.396447:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83effe40 going to sleep for 11 seconds 00000100:00100000:0.0:1790740370.400402:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6522:1877727022038912:192.168.204.3@tcp:105: 00010000:00010000:0.0:1790740370.400442:0:6522:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740370.400500:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7bed19f2-4c98-4684-89e7-a6871565665d+6:2402:x1877727000995200:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 4324us (4687us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740370.400512:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 79 00000100:00100000:3.0:1790740370.403258:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740370.403366:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000995456 00000100:00100000:0.0:1790740370.403377:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000995456 00000100:00100000:0.0:1790740370.403442:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 36 00000100:00100000:0.0:1790740370.403452:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+20:12217:x1877727000995456:12345-192.168.204.3@tcp:35:bash.0 00000100:00100000:0.0:1790740370.403760:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+21:12217:x1877727000995456:12345-192.168.204.3@tcp:35:bash.0 Request processed in 308us (511us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1790740370.403786:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 36 00000100:00100000:1.0:1790740370.508742:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740370.508843:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000995712 00000100:00100000:3.0:1790740370.508854:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000995712 00000100:00100000:3.0:1790740370.508916:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 157 00000100:00100000:3.0:1790740370.508926:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+21:12227:x1877727000995712:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:3.0:1790740370.508961:0:6537:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740370.508982:0:6537:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e5bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23e60 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740370.509129:0:6537:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1790740370.509227:0:6537:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e5bb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e60 expref: 23 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740370.509240:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98dc985be400) 00010000:00010000:3.0:1790740370.509243:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790740370.509248:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e5bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e60 expref: 23 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740370.509261:0:6537:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc8a00, rc 0) 00000100:00100000:3.0:1790740370.509490:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+22:12227:x1877727000995712:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 564us (756us total) trans 4294967421 rc 301/301 00000100:00100000:3.0:1790740370.509497:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 157 00000100:00100000:2.0:1790740370.521990:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740370.522216:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000995968 00000100:00100000:0.0:1790740370.522226:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000995968 00000100:00100000:0.0:1790740370.522289:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 37 00000100:00100000:0.0:1790740370.522300:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+22:12227:x1877727000995968:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:0.0:1790740370.522702:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+23:12227:x1877727000995968:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 403us (722us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1790740370.522710:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 37 00000100:00100000:2.0:1790740370.538281:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790740370.538293:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790740370.538306:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022039168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790740370.538307:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfc13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022039040:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790740370.541857:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740370.542199:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022039168 00000100:00100000:0.0:1790740370.542210:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022039168 00000100:00080000:3.0:1790740370.542243:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790740370.542278:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1790740370.542289:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022039168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790740370.544326:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1790740370.544430:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022039168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2141us (2577us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740370.544440:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1790740370.544595:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022039168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790740370.546836:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740370.547203:0:10118:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022039040 00000100:00100000:3.0:1790740370.547213:0:10118:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022039040 00000100:00100000:3.0:1790740370.547293:0:10118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1790740370.547302:0:10118:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb81b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022039040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790740370.547327:0:10118:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1790740370.547390:0:10118:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb81b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022039040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740370.547397:0:10118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1790740370.547488:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfc13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022039040:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1790740370.549253:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790740370.626484:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740370.626601:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000996096 00000100:00100000:0.0:1790740370.626612:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000996096 00000100:00100000:0.0:1790740370.626679:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 158 00000100:00100000:0.0:1790740370.626690:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+23:12233:x1877727000996096:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:0.0:1790740370.626718:0:13222:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740370.626740:0:13222:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2200/0xb25dda4f4e92e5c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23e67 expref: -99 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.626810:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2800/0xb25dda4f4e92e5d0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.626828:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2800/0xb25dda4f4e92e5d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.626856:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2800/0xb25dda4f4e92e5d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790740370.627560:0:13222:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1790740370.627566:0:13222:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790740370.627588:0:13222:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2800/0xb25dda4f4e92e5d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.627619:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2200/0xb25dda4f4e92e5c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e67 expref: 25 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.627638:0:13222:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2800/0xb25dda4f4e92e5d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e67 expref: 24 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.627647:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98dc887e4800) 00010000:00010000:0.0:1790740370.627650:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790740370.627653:0:13222:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaeee2800, rc 0) 00000100:00100000:0.0:1790740370.627772:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+24:12233:x1877727000996096:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 1083us (1297us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740370.627780:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 158 00000100:00100000:1.0:1790740370.639371:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740370.639459:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000996352 00000100:00100000:2.0:1790740370.639471:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000996352 00000100:00100000:2.0:1790740370.639552:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 159 00000100:00100000:2.0:1790740370.639564:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb81b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+24:12233:x1877727000996352:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:2.0:1790740370.639597:0:7760:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740370.639621:0:7760:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92e5d7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23e6e expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.639727:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92e5de lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.639742:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92e5de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.639752:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92e5de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740370.639763:0:7760:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1790740370.639873:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92e5d7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e6e expref: 27 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.639904:0:7760:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92e5de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e6e expref: 26 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.639926:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc887e4f00) 00010000:00010000:2.0:1790740370.639929:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790740370.639933:0:7760:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f33e00, rc 0) 00000100:00100000:2.0:1790740370.640000:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb81b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+26:12233:x1877727000996352:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 439us (640us total) trans 4294967423 rc 0/0 00000100:00100000:2.0:1790740370.640007:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 159 00000100:00100000:2.0:1790740370.645293:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740370.645329:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740370.645432:0:9550:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000996480 00000100:00100000:0.0:1790740370.645442:0:9550:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000996480 00000100:00100000:0.0:1790740370.645511:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 12 00000100:00100000:0.0:1790740370.645531:0:9550:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc81326a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7bed19f2-4c98-4684-89e7-a6871565665d+26:2402:x1877727000996480:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790740370.645550:0:9550:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740370.645579:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92e5de lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e6e expref: 26 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.645620:0:9550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc887e4f00) 00010000:00010000:0.0:1790740370.645625:0:9550:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740370.645683:0:9550:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc81326a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7bed19f2-4c98-4684-89e7-a6871565665d+25:2402:x1877727000996480:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 153us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740370.645691:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 12 00000100:00100000:3.0:1790740370.647294:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000996736 00000100:00100000:3.0:1790740370.647305:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000996736 00000100:00100000:2.0:1790740370.647493:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 160 00000100:00100000:2.0:1790740370.647503:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc81325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+25:12233:x1877727000996736:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:2.0:1790740370.647535:0:6537:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740370.647557:0:6537:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92e5ec lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23e75 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.647682:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92e5f3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.647700:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92e5f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.647714:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92e5f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740370.647728:0:6537:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1790740370.647836:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92e5ec lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e75 expref: 28 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.647871:0:6537:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92e5f3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e75 expref: 27 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.647895:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc887e4f00) 00010000:00010000:2.0:1790740370.647899:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790740370.647903:0:6537:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f33000, rc 0) 00000100:00100000:2.0:1790740370.647971:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc81325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+27:12233:x1877727000996736:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 469us (2640us total) trans 4294967424 rc 0/0 00000100:00100000:2.0:1790740370.647978:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 160 00000100:00100000:1.0:1790740370.655390:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740370.659072:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000996864 00000100:00100000:0.0:1790740370.659089:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000996864 00000100:00100000:0.0:1790740370.659383:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 57 00000100:00100000:0.0:1790740370.659395:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bed19f2-4c98-4684-89e7-a6871565665d+6:2403:x1877727000996864:12345-192.168.204.3@tcp:1:lfs.0 00010000:00010000:0.0:1790740370.659453:0:8451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fccda41/0xb25dda4f4e92e601 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.659475:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c130e9a4/0xb25dda4f4e92e5b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e59 expref: 6 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.659482:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740370.659487:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790740370.659492:0:8451:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fccda41/0xb25dda4f4e92e601 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.659540:0:8451:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c130e9a4/0xb25dda4f4e92e5b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e59 expref: 6 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.659556:0:8451:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c130e9a4/0xb25dda4f4e92e5b4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e59 expref: 6 pid: 9806 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740370.659591:0:8451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8451:1877727022039296:192.168.204.3@tcp:104: 00000100:00100000:0.0:1790740370.659701:0:8451:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83eff240 going to sleep for 11 seconds 00000100:00100000:0.0:1790740370.664666:0:8451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8451:1877727022039296:192.168.204.3@tcp:104: 00010000:00010000:0.0:1790740370.664696:0:8451:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007fccda41/0xb25dda4f4e92e601 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740370.666646:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740370.666867:0:8459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000996992 00000100:00100000:2.0:1790740370.666875:0:8459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000996992 00002000:00100000:2.0:1790740370.666946:0:8459:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff98db82330380 x1877727000996992/t0(0) o4->7bed19f2-4c98-4684-89e7-a6871565665d@192.168.204.3@tcp:426/0 lens 504/0 e 0 to 0 dl 1790740381 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790740370.666958:0:8459:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98db82330380 with x1877727000996992 ext(0->12) 00010000:00010000:2.0:1790740370.666968:0:8459:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c130e9a4/0xb25dda4f4e92e5b4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e59 expref: 7 pid: 9806 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.666987:0:8459:0:(ldlm_lockd.c:610:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c130e9a4/0xb25dda4f4e92e5b4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e59 expref: 7 pid: 9806 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790740370.666996:0:8459:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98db82330380 00000100:00100000:2.0:1790740370.667065:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 2 00000100:00100000:2.0:1790740370.667076:0:8459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82330380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7bed19f2-4c98-4684-89e7-a6871565665d+7:2402:x1877727000996992:12345-192.168.204.3@tcp:4:lfs.0 00000100:00100000:2.0:1790740370.668480:0:8459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82330380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7bed19f2-4c98-4684-89e7-a6871565665d+9:2402:x1877727000996992:12345-192.168.204.3@tcp:4:lfs.0 Request processed in 1398us (1834us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1790740370.668502:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 2 00002000:00100000:2.0:1790740370.668524:0:8459:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff98db82330380 x1877727000996992/t4294967306(0) o4->7bed19f2-4c98-4684-89e7-a6871565665d@192.168.204.3@tcp:426/0 lens 504/448 e 0 to 0 dl 1790740381 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790740370.668536:0:8459:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98db82330380 with x1877727000996992 ext(0->12) 00010000:00010000:2.0:1790740370.668545:0:8459:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c130e9a4/0xb25dda4f4e92e5b4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e59 expref: 9 pid: 9806 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.668563:0:8459:0:(ldlm_lockd.c:610:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c130e9a4/0xb25dda4f4e92e5b4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e59 expref: 9 pid: 9806 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790740370.668570:0:8459:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98db82330380 00000100:00100000:2.0:1790740370.673134:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740370.675292:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000997120 00000100:00100000:1.0:1790740370.675308:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000997120 00010000:00010000:1.0:1790740370.675365:0:6521:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c130e9a4/0xb25dda4f4e92e5b4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e59 expref: 9 pid: 9806 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740370.676130:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 80 00000100:00100000:1.0:1790740370.676145:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc81327480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7bed19f2-4c98-4684-89e7-a6871565665d+9:2403:x1877727000997120:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740370.676163:0:6521:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1790740370.676182:0:6521:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1790740370.676185:0:6521:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1790740370 00002000:00010000:1.0:1790740370.676187:0:6521:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1790740370 00002000:00010000:1.0:1790740370.676189:0:6521:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1790740370 00002000:00010000:1.0:1790740370.676191:0:6521:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1790740370.676197:0:6521:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c130e9a4/0xb25dda4f4e92e5b4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e59 expref: 9 pid: 9806 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740370.676231:0:6521:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c130e9a4/0xb25dda4f4e92e5b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e59 expref: 9 pid: 9806 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740370.676255:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c130e9a4/0xb25dda4f4e92e5b4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e59 expref: 9 pid: 9806 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740370.676272:0:6521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790740370.676276:0:6521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790740370.676283:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007fccda41/0xb25dda4f4e92e601 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740370.676292:0:6521:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fccda41/0xb25dda4f4e92e601 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740370.676327:0:6521:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740370.676402:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc81327480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7bed19f2-4c98-4684-89e7-a6871565665d+8:2403:x1877727000997120:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 263us (3277us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740370.676410:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 80 00010000:00010000:0.0:1790740370.676559:0:8451:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007fccda41/0xb25dda4f4e92e601 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.676568:0:8451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007fccda41/0xb25dda4f4e92e601 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.676587:0:8451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fccda41/0xb25dda4f4e92e601 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.676595:0:8451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007fccda41/0xb25dda4f4e92e601 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.676604:0:8451:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007fccda41/0xb25dda4f4e92e601 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.676612:0:8451:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee2200 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:0.0:1790740370.676617:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007fccda41/0xb25dda4f4e92e601 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.676639:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007fccda41/0xb25dda4f4e92e601 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.676652:0:8451:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007fccda41/0xb25dda4f4e92e601 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.676660:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fccda41/0xb25dda4f4e92e601 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740370.676708:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bed19f2-4c98-4684-89e7-a6871565665d+7:2403:x1877727000996864:12345-192.168.204.3@tcp:1:lfs.0 Request processed in 17316us (21329us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740370.676716:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 57 00000100:00100000:2.0:1790740370.680550:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740370.681396:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000997376 00000100:00100000:3.0:1790740370.681407:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000997376 00000100:00100000:3.0:1790740370.681547:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 38 00000100:00100000:3.0:1790740370.681558:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc9925d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+27:12233:x1877727000997376:12345-192.168.204.3@tcp:35:lfs.0 00000004:00010000:3.0:1790740370.682008:0:6538:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92e5f3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e75 expref: 27 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790740370.682234:0:6538:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:3.0:1790740370.682271:0:6538:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1790740370.682879:0:6538:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:3.0:1790740370.682925:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e608 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740370.682942:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3c00/0xb25dda4f4e92e59f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e4b expref: 31 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740370.682952:0:6538:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e608 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740370.682989:0:6538:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3c00/0xb25dda4f4e92e59f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e4b expref: 31 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740370.683026:0:6538:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3c00/0xb25dda4f4e92e59f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e4b expref: 31 pid: 13222 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740370.683083:0:6538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfcef480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6538:1877727022039424:192.168.204.3@tcp:104: 00000100:00100000:3.0:1790740370.683174:0:6538:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82c98480 going to sleep for 11 seconds 00000100:00100000:3.0:1790740370.688599:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740370.688696:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000997504 00000100:00100000:1.0:1790740370.688707:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000997504 00010000:00010000:1.0:1790740370.688751:0:6522:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3c00/0xb25dda4f4e92e59f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e4b expref: 32 pid: 13222 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740370.688804:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 81 00000100:00100000:1.0:1790740370.688814:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfced500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7bed19f2-4c98-4684-89e7-a6871565665d+32:2403:x1877727000997504:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740370.688845:0:6522:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740370.688852:0:6522:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3c00/0xb25dda4f4e92e59f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e4b expref: 32 pid: 13222 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740370.688866:0:6522:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3c00/0xb25dda4f4e92e59f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e4b expref: 32 pid: 13222 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740370.688888:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc887e4f00) 00010000:00010000:1.0:1790740370.688893:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e608 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740370.688903:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e608 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740370.688911:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e608 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740370.688945:0:6522:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740370.689009:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfced500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7bed19f2-4c98-4684-89e7-a6871565665d+32:2403:x1877727000997504:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 196us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740370.689017:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 81 00010000:00010000:0.0:1790740370.690477:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3c00/0xb25dda4f4e92e59f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e4b expref: 31 pid: 13222 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740370.690500:0:6538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfcef480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6538:1877727022039424:192.168.204.3@tcp:104: 00010000:00010000:0.0:1790740370.690534:0:6538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e608 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.690544:0:6538:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e608 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.690550:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e608 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790740370.690670:0:6538:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:0.0:1790740370.690796:0:6538:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:0.0:1790740370.690887:0:6538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6538:1877727022039552:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1790740370.691316:0:6538:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740370.691399:0:6538:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83eff480 going to sleep for 11 seconds 00000100:00100000:1.0:1790740370.694340:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022039552 00000100:00100000:1.0:1790740370.694356:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022039552 00000100:00100000:1.0:1790740370.694509:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1790740370.694534:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6538:x1877727022039552:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1790740370.694681:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6538:x1877727022039552:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 149us (3365us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740370.694689:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1790740370.694875:0:6538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6538:1877727022039552:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1790740370.695066:0:6538:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:0.0:1790740370.695148:0:6538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6538:1877727022039680:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1790740370.695187:0:6538:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740370.695217:0:6538:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc87de30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790740370.695273:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022039680 00000100:00100000:3.0:1790740370.695278:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022039680 00000100:00100000:3.0:1790740370.695308:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1790740370.695315:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6538:x1877727022039680:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1790740370.695422:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6538:x1877727022039680:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 108us (234us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1790740370.695429:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1790740370.695736:0:6538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6538:1877727022039680:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1790740370.695783:0:6538:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:0.0:1790740370.695820:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e608 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.695831:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e608 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.695840:0:6538:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e608 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.695847:0:6538:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc8a00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:0.0:1790740370.695852:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e608 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.695862:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e608 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.695878:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc887e4f00) 00010000:00010000:0.0:1790740370.695882:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1790740370.695897:0:6538:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e608 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.695903:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e608 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790740370.696006:0:6538:0:(mdd_object.c:4180:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1790740370.696225:0:6538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:0.0:1790740370.696238:0:6538:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 441982205876ns, next at 442982202720ns, rc = 0 00000001:00080000:0.0:1790740370.696245:0:6538:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:0.0:1790740370.696266:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc887e4f00) 00010000:00010000:0.0:1790740370.696270:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1790740370.696276:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92e5f3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e75 expref: 35 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740370.696422:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc9925d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+34:12233:x1877727000997376:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 14866us (15881us total) trans 4294967433 rc 0/0 00000100:00100000:0.0:1790740370.696430:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 38 00000020:00080000:0.0:1790740370.696434:0:6538:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:2.0:1790740370.697809:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790740370.702335:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740370.702644:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000997632 00000100:00100000:0.0:1790740370.702655:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000997632 00000100:00100000:0.0:1790740370.702726:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 161 00000100:00100000:0.0:1790740370.702738:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfceca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+34:12233:x1877727000997632:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:0.0:1790740370.702766:0:13222:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740370.702791:0:13222:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2200/0xb25dda4f4e92e60f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23e7c expref: -99 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.702859:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2200/0xb25dda4f4e92e60f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e7c expref: 35 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.702899:0:13222:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2200/0xb25dda4f4e92e60f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e7c expref: 35 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.702919:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc887e4700) 00010000:00010000:0.0:1790740370.702922:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790740370.702926:0:13222:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaeee2200, rc 0) 00000100:00100000:0.0:1790740370.703252:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfceca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+35:12233:x1877727000997632:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 514us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740370.703260:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 161 00000100:00100000:3.0:1790740370.707725:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740370.707906:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000997888 00000100:00100000:0.0:1790740370.707916:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000997888 00000100:00100000:0.0:1790740370.707985:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 39 00000100:00100000:0.0:1790740370.707996:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfcec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+35:12233:x1877727000997888:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:0.0:1790740370.708263:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfcec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+36:12233:x1877727000997888:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 269us (550us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1790740370.708271:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 39 00000100:00100000:3.0:1790740370.811500:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740370.811667:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000998144 00000100:00100000:0.0:1790740370.811679:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000998144 00000100:00100000:0.0:1790740370.811796:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 162 00000100:00100000:0.0:1790740370.811806:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfcee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+36:12243:x1877727000998144:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:0.0:1790740370.811832:0:6535:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740370.811852:0:6535:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3c00/0xb25dda4f4e92e616 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23e83 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790740370.811958:0:6535:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1790740370.812138:0:6535:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3c00/0xb25dda4f4e92e616 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e83 expref: 38 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.812151:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98dc985be400) 00010000:00010000:0.0:1790740370.812154:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790740370.812159:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3c00/0xb25dda4f4e92e616 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e83 expref: 38 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.812172:0:6535:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaeee3c00, rc 0) 00000100:00100000:0.0:1790740370.812233:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfcee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+37:12243:x1877727000998144:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 429us (743us total) trans 4294967435 rc 301/301 00000100:00100000:0.0:1790740370.812240:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 162 00000100:00100000:1.0:1790740370.816502:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740370.816695:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000998272 00000100:00100000:2.0:1790740370.816706:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000998272 00000100:00100000:2.0:1790740370.816767:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 163 00000100:00100000:2.0:1790740370.816777:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+37:12243:x1877727000998272:12345-192.168.204.3@tcp:34:lfs.0 00010000:00010000:2.0:1790740370.816853:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92e624 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.816870:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92e624 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.816884:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92e624 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.816914:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e62b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.816921:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e62b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.816928:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e62b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.817000:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92e632 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.818175:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92e632 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.818193:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92e632 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790740370.818254:0:6537:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92e632 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.818268:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92e624 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.818274:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92e624 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.818281:0:6537:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92e624 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.818287:0:6537:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f32c00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740370.818291:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92e624 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.818312:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92e624 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.818324:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98dc887e4800) 00010000:00010000:2.0:1790740370.818326:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740370.818331:0:6537:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92e624 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.818336:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92e624 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.818351:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e62b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.818357:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e62b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.818363:0:6537:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e62b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.818368:0:6537:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f33200 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740370.818371:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e62b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.818376:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e62b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.818383:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98dc887e4000) 00010000:00010000:2.0:1790740370.818386:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740370.818388:0:6537:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e62b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.818403:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e62b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.818414:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92e632 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.818419:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92e632 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.818426:0:6537:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92e632 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.818430:0:6537:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f32000 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740370.818433:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92e632 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.818439:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92e632 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.818446:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc887e4700) 00010000:00010000:2.0:1790740370.818448:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740370.818451:0:6537:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92e632 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740370.818456:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92e632 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740370.818619:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+37:12243:x1877727000998272:12345-192.168.204.3@tcp:34:lfs.0 Request processed in 1839us (2122us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740370.818628:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 163 00000100:00100000:3.0:1790740370.822689:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740370.823103:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000998528 00000100:00100000:0.0:1790740370.823117:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000998528 00000100:00100000:0.0:1790740370.823176:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 40 00000100:00100000:0.0:1790740370.823187:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+37:12243:x1877727000998528:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:0.0:1790740370.823421:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+38:12243:x1877727000998528:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 235us (741us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1790740370.823428:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 40 00000100:00100000:1.0:1790740370.868156:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740370.868272:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000998784 00000100:00100000:0.0:1790740370.868282:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000998784 00000100:00100000:0.0:1790740370.868344:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 164 00000100:00100000:0.0:1790740370.868354:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+38:12246:x1877727000998784:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:0.0:1790740370.868381:0:13222:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740370.868402:0:13222:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3c00/0xb25dda4f4e92e639 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23e8a expref: -99 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.868521:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2e00/0xb25dda4f4e92e640 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.868538:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2e00/0xb25dda4f4e92e640 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.868549:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2e00/0xb25dda4f4e92e640 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.868562:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3e00/0xb25dda4f4e92e647 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.868569:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3e00/0xb25dda4f4e92e647 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.868576:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3e00/0xb25dda4f4e92e647 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.868689:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2600/0xb25dda4f4e92e64e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.868698:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2600/0xb25dda4f4e92e64e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.868705:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2600/0xb25dda4f4e92e64e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790740370.868715:0:13222:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1790740370.869337:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2e00/0xb25dda4f4e92e640 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.869359:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2e00/0xb25dda4f4e92e640 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.869366:0:13222:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2e00/0xb25dda4f4e92e640 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.869372:0:13222:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee2e00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:0.0:1790740370.869376:0:13222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2e00/0xb25dda4f4e92e640 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.869385:0:13222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2e00/0xb25dda4f4e92e640 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.869398:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98dc887e4800) 00010000:00010000:0.0:1790740370.869401:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740370.869406:0:13222:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2e00/0xb25dda4f4e92e640 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.869411:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2e00/0xb25dda4f4e92e640 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.869426:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3e00/0xb25dda4f4e92e647 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.869431:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3e00/0xb25dda4f4e92e647 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.869436:0:13222:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3e00/0xb25dda4f4e92e647 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.869441:0:13222:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee3e00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:0.0:1790740370.869449:0:13222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3e00/0xb25dda4f4e92e647 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.869456:0:13222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3e00/0xb25dda4f4e92e647 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.869463:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98dc887e4000) 00010000:00010000:0.0:1790740370.869465:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740370.869468:0:13222:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3e00/0xb25dda4f4e92e647 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.869473:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3e00/0xb25dda4f4e92e647 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.869523:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3c00/0xb25dda4f4e92e639 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e8a expref: 41 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.869538:0:13222:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2600/0xb25dda4f4e92e64e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e8a expref: 40 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.869546:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc887e4700) 00010000:00010000:0.0:1790740370.869548:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790740370.869551:0:13222:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaeee2600, rc 0) 00000100:00100000:0.0:1790740370.869624:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+40:12246:x1877727000998784:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 1272us (1479us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1790740370.869633:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 164 00000100:00100000:1.0:1790740370.875657:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740370.875741:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000998912 00000100:00100000:0.0:1790740370.875752:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000998912 00000100:00100000:0.0:1790740370.875818:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 165 00000100:00100000:0.0:1790740370.875829:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+40:12246:x1877727000998912:12345-192.168.204.3@tcp:54:lfs.0 00010000:00010000:0.0:1790740370.875916:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3c00/0xb25dda4f4e92e65c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.875933:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3c00/0xb25dda4f4e92e65c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.875958:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3c00/0xb25dda4f4e92e65c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.875997:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3c00/0xb25dda4f4e92e65c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.876005:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3c00/0xb25dda4f4e92e65c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.876013:0:6535:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3c00/0xb25dda4f4e92e65c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.876019:0:6535:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee3c00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:0.0:1790740370.876024:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3c00/0xb25dda4f4e92e65c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.876061:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3c00/0xb25dda4f4e92e65c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.876074:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc887e4700) 00010000:00010000:0.0:1790740370.876077:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790740370.876083:0:6535:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3c00/0xb25dda4f4e92e65c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740370.876088:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3c00/0xb25dda4f4e92e65c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740370.876169:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+40:12246:x1877727000998912:12345-192.168.204.3@tcp:54:lfs.0 Request processed in 342us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740370.876176:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 165 00000100:00100000:3.0:1790740370.879135:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740370.879261:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000999168 00000100:00100000:0.0:1790740370.879270:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000999168 00000100:00100000:0.0:1790740370.879328:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 41 00000100:00100000:0.0:1790740370.879338:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfcef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+40:12246:x1877727000999168:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:0.0:1790740370.879591:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfcef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+41:12246:x1877727000999168:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 254us (464us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1790740370.879599:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 41 00010000:00010000:3.0:1790740370.922363:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740371.223716:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740371.223845:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000999424 00000100:00100000:3.0:1790740371.223856:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000999424 00000100:00100000:3.0:1790740371.223933:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 166 00000100:00100000:3.0:1790740371.223944:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5f6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+41:12277:x1877727000999424:12345-192.168.204.3@tcp:101:cat.0 00010000:00010000:3.0:1790740371.223970:0:6537:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740371.223994:0:6537:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e663 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23e91 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740371.224161:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e66a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740371.224188:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e66a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740371.224200:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e66a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740371.224212:0:6537:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1790740371.224318:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e663 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e91 expref: 44 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740371.224337:0:6537:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e66a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e91 expref: 43 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740371.224346:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc887e4700) 00010000:00010000:3.0:1790740371.224349:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790740371.224352:0:6537:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc8200, rc 0) 00000100:00100000:3.0:1790740371.224536:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5f6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+43:12277:x1877727000999424:12345-192.168.204.3@tcp:101:cat.0 Request processed in 593us (829us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1790740371.224545:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 166 00000100:00100000:1.0:1790740371.231674:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740371.231771:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740371.232123:0:9550:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000999808 00000100:00100000:2.0:1790740371.232134:0:9550:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000999808 00000100:00100000:2.0:1790740371.232205:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 13 00000100:00100000:2.0:1790740371.232215:0:9550:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7bed19f2-4c98-4684-89e7-a6871565665d+43:2403:x1877727000999808:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790740371.232229:0:9550:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740371.232254:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e66a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e91 expref: 43 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740371.232274:0:9550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc887e4700) 00010000:00010000:2.0:1790740371.232279:0:9550:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740371.232335:0:9550:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7bed19f2-4c98-4684-89e7-a6871565665d+42:2403:x1877727000999808:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 121us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740371.232342:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 13 00000100:00100000:3.0:1790740371.233647:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727000999680 00000100:00100000:3.0:1790740371.233660:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727000999680 00000100:00100000:3.0:1790740371.233713:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 42 00000100:00100000:3.0:1790740371.233721:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+42:12277:x1877727000999680:12345-192.168.204.3@tcp:35:cat.0 00000100:00100000:3.0:1790740371.234486:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+43:12277:x1877727000999680:12345-192.168.204.3@tcp:35:cat.0 Request processed in 760us (2817us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1790740371.234522:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 42 00000100:00100000:1.0:1790740371.344139:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740371.347168:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001000064 00000100:00100000:0.0:1790740371.347186:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001000064 00000100:00100000:0.0:1790740371.347339:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 167 00000100:00100000:0.0:1790740371.347350:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+43:12283:x1877727001000064:12345-192.168.204.3@tcp:101:dd.0 00010000:00010000:0.0:1790740371.347377:0:6536:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740371.347381:0:6536:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790740371.347406:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2800/0xb25dda4f4e92e5d0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e67 expref: 43 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740371.347426:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98dc887e4800) 00010000:00010000:0.0:1790740371.347431:0:6536:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790740371.347444:0:6536:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3c00/0xb25dda4f4e92e678 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23e98 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740371.347573:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3e00/0xb25dda4f4e92e67f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740371.347623:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2600/0xb25dda4f4e92e64e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e8a expref: 43 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740371.347634:0:6536:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3e00/0xb25dda4f4e92e67f lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740371.347672:0:6536:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2600/0xb25dda4f4e92e64e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e8a expref: 43 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740371.347687:0:6536:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2600/0xb25dda4f4e92e64e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e8a expref: 43 pid: 13222 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740371.347702:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6536:1877727022039808:192.168.204.3@tcp:104: 00000100:00100000:0.0:1790740371.347835:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dca0807f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790740371.359277:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740371.359455:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6536:1877727022039808:192.168.204.3@tcp:104: 00010000:00010000:0.0:1790740371.359508:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3e00/0xb25dda4f4e92e67f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740371.359592:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001000192 00000100:00100000:3.0:1790740371.359602:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001000192 00010000:00010000:3.0:1790740371.359653:0:6521:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2600/0xb25dda4f4e92e64e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e8a expref: 44 pid: 13222 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740371.359701:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 82 00000100:00100000:3.0:1790740371.359715:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84492680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7bed19f2-4c98-4684-89e7-a6871565665d+44:2402:x1877727001000192:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790740371.359736:0:6521:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740371.359745:0:6521:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2600/0xb25dda4f4e92e64e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e8a expref: 44 pid: 13222 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740371.359758:0:6521:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2600/0xb25dda4f4e92e64e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e8a expref: 44 pid: 13222 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740371.359784:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2600/0xb25dda4f4e92e64e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e8a expref: 44 pid: 13222 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740371.359804:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc887e4700) 00010000:00010000:3.0:1790740371.359809:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3e00/0xb25dda4f4e92e67f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740371.359821:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3e00/0xb25dda4f4e92e67f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740371.359829:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3e00/0xb25dda4f4e92e67f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740371.359888:0:6521:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740371.360346:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84492680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7bed19f2-4c98-4684-89e7-a6871565665d+43:2402:x1877727001000192:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 631us (1082us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740371.360356:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 82 00010000:00010000:0.0:1790740371.360683:0:6536:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3e00/0xb25dda4f4e92e67f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740371.360695:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3e00/0xb25dda4f4e92e67f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790740371.360724:0:6536:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1790740371.360922:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3c00/0xb25dda4f4e92e678 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e98 expref: 44 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740371.361158:0:6536:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3e00/0xb25dda4f4e92e67f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e98 expref: 43 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740371.361168:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc887e4700) 00010000:00010000:0.0:1790740371.361171:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790740371.361175:0:6536:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaeee3e00, rc 0) 00000100:00100000:0.0:1790740371.361231:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+43:12283:x1877727001000064:12345-192.168.204.3@tcp:101:dd.0 Request processed in 13883us (17102us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1790740371.361240:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 167 00000100:00100000:3.0:1790740371.370175:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740371.370325:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001000320 00000100:00100000:1.0:1790740371.370339:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001000320 00000100:00100000:1.0:1790740371.370412:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 168 00000100:00100000:1.0:1790740371.370430:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+43:12283:x1877727001000320:12345-192.168.204.3@tcp:101:dd.0 00010000:00010000:1.0:1790740371.370466:0:7760:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740371.370494:0:7760:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e68d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23e9f expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740371.370554:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e694 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740371.370573:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e694 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740371.370588:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e694 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740371.370752:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e68d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e9f expref: 45 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740371.370773:0:7760:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e694 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e9f expref: 44 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740371.370796:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc887e4700) 00010000:00010000:1.0:1790740371.370799:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790740371.370804:0:7760:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcbfc45c00, rc 0) 00000100:00100000:1.0:1790740371.370883:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+44:12283:x1877727001000320:12345-192.168.204.3@tcp:101:dd.0 Request processed in 455us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740371.370891:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 168 00000100:00100000:3.0:1790740371.377824:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740371.378494:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001000576 00000100:00100000:0.0:1790740371.378518:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001000576 00000100:00100000:0.0:1790740371.378601:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 169 00000100:00100000:0.0:1790740371.378613:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+44:12283:x1877727001000576:12345-192.168.204.3@tcp:36:dd.0 00010000:00010000:0.0:1790740371.379216:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3c00/0xb25dda4f4e92e69b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740371.379243:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3c00/0xb25dda4f4e92e69b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740371.379259:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3c00/0xb25dda4f4e92e69b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790740371.379321:0:13222:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:0.0:1790740371.379350:0:13222:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c2af7c2a reply state 000000007fb88fb5 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3c00/0xb25dda4f4e92e69b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740371.379365:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3c00/0xb25dda4f4e92e69b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740371.379395:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc887e4700) 00010000:00010000:0.0:1790740371.379398:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790740371.379403:0:13222:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790740371.379943:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+47:12283:x1877727001000576:12345-192.168.204.3@tcp:36:dd.0 Request processed in 1325us (2128us total) trans 4294967443 rc 0/0 00000100:00100000:0.0:1790740371.379953:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 169 00000020:00080000:0.0:1790740371.379962:0:13222:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1790740371.751739:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740371.752061:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001000704 00000100:00100000:0.0:1790740371.752071:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001000704 00000100:00100000:0.0:1790740371.752149:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 170 00000100:00100000:0.0:1790740371.752160:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5f6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+47:12298:x1877727001000704:12345-192.168.204.3@tcp:101:stat.0 00010000:00010000:0.0:1790740371.752185:0:6536:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740371.752208:0:6536:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2800/0xb25dda4f4e92e6a2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23ea6 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740371.752279:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2e00/0xb25dda4f4e92e6a9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740371.752305:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2e00/0xb25dda4f4e92e6a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740371.752319:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2e00/0xb25dda4f4e92e6a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740371.752332:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3800/0xb25dda4f4e92e6b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740371.752338:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3800/0xb25dda4f4e92e6b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740371.752365:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3800/0xb25dda4f4e92e6b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740371.752436:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2c00/0xb25dda4f4e92e6b7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740371.752447:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3e00/0xb25dda4f4e92e67f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e98 expref: 48 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740371.752455:0:6536:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2c00/0xb25dda4f4e92e6b7 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740371.752486:0:6536:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3e00/0xb25dda4f4e92e67f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e98 expref: 48 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740371.752514:0:6536:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3e00/0xb25dda4f4e92e67f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e98 expref: 48 pid: 6536 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740371.752528:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6536:1877727022039936:192.168.204.3@tcp:104: 00000100:00100000:0.0:1790740371.752622:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dca0807f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790740371.760312:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6536:1877727022039936:192.168.204.3@tcp:104: 00010000:00010000:0.0:1790740371.760345:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2c00/0xb25dda4f4e92e6b7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740371.762058:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740371.762295:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001000960 00000100:00100000:3.0:1790740371.762306:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001000960 00000100:00100000:3.0:1790740371.762373:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 43 00000100:00100000:3.0:1790740371.762383:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82f99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+49:6197:x1877727001000960:12345-192.168.204.3@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1790740371.762714:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82f99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+50:6197:x1877727001000960:12345-192.168.204.3@tcp:35:ldlm_bl.0 Request processed in 331us (692us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1790740371.762722:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 43 00000100:00100000:3.0:1790740371.765434:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740371.765545:0:10416:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001001088 00000100:00100000:2.0:1790740371.765554:0:10416:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001001088 00010000:00010000:2.0:1790740371.765593:0:10416:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3e00/0xb25dda4f4e92e67f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e98 expref: 50 pid: 6536 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740371.765637:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 83 00000100:00100000:2.0:1790740371.765646:0:10416:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc86ac1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7bed19f2-4c98-4684-89e7-a6871565665d+50:2403:x1877727001001088:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790740371.765661:0:10416:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740371.765667:0:10416:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3e00/0xb25dda4f4e92e67f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e98 expref: 50 pid: 6536 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740371.765703:0:10416:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3e00/0xb25dda4f4e92e67f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e98 expref: 50 pid: 6536 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740371.765726:0:10416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3e00/0xb25dda4f4e92e67f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e98 expref: 50 pid: 6536 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740371.765742:0:10416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc887e4700) 00010000:00010000:2.0:1790740371.765748:0:10416:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2c00/0xb25dda4f4e92e6b7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740371.765758:0:10416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2c00/0xb25dda4f4e92e6b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740371.765766:0:10416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2c00/0xb25dda4f4e92e6b7 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740371.765802:0:10416:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740371.765969:0:10416:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc86ac1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7bed19f2-4c98-4684-89e7-a6871565665d+49:2403:x1877727001001088:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 322us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740371.765977:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 83 00010000:00010000:1.0:1790740371.766738:0:6536:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2c00/0xb25dda4f4e92e6b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740371.766749:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2c00/0xb25dda4f4e92e6b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740371.766801:0:6536:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1790740371.766806:0:6536:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790740371.766845:0:6536:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2c00/0xb25dda4f4e92e6b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740371.766858:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2c00/0xb25dda4f4e92e6b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740371.766869:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2e00/0xb25dda4f4e92e6a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740371.766876:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2e00/0xb25dda4f4e92e6a9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740371.766884:0:6536:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2e00/0xb25dda4f4e92e6a9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740371.766890:0:6536:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee2e00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740371.766902:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2e00/0xb25dda4f4e92e6a9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740371.766910:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2e00/0xb25dda4f4e92e6a9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740371.767188:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98dc887e4800) 00010000:00010000:1.0:1790740371.767191:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740371.767196:0:6536:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2e00/0xb25dda4f4e92e6a9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740371.767203:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2e00/0xb25dda4f4e92e6a9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740371.767216:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3800/0xb25dda4f4e92e6b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740371.767221:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3800/0xb25dda4f4e92e6b0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740371.767227:0:6536:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3800/0xb25dda4f4e92e6b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740371.767231:0:6536:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee3800 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740371.767234:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3800/0xb25dda4f4e92e6b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740371.767240:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3800/0xb25dda4f4e92e6b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740371.767247:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98dc887e4000) 00010000:00010000:1.0:1790740371.767249:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740371.767259:0:6536:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3800/0xb25dda4f4e92e6b0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740371.767265:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3800/0xb25dda4f4e92e6b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740371.767303:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2800/0xb25dda4f4e92e6a2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ea6 expref: 49 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740371.767317:0:6536:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2c00/0xb25dda4f4e92e6b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ea6 expref: 48 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740371.767324:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc887e4700) 00010000:00010000:1.0:1790740371.767326:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790740371.767328:0:6536:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaeee2c00, rc 0) 00000100:00100000:1.0:1790740371.767389:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5f6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+48:12298:x1877727001000704:12345-192.168.204.3@tcp:101:stat.0 Request processed in 15231us (15661us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740371.767397:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 170 00000100:00100000:2.0:1790740371.864575:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740371.864633:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740371.864668:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740371.864701:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740371.864720:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740371.864744:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740371.864768:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001001728 00000100:00100000:2.0:1790740371.864777:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001001728 00000100:00100000:2.0:1790740371.864855:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001001344 00000100:00100000:2.0:1790740371.864859:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001001344 00000100:00100000:2.0:1790740371.864878:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001001856 00000100:00100000:2.0:1790740371.864880:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001001856 00000100:00100000:2.0:1790740371.864900:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 329 00000100:00100000:3.0:1790740371.864907:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001001216 00000100:00100000:2.0:1790740371.864909:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82f98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2405:x1877727001001728:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740371.864911:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001001216 00000100:00100000:3.0:1790740371.864948:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 390 00000100:00100000:3.0:1790740371.864955:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99054c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:2405:x1877727001001216:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740371.864981:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99054c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:2405:x1877727001001216:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 26us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740371.864981:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82f98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2405:x1877727001001728:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 73us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740371.864989:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 390 00000100:00100000:2.0:1790740371.864989:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 329 00000100:00100000:2.0:1790740371.865005:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 330 00000100:00100000:2.0:1790740371.865011:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc81326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+5:2405:x1877727001001344:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1790740371.865058:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc81326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+5:2405:x1877727001001344:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 47us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740371.865064:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 330 00000100:00100000:2.0:1790740371.865076:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 331 00000100:00100000:2.0:1790740371.865082:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfced500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2405:x1877727001001856:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1790740371.865106:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfced500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2405:x1877727001001856:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 24us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740371.865111:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 331 00000100:00080000:2.0:1790740371.865127:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790740371.865131:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790740371.865405:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001001472 00000100:00100000:0.0:1790740371.865410:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001001472 00000100:00100000:0.0:1790740371.865450:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001001600 00000100:00100000:0.0:1790740371.865454:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001001600 00000100:00100000:0.0:1790740371.865500:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 137 00000100:00100000:0.0:1790740371.865509:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82f99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bed19f2-4c98-4684-89e7-a6871565665d+6:2405:x1877727001001472:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1790740371.865543:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82f99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bed19f2-4c98-4684-89e7-a6871565665d+6:2405:x1877727001001472:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 35us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740371.865549:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 137 00000100:00100000:0.0:1790740371.865561:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 138 00000100:00100000:0.0:1790740371.865567:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc81327480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bed19f2-4c98-4684-89e7-a6871565665d+7:2405:x1877727001001600:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1790740371.865587:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc81327480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bed19f2-4c98-4684-89e7-a6871565665d+7:2405:x1877727001001600:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 21us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740371.865593:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 138 00000100:00080000:2.0:1790740371.865734:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790740371.897529:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740371.903384:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001002112 00000100:00100000:0.0:1790740371.903401:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001002112 00000100:00100000:0.0:1790740371.903482:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 171 00000100:00100000:0.0:1790740371.903505:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+48:12304:x1877727001002112:12345-192.168.204.3@tcp:36:truncate.0 00010000:00010000:0.0:1790740371.903572:0:6535:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740371.903600:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2c00/0xb25dda4f4e92e6b7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ea6 expref: 48 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740371.903620:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc887e4700) 00010000:00010000:0.0:1790740371.903625:0:6535:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790740371.903822:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3200/0xb25dda4f4e92e6be lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740371.903837:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3200/0xb25dda4f4e92e6be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740371.903846:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3200/0xb25dda4f4e92e6be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790740371.903929:0:6535:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:0.0:1790740371.903953:0:6535:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005f9b8c08 reply state 0000000036ff9a16 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3200/0xb25dda4f4e92e6be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740371.903965:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3200/0xb25dda4f4e92e6be lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740371.903971:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc887e4700) 00010000:00010000:0.0:1790740371.903973:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790740371.903976:0:6535:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790740371.904134:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+50:12304:x1877727001002112:12345-192.168.204.3@tcp:36:truncate.0 Request processed in 641us (6614us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1790740371.904143:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 171 00000020:00080000:0.0:1790740371.904147:0:6535:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00080000:1.0:1790740371.907310:0:6514:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967446 is committed 00000004:00080000:1.0:1790740371.907342:0:6514:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1790740371.907366:0:6514:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98db83eff480 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1790740371.907372:0:6514:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98dc8137b000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98db83eff540 00000020:00080000:1.0:1790740371.907376:0:6514:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98dc8137b700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98db83cc8e00 00000020:00080000:0.0:1790740371.907413:0:6567:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1790740371.907472:0:6567:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1790740371.907617:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790740371.907637:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db845bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022040064:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1790740371.907703:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740371.907882:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022040064 00000100:00100000:0.0:1790740371.907890:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022040064 00000100:00100000:0.0:1790740371.907948:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790740371.907957:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1877727022040064:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1790740371.907982:0:8451:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:0.0:1790740371.908022:0:8451:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6abc8792, atime: 0x6abc8792, ctime: 0x6abc8792, blocks: 0x8 00010000:00010000:0.0:1790740371.908053:0:8451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb00d0c2/0xb25dda4f4e92e6c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740371.908070:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1790740371.908075:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740371.908082:0:8451:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb00d0c2/0xb25dda4f4e92e6c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740371.908111:0:8451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb00d0c2/0xb25dda4f4e92e6c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740371.908122:0:8451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb00d0c2/0xb25dda4f4e92e6c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740371.908129:0:8451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb00d0c2/0xb25dda4f4e92e6c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740371.908145:0:8451:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790740371.908270:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3640:x1877727022040064:12345-0@lo:6:osp-syn-1-0.0 Request processed in 314us (566us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1790740371.908278:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00010000:2.0:1790740371.909327:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e552 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740371.909340:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e552 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740371.909358:0:3625:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e552 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740371.909364:0:3625:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf061a00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740371.909368:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e552 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740371.909377:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e552 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740371.909392:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff98dc887e4200) 00010000:00010000:2.0:1790740371.909395:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740371.909400:0:3625:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e552 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740371.909407:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061a00/0xb25dda4f4e92e552 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740371.909427:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92e559 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740371.909434:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92e559 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740371.909439:0:3625:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92e559 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740371.909444:0:3625:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf061800 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740371.909447:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92e559 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740371.909463:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92e559 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740371.909472:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98dc887e4800) 00010000:00010000:2.0:1790740371.909475:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740371.909478:0:3625:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92e559 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740371.909484:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92e559 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740371.909512:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3a00/0xb25dda4f4e92e598 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740371.909519:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3a00/0xb25dda4f4e92e598 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740371.909525:0:3625:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3a00/0xb25dda4f4e92e598 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740371.909530:0:3625:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee3a00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740371.909533:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3a00/0xb25dda4f4e92e598 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740371.909539:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3a00/0xb25dda4f4e92e598 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740371.909548:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98dc887e4000) 00010000:00010000:2.0:1790740371.909550:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740371.909553:0:3625:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3a00/0xb25dda4f4e92e598 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740371.909641:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3a00/0xb25dda4f4e92e598 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740371.909660:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3c00/0xb25dda4f4e92e69b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740371.909667:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3c00/0xb25dda4f4e92e69b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740371.909673:0:3625:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3c00/0xb25dda4f4e92e69b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740371.909679:0:3625:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee3c00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740371.909682:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3c00/0xb25dda4f4e92e69b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740371.909688:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3c00/0xb25dda4f4e92e69b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740371.909697:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc887e4700) 00010000:00010000:2.0:1790740371.909700:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740371.909703:0:3625:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3c00/0xb25dda4f4e92e69b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740371.909710:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3c00/0xb25dda4f4e92e69b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740371.909721:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3200/0xb25dda4f4e92e6be lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740371.909728:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3200/0xb25dda4f4e92e6be lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740371.909741:0:3625:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3200/0xb25dda4f4e92e6be lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740371.909746:0:3625:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee3200 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740371.909749:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3200/0xb25dda4f4e92e6be lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740371.909756:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3200/0xb25dda4f4e92e6be lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740371.909764:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc887e4700) 00010000:00010000:2.0:1790740371.909766:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740371.909769:0:3625:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3200/0xb25dda4f4e92e6be lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740371.909776:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3200/0xb25dda4f4e92e6be lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740371.909796:0:10357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790740371.909803:0:10357:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb00d0c2/0xb25dda4f4e92e6c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740371.909811:0:10357:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee2000 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:2.0:1790740371.909815:0:10357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb00d0c2/0xb25dda4f4e92e6c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740371.909822:0:10357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb00d0c2/0xb25dda4f4e92e6c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740371.909845:0:10357:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb00d0c2/0xb25dda4f4e92e6c5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740371.909852:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb00d0c2/0xb25dda4f4e92e6c5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790740371.909955:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98db845bce00/2, rc 0, transno 4294967308 00000100:00100000:3.0:1790740371.909971:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db845bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022040064:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1790740371.910877:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740371.910880:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740371.910883:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740371.950052:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740372.074611:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84492a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877727022040576:0@lo:400:kworker.0 00000100:00100000:0.0:1790740372.074696:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740372.074756:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84492680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022041088:0@lo:400:kworker.0 00000100:00100000:0.0:1790740372.074783:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740372.074807:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83c51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022041600:0@lo:400:kworker.0 00000100:00100000:0.0:1790740372.074827:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740372.074852:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1790740372.074858:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84491180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022040448:0@lo:400:kworker.0 00000100:00100000:0.0:1790740372.074881:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740372.074900:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1877727022040960:0@lo:400:kworker.0 00000100:00100000:0.0:1790740372.074934:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740372.074968:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83c51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1877727022041472:0@lo:400:kworker.0 00000100:00100000:0.0:1790740372.074990:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740372.075053:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022041088 00000100:00100000:0.0:1790740372.075061:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022041088 00000100:00100000:0.0:1790740372.075110:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022041600 00000100:00100000:0.0:1790740372.075113:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022041600 00000100:00100000:0.0:1790740372.075136:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1790740372.075144:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022041088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740372.075197:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022041088:12345-0@lo:400:kworker.0 Request processed in 53us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740372.075204:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1790740372.075221:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1790740372.075228:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022041600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740372.075257:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022041600:12345-0@lo:400:kworker.0 Request processed in 31us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740372.075263:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1790740372.075281:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022040448 00000100:00100000:0.0:1790740372.075284:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022040448 00000100:00100000:0.0:1790740372.075308:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1790740372.075314:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022040448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740372.075362:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022040448:12345-0@lo:400:kworker.0 Request processed in 48us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740372.075367:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1790740372.075405:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84493100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727022040192:0@lo:400:kworker.0 00000100:00100000:0.0:1790740372.075436:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740372.075459:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84493800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022040704:0@lo:400:kworker.0 00000100:00100000:0.0:1790740372.075507:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740372.075525:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83c53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022041216:0@lo:400:kworker.0 00000100:00100000:0.0:1790740372.075546:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740372.075565:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1790740372.075570:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84492300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727022040320:0@lo:400:kworker.0 00000100:00100000:0.0:1790740372.075595:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740372.075610:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84493b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877727022040832:0@lo:400:kworker.0 00000100:00100000:0.0:1790740372.075630:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740372.075647:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83c53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1877727022041344:0@lo:400:kworker.0 00000100:00100000:0.0:1790740372.075666:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740372.075687:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022040192 00000100:00100000:0.0:1790740372.075691:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022040192 00000100:00100000:0.0:1790740372.075715:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1790740372.075721:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99055450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3638:x1877727022040192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740372.075755:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99055450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3638:x1877727022040192:12345-0@lo:400:kworker.0 Request processed in 34us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740372.075762:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1790740372.075788:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022041216 00000100:00100000:0.0:1790740372.075791:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022041216 00000100:00100000:0.0:1790740372.075812:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1790740372.075818:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022041216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740372.075844:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022041216:12345-0@lo:400:kworker.0 Request processed in 27us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740372.075850:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1790740372.075885:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84491180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022040448:0@lo:400:kworker.0 00000100:00100000:0.0:1790740372.075909:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84492680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022041088:0@lo:400:kworker.0 00000100:00100000:0.0:1790740372.075918:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83c51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022041600:0@lo:400:kworker.0 00000100:00100000:0.0:1790740372.075948:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022040576 00000100:00100000:0.0:1790740372.075951:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022040576 00000100:00100000:0.0:1790740372.075968:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022040960 00000100:00100000:0.0:1790740372.075971:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022040960 00000100:00100000:0.0:1790740372.075984:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022041472 00000100:00100000:0.0:1790740372.075986:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022041472 00000100:00100000:0.0:1790740372.075997:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1790740372.076004:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877727022040576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740372.076066:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877727022040576:12345-0@lo:400:kworker.0 Request processed in 62us (1371us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740372.076073:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1790740372.076085:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022040320 00000100:00100000:0.0:1790740372.076088:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022040320 00000100:00100000:0.0:1790740372.076100:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022040832 00000100:00100000:0.0:1790740372.076102:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022040832 00000100:00100000:0.0:1790740372.076113:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022041344 00000100:00100000:0.0:1790740372.076115:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022041344 00000100:00100000:0.0:1790740372.076128:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1790740372.076132:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1877727022040960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740372.076161:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1877727022040960:12345-0@lo:400:kworker.0 Request processed in 28us (1227us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740372.076167:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1790740372.076180:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1790740372.076185:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1877727022041472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740372.076214:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1877727022041472:12345-0@lo:400:kworker.0 Request processed in 29us (1223us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740372.076226:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1790740372.076238:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1790740372.076244:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84497480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727022040320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740372.076275:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84497480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727022040320:12345-0@lo:400:kworker.0 Request processed in 31us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740372.076280:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1790740372.076292:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1790740372.076299:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877727022040832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740372.076327:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877727022040832:12345-0@lo:400:kworker.0 Request processed in 29us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740372.076332:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1790740372.076343:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1790740372.076349:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84496d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877727022041344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740372.076373:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84496d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877727022041344:12345-0@lo:400:kworker.0 Request processed in 25us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740372.076379:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00010000:00080000:0.0:1790740372.076406:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db84490380 x1877727022040960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740372.076417:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1877727022040960:0@lo:400:kworker.0 00010000:00080000:0.0:1790740372.076428:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83c51f80 x1877727022041472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740372.076436:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83c51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1877727022041472:0@lo:400:kworker.0 00000100:00100000:0.0:1790740372.076445:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84492a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877727022040576:0@lo:400:kworker.0 00000100:00100000:0.0:1790740372.076477:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84492300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727022040320:0@lo:400:kworker.0 00000100:00100000:0.0:1790740372.076501:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84493b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877727022040832:0@lo:400:kworker.0 00000100:00100000:0.0:1790740372.076510:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83c53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1877727022041344:0@lo:400:kworker.0 00000100:00100000:0.0:1790740372.076519:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84493100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727022040192:0@lo:400:kworker.0 00000100:00100000:0.0:1790740372.076527:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83c53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022041216:0@lo:400:kworker.0 00000100:00100000:3.0:1790740372.077978:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db845bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022041728:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790740372.078099:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740372.078830:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740372.078863:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001002240 00000100:00100000:3.0:1790740372.078872:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001002240 00000100:00100000:3.0:1790740372.078939:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 172 00000100:00100000:3.0:1790740372.078949:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+16:12318:x1877727001002240:12345-192.168.204.3@tcp:101:stat.0 00010000:00010000:3.0:1790740372.078979:0:6537:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740372.079005:0:6537:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e6cc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23ead expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.079130:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e6d3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.079145:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e6d3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.079157:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e6d3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.079172:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e6da lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.079180:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e6da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.079185:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e6da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.079297:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e6e1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.079308:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e6e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.079315:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e6e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740372.079544:0:6537:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1790740372.079548:0:6537:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:1.0:1790740372.079725:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022040704 00000100:00100000:1.0:1790740372.079732:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022040704 00000100:00100000:1.0:1790740372.079768:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1790740372.079775:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022040704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740372.079841:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022040704:12345-0@lo:400:kworker.0 Request processed in 65us (4331us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740372.079855:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1790740372.080082:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84493800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022040704:0@lo:400:kworker.0 00000100:00100000:1.0:1790740372.080099:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790740372.080110:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83c53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022041856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790740372.080145:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740372.080176:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022041728 00000100:00100000:1.0:1790740372.080181:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022041728 00000100:00100000:1.0:1790740372.080206:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022041856 00000100:00100000:1.0:1790740372.080208:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022041856 00000100:00100000:1.0:1790740372.080222:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1790740372.080228:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022041728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790740372.080247:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790740372.080281:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022041728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (2183us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740372.080287:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1790740372.080297:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1790740372.080303:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83c53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1877727022041856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790740372.080312:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000004:00010000:3.0:1790740372.080539:0:6537:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e6e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.080554:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e6e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740372.080652:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83c53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1877727022041856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 349us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740372.080659:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1790740372.080698:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83c53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022041856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790740372.080713:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db845bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022041728:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1790740372.080800:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e6d3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.080808:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e6d3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.080815:0:6537:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e6d3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.080821:0:6537:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc9c00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740372.080826:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e6d3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.080834:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e6d3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.080859:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98dc887e4800) 00010000:00010000:3.0:1790740372.080861:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740372.080867:0:6537:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e6d3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.080874:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e6d3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.080888:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e6da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.080894:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e6da lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.080900:0:6537:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e6da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.080905:0:6537:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc9e00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740372.080907:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e6da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.080927:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e6da lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.080945:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98dcaf04c000) 00010000:00010000:3.0:1790740372.080948:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740372.080951:0:6537:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e6da lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.080956:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e6da lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.081500:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e6cc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ead expref: 18 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.081519:0:6537:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e6e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ead expref: 17 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.081527:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc887e4700) 00010000:00010000:3.0:1790740372.081529:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790740372.081532:0:6537:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc8200, rc 0) 00000100:00100000:3.0:1790740372.082112:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+17:12318:x1877727001002240:12345-192.168.204.3@tcp:101:stat.0 Request processed in 3162us (3282us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740372.082121:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 172 00000100:00080000:2.0:1790740372.082284:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790740372.082290:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790740372.082293:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790740372.082296:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790740372.185871:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740372.191413:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001002496 00000100:00100000:0.0:1790740372.191430:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001002496 00000100:00100000:0.0:1790740372.191955:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 173 00000100:00100000:0.0:1790740372.191981:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+17:12328:x1877727001002496:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:0.0:1790740372.192003:0:6535:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740372.192389:0:6535:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2c00/0xb25dda4f4e92e6e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23eb4 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790740372.193366:0:6535:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1790740372.193480:0:6535:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2c00/0xb25dda4f4e92e6e8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23eb4 expref: 19 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740372.193512:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98dc985be400) 00010000:00010000:0.0:1790740372.193516:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790740372.193521:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2c00/0xb25dda4f4e92e6e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23eb4 expref: 19 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740372.193535:0:6535:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaeee2c00, rc 0) 00000100:00100000:0.0:1790740372.193889:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+18:12328:x1877727001002496:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 1909us (8023us total) trans 4294967447 rc 301/301 00000100:00100000:0.0:1790740372.193920:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 173 00000100:00100000:2.0:1790740372.202617:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740372.209189:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001002752 00000100:00100000:3.0:1790740372.209205:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001002752 00000100:00100000:2.0:1790740372.214285:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 44 00000100:00100000:2.0:1790740372.214301:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc9925e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+18:12328:x1877727001002752:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:2.0:1790740372.214568:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc9925e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+19:12328:x1877727001002752:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 270us (11960us total) trans 4294967448 rc 0/0 00000100:00100000:2.0:1790740372.214586:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 44 00000100:00100000:2.0:1790740372.320539:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740372.320810:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001003008 00000100:00100000:0.0:1790740372.320820:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001003008 00000100:00100000:0.0:1790740372.320886:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 174 00000100:00100000:0.0:1790740372.320896:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+19:12334:x1877727001003008:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:0.0:1790740372.321210:0:13222:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740372.321234:0:13222:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3600/0xb25dda4f4e92e6f6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23ebb expref: -99 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740372.321357:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92e6fd lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740372.321374:0:13222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e6e1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ead expref: 20 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740372.321382:0:13222:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92e6fd lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740372.321418:0:13222:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e6e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ead expref: 20 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740372.321433:0:13222:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e6e1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ead expref: 20 pid: 6537 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740372.321448:0:13222:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84496300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13222:1877727022041984:192.168.204.3@tcp:104: 00000100:00100000:0.0:1790740372.321789:0:13222:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dca0807b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790740372.329230:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740372.329348:0:6520:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001003136 00000100:00100000:1.0:1790740372.329365:0:6520:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001003136 00010000:00010000:1.0:1790740372.329425:0:6520:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e6e1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ead expref: 21 pid: 6537 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740372.329472:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 84 00000100:00100000:1.0:1790740372.329497:0:6520:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84494700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7bed19f2-4c98-4684-89e7-a6871565665d+21:2403:x1877727001003136:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740372.329514:0:6520:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740372.329522:0:6520:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e6e1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ead expref: 21 pid: 6537 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.329537:0:6520:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e6e1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ead expref: 21 pid: 6537 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.329559:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc887e4700) 00010000:00010000:1.0:1790740372.329565:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92e6fd lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.329588:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92e6fd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.329597:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92e6fd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.329619:0:6520:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740372.329684:0:6520:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84494700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7bed19f2-4c98-4684-89e7-a6871565665d+21:2403:x1877727001003136:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 203us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740372.329692:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 84 00010000:00010000:2.0:1790740372.331502:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e6e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ead expref: 20 pid: 6537 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740372.331527:0:13222:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84496300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13222:1877727022041984:192.168.204.3@tcp:104: 00010000:00010000:2.0:1790740372.331565:0:13222:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92e6fd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740372.331588:0:13222:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92e6fd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740372.331595:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92e6fd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740372.331617:0:13222:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1790740372.332174:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3600/0xb25dda4f4e92e6f6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ebb expref: 21 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740372.332194:0:13222:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92e6fd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ebb expref: 20 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740372.332204:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc887e4700) 00010000:00010000:2.0:1790740372.332207:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790740372.332210:0:13222:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaeee2400, rc 0) 00000100:00100000:2.0:1790740372.332407:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+20:12334:x1877727001003008:12345-192.168.204.3@tcp:101:bash.0 Request processed in 11512us (11879us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1790740372.332417:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 174 00000100:00100000:0.0:1790740372.351141:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740372.352517:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001003392 00000100:00100000:3.0:1790740372.352532:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001003392 00000100:00100000:3.0:1790740372.352665:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 175 00000100:00100000:3.0:1790740372.352676:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+20:12334:x1877727001003392:12345-192.168.204.3@tcp:36:bash.0 00010000:00010000:3.0:1790740372.352937:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e70b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.352957:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e70b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.352968:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e70b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790740372.353059:0:6537:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:3.0:1790740372.353095:0:6537:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e5731c84 reply state 00000000bd3bb726 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e70b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.353109:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e70b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.353116:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc887e4700) 00010000:00010000:3.0:1790740372.353118:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790740372.353122:0:6537:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790740372.353223:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+23:12334:x1877727001003392:12345-192.168.204.3@tcp:36:bash.0 Request processed in 547us (2089us total) trans 4294967451 rc 0/0 00000100:00100000:3.0:1790740372.353230:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 175 00000020:00080000:3.0:1790740372.353236:0:6537:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1790740372.364833:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740372.365008:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001003520 00000100:00100000:0.0:1790740372.365019:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001003520 00000100:00100000:0.0:1790740372.365108:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 176 00000100:00100000:0.0:1790740372.365116:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+23:12334:x1877727001003520:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:0.0:1790740372.365139:0:6535:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740372.365160:0:6535:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3200/0xb25dda4f4e92e712 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23ec2 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740372.365554:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3c00/0xb25dda4f4e92e719 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740372.365570:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92e6fd lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ebb expref: 24 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740372.365581:0:6535:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3c00/0xb25dda4f4e92e719 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740372.365621:0:6535:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92e6fd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ebb expref: 24 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740372.365637:0:6535:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92e6fd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ebb expref: 24 pid: 13222 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740372.365652:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84496300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6535:1877727022042112:192.168.204.3@tcp:104: 00000100:00100000:0.0:1790740372.365741:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dca0807b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790740372.375352:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740372.376269:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001003648 00000100:00100000:1.0:1790740372.376282:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001003648 00010000:00010000:1.0:1790740372.376348:0:6522:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92e6fd lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ebb expref: 25 pid: 13222 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740372.376400:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 85 00000100:00100000:1.0:1790740372.376410:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84493800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7bed19f2-4c98-4684-89e7-a6871565665d+25:2403:x1877727001003648:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740372.376428:0:6522:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740372.376435:0:6522:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92e6fd lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ebb expref: 25 pid: 13222 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.376451:0:6522:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92e6fd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ebb expref: 25 pid: 13222 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.376473:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc887e4700) 00010000:00010000:1.0:1790740372.376478:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3c00/0xb25dda4f4e92e719 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.376499:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3c00/0xb25dda4f4e92e719 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.376506:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3c00/0xb25dda4f4e92e719 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.376527:0:6522:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740372.376726:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84493800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7bed19f2-4c98-4684-89e7-a6871565665d+25:2403:x1877727001003648:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 316us (1386us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740372.376736:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 85 00010000:00010000:2.0:1790740372.377357:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92e6fd lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ebb expref: 24 pid: 13222 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740372.377378:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84496300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6535:1877727022042112:192.168.204.3@tcp:104: 00010000:00010000:2.0:1790740372.377414:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3c00/0xb25dda4f4e92e719 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740372.377438:0:6535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3c00/0xb25dda4f4e92e719 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740372.377445:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3c00/0xb25dda4f4e92e719 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740372.377512:0:6535:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1790740372.377517:0:6535:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790740372.377547:0:6535:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3c00/0xb25dda4f4e92e719 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740372.377578:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3200/0xb25dda4f4e92e712 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ec2 expref: 24 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740372.377593:0:6535:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3c00/0xb25dda4f4e92e719 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ec2 expref: 23 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740372.377601:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc887e4700) 00010000:00010000:2.0:1790740372.377604:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790740372.377607:0:6535:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaeee3c00, rc 0) 00000100:00100000:2.0:1790740372.377656:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+23:12334:x1877727001003520:12345-192.168.204.3@tcp:101:bash.0 Request processed in 12540us (12832us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740372.377664:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 176 00000100:00100000:0.0:1790740372.383955:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740372.385712:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001003904 00000100:00100000:3.0:1790740372.385726:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001003904 00000100:00100000:3.0:1790740372.385798:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 45 00000100:00100000:3.0:1790740372.385808:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84493100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+23:12334:x1877727001003904:12345-192.168.204.3@tcp:35:bash.0 00000100:00100000:3.0:1790740372.386072:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84493100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+24:12334:x1877727001003904:12345-192.168.204.3@tcp:35:bash.0 Request processed in 264us (2126us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1790740372.386080:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 45 00000100:00100000:3.0:1790740372.492548:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740372.493980:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001004160 00000100:00100000:2.0:1790740372.493995:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001004160 00000100:00100000:2.0:1790740372.494108:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 177 00000100:00100000:2.0:1790740372.494120:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+24:12344:x1877727001004160:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:2.0:1790740372.494148:0:13222:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740372.494186:0:13222:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92e720 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23ec9 expref: -99 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740372.494298:0:13222:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1790740372.494405:0:13222:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92e720 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ec9 expref: 26 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740372.494419:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98dc985be400) 00010000:00010000:2.0:1790740372.494422:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790740372.494428:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92e720 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ec9 expref: 26 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740372.494442:0:13222:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f33000, rc 0) 00000100:00100000:2.0:1790740372.494524:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+25:12344:x1877727001004160:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 407us (1996us total) trans 4294967453 rc 301/301 00000100:00100000:2.0:1790740372.494531:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 177 00000100:00100000:0.0:1790740372.499407:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740372.499597:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001004288 00000100:00100000:3.0:1790740372.499608:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001004288 00000100:00100000:3.0:1790740372.499675:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 178 00000100:00100000:3.0:1790740372.499686:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84493b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+25:12344:x1877727001004288:12345-192.168.204.3@tcp:34:lfs.0 00010000:00010000:3.0:1790740372.499777:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e72e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.499794:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e72e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.499806:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e72e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.499820:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e735 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.499827:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e735 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.499834:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e735 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.499924:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e73c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.499934:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e73c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.499941:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e73c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790740372.499993:0:6537:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e73c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.500006:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e72e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.500071:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e72e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.500078:0:6537:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e72e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.500085:0:6537:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc9c00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740372.500089:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e72e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.500097:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e72e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.500111:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98dc887e4800) 00010000:00010000:3.0:1790740372.500114:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740372.500119:0:6537:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e72e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.500125:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e72e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.500139:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e735 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.500145:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e735 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.500150:0:6537:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e735 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.500155:0:6537:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc9e00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740372.500165:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e735 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.500171:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e735 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.500179:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98dcaf04c000) 00010000:00010000:3.0:1790740372.500181:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740372.500184:0:6537:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e735 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.500189:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e735 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.500205:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e73c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.500211:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e73c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.500217:0:6537:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e73c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.500222:0:6537:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc8a00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740372.500225:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e73c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.500230:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e73c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.500237:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc887e4700) 00010000:00010000:3.0:1790740372.500240:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740372.500249:0:6537:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e73c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.500256:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e73c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740372.500340:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84493b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+25:12344:x1877727001004288:12345-192.168.204.3@tcp:34:lfs.0 Request processed in 656us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740372.500347:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 178 00000100:00100000:0.0:1790740372.506816:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740372.507062:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001004544 00000100:00100000:3.0:1790740372.507074:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001004544 00000100:00100000:3.0:1790740372.507130:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 46 00000100:00100000:3.0:1790740372.507140:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+25:12344:x1877727001004544:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:3.0:1790740372.507435:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+26:12344:x1877727001004544:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 295us (629us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1790740372.507443:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 46 00000100:00100000:2.0:1790740372.573984:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740372.574513:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001004800 00000100:00100000:0.0:1790740372.574524:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001004800 00000100:00100000:0.0:1790740372.574710:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 179 00000100:00100000:0.0:1790740372.574721:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84496300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+26:12347:x1877727001004800:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:0.0:1790740372.574748:0:6535:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740372.574772:0:6535:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2e00/0xb25dda4f4e92e743 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23ed0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740372.574843:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3e00/0xb25dda4f4e92e74a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740372.574857:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3e00/0xb25dda4f4e92e74a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740372.574867:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3e00/0xb25dda4f4e92e74a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740372.574880:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2600/0xb25dda4f4e92e751 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740372.574886:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2600/0xb25dda4f4e92e751 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740372.574892:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2600/0xb25dda4f4e92e751 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740372.576096:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3800/0xb25dda4f4e92e758 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740372.576115:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3800/0xb25dda4f4e92e758 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740372.576139:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3800/0xb25dda4f4e92e758 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790740372.576152:0:6535:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1790740372.576803:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3e00/0xb25dda4f4e92e74a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740372.576814:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3e00/0xb25dda4f4e92e74a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740372.576820:0:6535:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3e00/0xb25dda4f4e92e74a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740372.576826:0:6535:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee3e00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:0.0:1790740372.576831:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3e00/0xb25dda4f4e92e74a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740372.576838:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3e00/0xb25dda4f4e92e74a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740372.576862:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98dc887e4800) 00010000:00010000:0.0:1790740372.576865:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740372.576870:0:6535:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3e00/0xb25dda4f4e92e74a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740372.576876:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3e00/0xb25dda4f4e92e74a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740372.576891:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2600/0xb25dda4f4e92e751 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740372.576897:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2600/0xb25dda4f4e92e751 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740372.577562:0:6535:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2600/0xb25dda4f4e92e751 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740372.577569:0:6535:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee2600 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:0.0:1790740372.577572:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2600/0xb25dda4f4e92e751 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740372.577595:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2600/0xb25dda4f4e92e751 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740372.577606:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98dc887e4100) 00010000:00010000:0.0:1790740372.577608:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740372.577612:0:6535:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2600/0xb25dda4f4e92e751 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740372.577618:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2600/0xb25dda4f4e92e751 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740372.577685:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2e00/0xb25dda4f4e92e743 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ed0 expref: 29 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740372.577701:0:6535:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3800/0xb25dda4f4e92e758 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ed0 expref: 28 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740372.577709:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc887e4700) 00010000:00010000:0.0:1790740372.577711:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790740372.577713:0:6535:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaeee3800, rc 0) 00000100:00100000:0.0:1790740372.577811:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84496300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+28:12347:x1877727001004800:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 3091us (3837us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1790740372.577832:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 179 00000100:00100000:0.0:1790740372.581969:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740372.582837:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001004928 00000100:00100000:1.0:1790740372.582849:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001004928 00000100:00100000:1.0:1790740372.583005:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 180 00000100:00100000:1.0:1790740372.583059:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84492a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+28:12347:x1877727001004928:12345-192.168.204.3@tcp:54:lfs.0 00010000:00010000:1.0:1790740372.583138:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e766 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.583158:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e766 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.583171:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e766 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.583208:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e766 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.583216:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e766 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.583223:0:6536:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e766 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.583229:0:6536:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc45800 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740372.583234:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e766 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.583241:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e766 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.583254:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc887e4700) 00010000:00010000:1.0:1790740372.583257:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790740372.583262:0:6536:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e766 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.583268:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e766 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740372.584141:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740372.584245:0:9550:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001005056 00000100:00100000:3.0:1790740372.584252:0:9550:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001005056 00000100:00100000:3.0:1790740372.584317:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 14 00000100:00100000:3.0:1790740372.584326:0:9550:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfcec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7bed19f2-4c98-4684-89e7-a6871565665d+29:2402:x1877727001005056:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790740372.584401:0:9550:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740372.584424:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3800/0xb25dda4f4e92e758 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ed0 expref: 29 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.584437:0:9550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc887e4700) 00010000:00010000:3.0:1790740372.584441:0:9550:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740372.585420:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84492a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+28:12347:x1877727001004928:12345-192.168.204.3@tcp:54:lfs.0 Request processed in 2359us (3507us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740372.585431:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 180 00000100:00100000:3.0:1790740372.589758:0:9550:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfcec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7bed19f2-4c98-4684-89e7-a6871565665d+27:2402:x1877727001005056:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 5419us (5719us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740372.589793:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 14 00000100:00100000:0.0:1790740372.590281:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740372.590617:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001005312 00000100:00100000:3.0:1790740372.590627:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001005312 00000100:00100000:3.0:1790740372.590685:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 47 00000100:00100000:3.0:1790740372.590697:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84490380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+27:12347:x1877727001005312:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:3.0:1790740372.590935:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84490380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+28:12347:x1877727001005312:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 238us (655us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1790740372.590943:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 47 00000100:00100000:2.0:1790740372.817813:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740372.817919:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001005568 00000100:00100000:0.0:1790740372.817930:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001005568 00000100:00100000:0.0:1790740372.817993:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 181 00000100:00100000:0.0:1790740372.818003:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+28:12365:x1877727001005568:12345-192.168.204.3@tcp:101:cat.0 00010000:00010000:0.0:1790740372.818027:0:7760:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740372.818091:0:7760:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2600/0xb25dda4f4e92e76d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23ed7 expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740372.818207:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3e00/0xb25dda4f4e92e774 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740372.818222:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3e00/0xb25dda4f4e92e774 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740372.818235:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3e00/0xb25dda4f4e92e774 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790740372.818246:0:7760:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1790740372.818341:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2600/0xb25dda4f4e92e76d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ed7 expref: 31 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740372.818359:0:7760:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3e00/0xb25dda4f4e92e774 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ed7 expref: 30 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740372.818368:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc887e4700) 00010000:00010000:0.0:1790740372.818384:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1790740372.818388:0:7760:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaeee3e00, rc 0) 00000100:00100000:0.0:1790740372.818510:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+30:12365:x1877727001005568:12345-192.168.204.3@tcp:101:cat.0 Request processed in 507us (705us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1790740372.818518:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 181 00000100:00100000:0.0:1790740372.848434:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740372.848676:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001005696 00000100:00100000:2.0:1790740372.848686:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001005696 00000100:00100000:2.0:1790740372.848754:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 182 00000100:00100000:2.0:1790740372.848765:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84492680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+30:12366:x1877727001005696:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:2.0:1790740372.848858:0:6535:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740372.848883:0:6535:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92e782 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23ede expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740372.849484:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92e789 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740372.849517:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92e789 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740372.849530:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92e789 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740372.849667:0:6535:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1790740372.849671:0:6535:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790740372.849695:0:6535:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92e789 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740372.849727:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92e782 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ede expref: 32 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740372.849750:0:6535:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92e789 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ede expref: 31 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740372.849760:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98dc887e4800) 00010000:00010000:2.0:1790740372.849763:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790740372.849766:0:6535:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f32e00, rc 0) 00000100:00100000:2.0:1790740372.850379:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84492680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+31:12366:x1877727001005696:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 1612us (1953us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740372.850390:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 182 00000100:00100000:3.0:1790740372.855364:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740372.855631:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001006080 00000100:00100000:0.0:1790740372.855643:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001006080 00000100:00100000:0.0:1790740372.855744:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 48 00000100:00100000:0.0:1790740372.855755:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83f12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+31:12366:x1877727001006080:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:0.0:1790740372.856176:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83f12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+32:12366:x1877727001006080:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 422us (1150us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1790740372.856184:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 48 00000100:00100000:3.0:1790740372.861372:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740372.861491:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001006208 00000100:00100000:1.0:1790740372.861501:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001006208 00000100:00100000:1.0:1790740372.861609:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 15 00000100:00100000:1.0:1790740372.861620:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83f11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7bed19f2-4c98-4684-89e7-a6871565665d+32:12366:x1877727001006208:12345-192.168.204.3@tcp:103:lfs.0 00010000:00010000:1.0:1790740372.861637:0:6521:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1790740372.861666:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3c00/0xb25dda4f4e92e719 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ec2 expref: 32 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.861689:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3e00/0xb25dda4f4e92e774 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ed7 expref: 31 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.861703:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2200/0xb25dda4f4e92e60f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e7c expref: 30 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.861714:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc887e4700) 00010000:00010000:1.0:1790740372.861719:0:6521:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740372.861790:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83f11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7bed19f2-4c98-4684-89e7-a6871565665d+29:12366:x1877727001006208:12345-192.168.204.3@tcp:103:lfs.0 Request processed in 171us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740372.861797:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 15 00000100:00100000:1.0:1790740372.869282:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740372.869376:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001006336 00000100:00100000:0.0:1790740372.869386:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001006336 00000100:00100000:0.0:1790740372.869888:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 183 00000100:00100000:0.0:1790740372.869967:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83c53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+29:12366:x1877727001006336:12345-192.168.204.3@tcp:58:lfs.0 00010000:00010000:0.0:1790740372.870115:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2800/0xb25dda4f4e92e790 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740372.870134:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2800/0xb25dda4f4e92e790 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740372.870146:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2800/0xb25dda4f4e92e790 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790740372.870248:0:6536:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1790740372.870337:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83c53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+29:12366:x1877727001006336:12345-192.168.204.3@tcp:58:lfs.0 Request processed in 440us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740372.870358:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 183 00000100:00100000:0.0:1790740372.901879:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740372.902159:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001006464 00000100:00100000:1.0:1790740372.902169:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001006464 00000100:00100000:1.0:1790740372.902235:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 184 00000100:00100000:1.0:1790740372.902260:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84491180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+29:12368:x1877727001006464:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:1.0:1790740372.902286:0:7760:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740372.902310:0:7760:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44e00/0xb25dda4f4e92e797 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23ee5 expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.902381:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92e79e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.902395:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92e79e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.902407:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92e79e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.902423:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e7a5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.902431:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e7a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.902438:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e7a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.902530:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e7ac lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.902540:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e7ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.902548:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e7ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740372.902613:0:7760:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1790740372.902617:0:7760:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790740372.902636:0:7760:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e7ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.902647:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e7ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.902655:0:7760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92e79e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.902662:0:7760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92e79e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.902669:0:7760:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92e79e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.902676:0:7760:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc44800 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740372.902680:0:7760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92e79e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.902687:0:7760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92e79e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.902698:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98dc887e4800) 00010000:00010000:1.0:1790740372.902701:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740372.902706:0:7760:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92e79e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.902711:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92e79e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.902736:0:7760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e7a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.902741:0:7760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e7a5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.902747:0:7760:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e7a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.902751:0:7760:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc44400 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740372.902754:0:7760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e7a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.902773:0:7760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e7a5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.902782:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98dcaec70400) 00010000:00010000:1.0:1790740372.902792:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740372.902795:0:7760:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e7a5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.902801:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e7a5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.902833:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44e00/0xb25dda4f4e92e797 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ee5 expref: 31 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.902846:0:7760:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e7ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ee5 expref: 30 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.902865:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc887e4700) 00010000:00010000:1.0:1790740372.902868:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790740372.902870:0:7760:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcbfc45800, rc 0) 00000100:00100000:1.0:1790740372.903357:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84491180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+30:12368:x1877727001006464:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 1097us (1489us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740372.903366:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 184 00010000:00010000:3.0:1790740372.970306:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790740373.034248:0:13821:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790740373.034259:0:13821:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790740373.034309:0:13821:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1790740373.034327:0:13821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790740373.034628:0:13821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfcef480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13821:1877727022042240:192.168.204.3@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790740373.034856:0:13821:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83d050c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790740373.050737:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740373.050788:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001006592 00000100:00100000:0.0:1790740373.050796:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001006592 00000100:00100000:0.0:1790740373.050850:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 185 00000100:00100000:0.0:1790740373.050860:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+31:12379:x1877727001006592:12345-192.168.204.3@tcp:53:lhsmtool_posix.0 00000100:00100000:3.0:1790740373.051015:0:13821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfcef480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13821:1877727022042240:192.168.204.3@tcp:107:hsm_cdtr.0 00000004:00000080:0.0:1790740373.051271:0:6535:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790740373.051394:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+30:12379:x1877727001006592:12345-192.168.204.3@tcp:53:lhsmtool_posix.0 Request processed in 523us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740373.052114:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 185 00000100:00100000:3.0:1790740373.059425:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740373.059740:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001006720 00000100:00100000:0.0:1790740373.059751:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001006720 00000100:00100000:0.0:1790740373.059939:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 186 00000100:00100000:0.0:1790740373.059954:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8453d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+30:12379:x1877727001006720:12345-192.168.204.3@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1790740373.061425:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3a00/0xb25dda4f4e92e7b3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.061448:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3a00/0xb25dda4f4e92e7b3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.061462:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3a00/0xb25dda4f4e92e7b3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.061551:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3200/0xb25dda4f4e92e7ba lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.061560:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3200/0xb25dda4f4e92e7ba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.061582:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3200/0xb25dda4f4e92e7ba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.061619:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92e7c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.061629:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92e7c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.061636:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92e7c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790740373.061692:0:13222:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1790740373.061697:0:13222:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790740373.061712:0:13222:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92e7c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.061724:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3a00/0xb25dda4f4e92e7b3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.061732:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3a00/0xb25dda4f4e92e7b3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.061740:0:13222:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3a00/0xb25dda4f4e92e7b3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.061747:0:13222:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee3a00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:0.0:1790740373.061751:0:13222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3a00/0xb25dda4f4e92e7b3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.061759:0:13222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3a00/0xb25dda4f4e92e7b3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.061779:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98db82949800) 00010000:00010000:0.0:1790740373.061795:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740373.061801:0:13222:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3a00/0xb25dda4f4e92e7b3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.061808:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3a00/0xb25dda4f4e92e7b3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.061823:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3200/0xb25dda4f4e92e7ba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.061829:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3200/0xb25dda4f4e92e7ba lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.061835:0:13222:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3200/0xb25dda4f4e92e7ba lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.061840:0:13222:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee3200 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:0.0:1790740373.061843:0:13222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3200/0xb25dda4f4e92e7ba lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.061850:0:13222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3200/0xb25dda4f4e92e7ba lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.061857:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff98dc887e4100) 00010000:00010000:0.0:1790740373.061859:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740373.061862:0:13222:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3200/0xb25dda4f4e92e7ba lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.061867:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3200/0xb25dda4f4e92e7ba lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.061903:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92e7c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.061910:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92e7c1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.061916:0:13222:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92e7c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.061921:0:13222:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee2400 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:0.0:1790740373.061924:0:13222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92e7c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.061930:0:13222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92e7c1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.061937:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc887e4700) 00010000:00010000:0.0:1790740373.061940:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740373.061943:0:13222:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92e7c1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.061948:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92e7c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740373.062067:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8453d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+30:12379:x1877727001006720:12345-192.168.204.3@tcp:34:lhsmtool_posix.0 Request processed in 2103us (2637us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740373.062076:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 186 00000100:00100000:0.0:1790740373.073796:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740373.077013:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001006976 00000100:00100000:3.0:1790740373.077065:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001006976 00000100:00100000:3.0:1790740373.077132:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 187 00000100:00100000:3.0:1790740373.077142:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db846b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+30:12379:x1877727001006976:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790740373.077170:0:6537:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740373.077192:0:6537:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e7c8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23eec expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.077333:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e7cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.077353:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e7cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.077378:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e7cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740373.077536:0:6537:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1790740373.077642:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e7cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.077654:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e7cf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.077662:0:6537:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e7cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.077673:0:6537:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc9e00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740373.077679:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e7cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.077691:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e7cf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.077709:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc887e4700) 00010000:00010000:3.0:1790740373.077712:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790740373.077722:0:6537:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e7cf lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.077729:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e7cf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.077793:0:6537:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e7c8 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23eec expref: 32 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.077827:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98db82949800) 00010000:00010000:3.0:1790740373.077830:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790740373.077835:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e7c8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23eec expref: 32 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.077850:0:6537:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc8a00, rc 0) 00000100:00100000:3.0:1790740373.078321:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db846b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+31:12379:x1877727001006976:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 1172us (4525us total) trans 4294967459 rc 301/301 00000100:00100000:3.0:1790740373.078335:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 187 00000100:00100000:0.0:1790740373.085877:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740373.086000:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001007104 00000100:00100000:1.0:1790740373.086012:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001007104 00000100:00100000:1.0:1790740373.086109:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 188 00000100:00100000:1.0:1790740373.086120:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db846b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+31:12379:x1877727001007104:12345-192.168.204.3@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790740373.086161:0:6535:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790740373.086289:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db846b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+31:12379:x1877727001007104:12345-192.168.204.3@tcp:53:lhsmtool_posix.0 Request processed in 170us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740373.086297:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 188 00000100:00100000:3.0:1790740373.102360:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740373.102690:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001007360 00000100:00100000:1.0:1790740373.102700:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001007360 00000100:00100000:1.0:1790740373.102766:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 189 00000100:00100000:1.0:1790740373.102777:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8453df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+31:12379:x1877727001007360:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790740373.102802:0:7760:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740373.102806:0:7760:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1790740373.102835:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32e00/0xb25dda4f4e92e789 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ede expref: 31 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.102856:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98dc887e4800) 00010000:00010000:1.0:1790740373.102862:0:7760:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790740373.102906:0:7760:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e7dd lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23ef3 expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790740373.103341:0:7760:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:1.0:1790740373.103497:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92e7e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.103511:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92e7e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.103520:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92e7e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.103572:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e7dd lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ef3 expref: 33 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.103587:0:7760:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92e7e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ef3 expref: 32 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.103595:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98dcaec70400) 00010000:00010000:1.0:1790740373.103597:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790740373.103599:0:7760:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcbfc44800, rc 0) 00000100:00100000:1.0:1790740373.103670:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8453df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+32:12379:x1877727001007360:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 896us (1327us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1790740373.103679:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 189 00000100:00100000:3.0:1790740373.111247:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db846b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022042368:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790740373.111322:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740373.111651:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022042368 00000100:00100000:0.0:1790740373.111675:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022042368 00000100:00100000:0.0:1790740373.111735:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1790740373.111744:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8453ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727022042368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790740373.111783:0:6541:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1790740373.111890:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8453ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727022042368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 146us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740373.111907:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1790740373.118973:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db846b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022042368:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790740373.119718:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740373.119826:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001007616 00000100:00100000:0.0:1790740373.119834:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001007616 00000100:00100000:1.0:1790740373.120379:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 190 00000100:00100000:1.0:1790740373.120391:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83c51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+32:12379:x1877727001007616:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790740373.120456:0:6536:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740373.120508:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92e7e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ef3 expref: 32 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.120540:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98dcaec70400) 00010000:00010000:1.0:1790740373.120551:0:6536:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790740373.120574:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e7f2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.120588:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e7f2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.120598:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e7f2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.120611:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92e7f9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xfdc49c03 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.120617:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92e7f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xfdc49c03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.120622:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92e7f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xfdc49c03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.120667:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e7f2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.120674:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e7f2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.120681:0:6536:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e7f2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.120686:0:6536:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc44c00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740373.120697:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e7f2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.120705:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e7f2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.120714:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98dc887e4800) 00010000:00010000:1.0:1790740373.120717:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740373.120721:0:6536:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e7f2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.120727:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e7f2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.120737:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92e7f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xfdc49c03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.120743:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92e7f9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xfdc49c03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.120748:0:6536:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92e7f9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xfdc49c03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.120753:0:6536:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc45a00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740373.120755:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92e7f9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xfdc49c03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.120761:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92e7f9 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xfdc49c03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.120768:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xfdc49c03 (ffff98dcaec70700) 00010000:00010000:1.0:1790740373.120770:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740373.120779:0:6536:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92e7f9 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xfdc49c03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.120786:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92e7f9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xfdc49c03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740373.120878:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83c51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+31:12379:x1877727001007616:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 Request processed in 489us (1164us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790740373.120885:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 190 00000100:00100000:1.0:1790740373.124536:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740373.125108:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001007744 00000100:00100000:0.0:1790740373.125118:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001007744 00000100:00100000:0.0:1790740373.125181:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 191 00000100:00100000:0.0:1790740373.125193:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83c51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+31:12379:x1877727001007744:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790740373.125224:0:13222:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740373.125250:0:13222:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92e800 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23efa expref: -99 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.125291:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3200/0xb25dda4f4e92e807 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.125307:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3200/0xb25dda4f4e92e807 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.125321:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3200/0xb25dda4f4e92e807 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.125450:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92e800 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23efa expref: 33 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.125483:0:13222:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3200/0xb25dda4f4e92e807 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23efa expref: 32 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.125501:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98dc887e4100) 00010000:00010000:0.0:1790740373.125504:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790740373.125508:0:13222:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaeee3200, rc 0) 00000100:00100000:0.0:1790740373.126121:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83c51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+32:12379:x1877727001007744:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 927us (1591us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740373.126130:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 191 00000100:00100000:3.0:1790740373.135338:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740373.135429:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001008000 00000100:00100000:0.0:1790740373.135441:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001008000 00000100:00100000:0.0:1790740373.135513:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 192 00000100:00100000:0.0:1790740373.135537:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8453ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+32:12379:x1877727001008000:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790740373.135634:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3a00/0xb25dda4f4e92e80e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.135652:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3a00/0xb25dda4f4e92e80e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.135664:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3a00/0xb25dda4f4e92e80e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790740373.135840:0:6537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:0.0:1790740373.135864:0:6537:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 444421831876ns, next at 445421815996ns, rc = 0 00000004:00010000:0.0:1790740373.135926:0:6537:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f1ff5e73 reply state 00000000996e4a2b transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3a00/0xb25dda4f4e92e80e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.135940:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3a00/0xb25dda4f4e92e80e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.135948:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98dc887e4100) 00010000:00010000:0.0:1790740373.135957:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1790740373.135961:0:6537:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790740373.136091:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8453ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+34:12379:x1877727001008000:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 Request processed in 555us (763us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1790740373.136100:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 192 00000100:00100000:2.0:1790740373.143174:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740373.148314:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001008128 00000100:00100000:3.0:1790740373.148329:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001008128 00000100:00100000:2.0:1790740373.148568:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 193 00000100:00100000:2.0:1790740373.148580:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfcef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+34:12379:x1877727001008128:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790740373.148606:0:6536:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740373.148628:0:6536:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92e815 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23f01 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740373.148686:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92e815 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f01 expref: 35 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740373.148701:0:6536:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92e815 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f01 expref: 35 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740373.148721:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98dc887e4100) 00010000:00010000:2.0:1790740373.148725:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790740373.148728:0:6536:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f33600, rc 0) 00000100:00100000:2.0:1790740373.148876:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfcef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+35:12379:x1877727001008128:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 296us (5712us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740373.148883:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 193 00000100:00100000:3.0:1790740373.154492:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740373.154652:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001008256 00000100:00100000:1.0:1790740373.154662:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001008256 00000100:00100000:1.0:1790740373.154746:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 59 00000100:00100000:1.0:1790740373.154756:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8453d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bed19f2-4c98-4684-89e7-a6871565665d+6:2405:x1877727001008256:12345-192.168.204.3@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1790740373.154820:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790740373.155076:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8453d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bed19f2-4c98-4684-89e7-a6871565665d+7:2405:x1877727001008256:12345-192.168.204.3@tcp:2:lhsmtool_posix.0 Request processed in 320us (593us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1790740373.155084:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 59 00000100:00100000:2.0:1790740373.163455:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740373.163646:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001008512 00000100:00100000:3.0:1790740373.163656:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001008512 00000100:00100000:3.0:1790740373.163761:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 49 00000100:00100000:3.0:1790740373.163772:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82f99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+35:12379:x1877727001008512:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790740373.164020:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82f99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+36:12379:x1877727001008512:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 Request processed in 249us (575us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1790740373.164029:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 49 00000100:00100000:1.0:1790740373.168961:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740373.174096:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001008768 00000100:00100000:0.0:1790740373.174113:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001008768 00000100:00100000:0.0:1790740373.174193:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 194 00000100:00100000:0.0:1790740373.174204:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+36:12379:x1877727001008768:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790740373.174332:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+36:12379:x1877727001008768:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 Request processed in 129us (5439us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740373.174341:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 194 00000100:00100000:2.0:1790740373.177930:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740373.178014:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001008896 00000100:00100000:0.0:1790740373.178024:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001008896 00000100:00100000:0.0:1790740373.178103:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 195 00000100:00100000:0.0:1790740373.178113:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84461c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+36:12379:x1877727001008896:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790740373.178133:0:6535:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740373.178154:0:6535:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92e81c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23f08 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.178223:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3600/0xb25dda4f4e92e823 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.178239:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3600/0xb25dda4f4e92e823 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.178251:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3600/0xb25dda4f4e92e823 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790740373.178306:0:6535:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790740373.178322:0:6535:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3600/0xb25dda4f4e92e823 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.178345:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92e81c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f08 expref: 38 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.178361:0:6535:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3600/0xb25dda4f4e92e823 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f08 expref: 37 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.178370:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98dc887e4100) 00010000:00010000:0.0:1790740373.178373:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1790740373.178377:0:6535:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaeee3600, rc 0) 00000100:00100000:0.0:1790740373.178439:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84461c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+37:12379:x1877727001008896:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 327us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740373.178446:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 195 00000100:00100000:1.0:1790740373.181585:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740373.181640:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001009024 00000100:00100000:3.0:1790740373.181650:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001009024 00000100:00100000:3.0:1790740373.181714:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 60 00000100:00100000:3.0:1790740373.181725:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7bed19f2-4c98-4684-89e7-a6871565665d+7:2403:x1877727001009024:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790740373.181744:0:9806:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740373.181765:0:9806:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063a6c57a/0xb25dda4f4e92e82a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23f0f expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790740373.181790:0:9806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abc8795, blocks: 0x0 00010000:00010000:3.0:1790740373.181809:0:9806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=444s v=(0 0) 00010000:00010000:3.0:1790740373.181819:0:9806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790740373.181830:0:9806:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063a6c57a/0xb25dda4f4e92e82a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f0f expref: 8 pid: 9806 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.181848:0:9806:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000063a6c57a/0xb25dda4f4e92e82a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f0f expref: 8 pid: 9806 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.181862:0:9806:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc9c00, rc 0) 00000100:00100000:3.0:1790740373.181940:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7bed19f2-4c98-4684-89e7-a6871565665d+8:2403:x1877727001009024:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 216us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740373.181948:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 60 00000100:00100000:3.0:1790740373.185380:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740373.185524:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001009280 00000100:00100000:2.0:1790740373.185535:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001009280 00000100:00100000:2.0:1790740373.185609:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 196 00000100:00100000:2.0:1790740373.185619:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8453ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+37:12379:x1877727001009280:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790740373.185748:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8453ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+37:12379:x1877727001009280:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 Request processed in 131us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740373.185757:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 196 00000100:00100000:3.0:1790740373.192459:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740373.192582:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001009408 00000100:00100000:0.0:1790740373.192593:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001009408 00000100:00100000:0.0:1790740373.192647:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 61 00000100:00100000:0.0:1790740373.192657:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8453c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bed19f2-4c98-4684-89e7-a6871565665d+8:12379:x1877727001009408:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790740373.192676:0:8451:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740373.192696:0:8451:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000918517f7/0xb25dda4f4e92e831 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23f16 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.192733:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000063a6c57a/0xb25dda4f4e92e82a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f0f expref: 9 pid: 9806 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.192761:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740373.192766:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740373.192772:0:8451:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000918517f7/0xb25dda4f4e92e831 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f16 expref: 9 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.192822:0:8451:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000063a6c57a/0xb25dda4f4e92e82a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f0f expref: 9 pid: 9806 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.192837:0:8451:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000063a6c57a/0xb25dda4f4e92e82a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f0f expref: 9 pid: 9806 timeout: 544 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740373.192853:0:8451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db846b6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8451:1877727022042496:192.168.204.3@tcp:104: 00000100:00100000:0.0:1790740373.192942:0:8451:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc87de3300 going to sleep for 11 seconds 00000100:00100000:0.0:1790740373.203225:0:8451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db846b6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8451:1877727022042496:192.168.204.3@tcp:104: 00010000:00010000:0.0:1790740373.203263:0:8451:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000918517f7/0xb25dda4f4e92e831 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f16 expref: 9 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.203286:0:8451:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaeee2c00, rc 0) 00000100:00100000:0.0:1790740373.203352:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8453c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bed19f2-4c98-4684-89e7-a6871565665d+9:12379:x1877727001009408:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 10695us (10902us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740373.203362:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 61 00000100:00100000:0.0:1790740373.211353:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740373.217303:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001009536 00000100:00100000:1.0:1790740373.217322:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001009536 00010000:00010000:1.0:1790740373.217372:0:6522:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000063a6c57a/0xb25dda4f4e92e82a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f0f expref: 9 pid: 9806 timeout: 544 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740373.217419:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 86 00000100:00100000:1.0:1790740373.217429:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db846b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7bed19f2-4c98-4684-89e7-a6871565665d+9:2402:x1877727001009536:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740373.217447:0:6522:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740373.217502:0:6522:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000063a6c57a/0xb25dda4f4e92e82a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f0f expref: 9 pid: 9806 timeout: 544 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.217518:0:6522:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000063a6c57a/0xb25dda4f4e92e82a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f0f expref: 9 pid: 9806 timeout: 544 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.217542:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063a6c57a/0xb25dda4f4e92e82a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f0f expref: 9 pid: 9806 timeout: 544 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.217557:0:6522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790740373.217562:0:6522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790740373.217572:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000918517f7/0xb25dda4f4e92e831 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f16 expref: 8 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.217583:0:6522:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000918517f7/0xb25dda4f4e92e831 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f16 expref: 8 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.217622:0:6522:0:(ldlm_lockd.c:1085:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000918517f7/0xb25dda4f4e92e831 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f16 expref: 8 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740373.217637:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db8468ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6522:1877727022042624:192.168.204.3@tcp:105: 00000100:00100000:1.0:1790740373.217734:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc86ae33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790740373.223795:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db8468ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6522:1877727022042624:192.168.204.3@tcp:105: 00010000:00010000:3.0:1790740373.223832:0:6522:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740373.223913:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db846b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7bed19f2-4c98-4684-89e7-a6871565665d+8:2402:x1877727001009536:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 6484us (12571us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740373.223934:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 86 00000100:00100000:3.0:1790740373.225767:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740373.225922:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001009664 00000100:00100000:2.0:1790740373.225933:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001009664 00002000:00100000:2.0:1790740373.225987:0:8457:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff98db8453c000 x1877727001009664/t0(0) o4->7bed19f2-4c98-4684-89e7-a6871565665d@192.168.204.3@tcp:429/0 lens 504/0 e 0 to 0 dl 1790740384 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790740373.225999:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98db8453c000 with x1877727001009664 ext(0->8) 00002000:00010000:2.0:1790740373.226006:0:8457:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98db8453c000 00000100:00100000:2.0:1790740373.226059:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 4 00000100:00100000:2.0:1790740373.226070:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8453c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7bed19f2-4c98-4684-89e7-a6871565665d+8:2403:x1877727001009664:12345-192.168.204.3@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1790740373.228843:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8453c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7bed19f2-4c98-4684-89e7-a6871565665d+10:2403:x1877727001009664:12345-192.168.204.3@tcp:4:lhsmtool_posix.0 Request processed in 2762us (3072us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1790740373.228857:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 4 00002000:00100000:2.0:1790740373.228872:0:8457:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff98db8453c000 x1877727001009664/t4294967315(0) o4->7bed19f2-4c98-4684-89e7-a6871565665d@192.168.204.3@tcp:429/0 lens 504/448 e 0 to 0 dl 1790740384 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790740373.228884:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98db8453c000 with x1877727001009664 ext(0->8) 00002000:00010000:2.0:1790740373.228890:0:8457:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98db8453c000 00000100:00100000:3.0:1790740373.235441:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740373.235878:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001009792 00000100:00100000:0.0:1790740373.235902:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001009792 00000100:00100000:0.0:1790740373.235982:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 197 00000100:00100000:0.0:1790740373.235992:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8453f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+37:12379:x1877727001009792:12345-192.168.204.3@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1790740373.240601:0:6514:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:0.0:1790740373.240620:0:6514:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:0.0:1790740373.240662:0:6514:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:0.0:1790740373.240684:0:6567:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1790740373.240694:0:6567:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1790740373.240854:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8453f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+21:12379:x1877727001009792:12345-192.168.204.3@tcp:44:lhsmtool_posix.0 Request processed in 4857us (5415us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740373.240865:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 197 00000100:00100000:2.0:1790740373.245290:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790740373.245312:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022042752:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1790740373.245400:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740373.245449:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022042752 00000100:00100000:2.0:1790740373.245458:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022042752 00000100:00100000:2.0:1790740373.245519:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790740373.245528:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727022042752:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1790740373.245672:0:8453:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1790740373.245676:0:8453:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1790740373 00002000:00010000:2.0:1790740373.245679:0:8453:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1790740373.245681:0:8453:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1790740373 -> 1790740373 00002000:00010000:2.0:1790740373.245684:0:8453:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1790740373.245722:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1877727022042752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 196us (321us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1790740373.245728:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000004:00080000:2.0:1790740373.245771:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98db84461880/2, rc 0, transno 4294967316 00000100:00100000:2.0:1790740373.245777:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022042752:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1790740373.247258:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e70b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.247276:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e70b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.247284:0:3624:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e70b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.247290:0:3624:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc9400 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740373.247295:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e70b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.247303:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e70b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740373.249585:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740373.249633:0:14497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001009920 00000100:00100000:2.0:1790740373.249644:0:14497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001009920 00000100:00100000:2.0:1790740373.249699:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 63 00000100:00100000:2.0:1790740373.249710:0:14497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc98537800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7bed19f2-4c98-4684-89e7-a6871565665d+10:2403:x1877727001009920:12345-192.168.204.3@tcp:16:lhsmtool_posix.0 00010000:00010000:3.0:1790740373.258336:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc887e4700) 00010000:00010000:3.0:1790740373.258352:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740373.258365:0:3624:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e70b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.258390:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e70b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.258428:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3a00/0xb25dda4f4e92e80e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.258436:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3a00/0xb25dda4f4e92e80e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.258459:0:3624:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3a00/0xb25dda4f4e92e80e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.258475:0:3624:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee3a00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740373.258479:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3a00/0xb25dda4f4e92e80e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.258488:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3a00/0xb25dda4f4e92e80e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.258505:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98dc887e4100) 00010000:00010000:3.0:1790740373.258507:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790740373.258510:0:3624:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3a00/0xb25dda4f4e92e80e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.258516:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3a00/0xb25dda4f4e92e80e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790740373.259289:0:8446:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:1.0:1790740373.259303:0:8446:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:2.0:1790740373.259511:0:14497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc98537800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7bed19f2-4c98-4684-89e7-a6871565665d+7:2403:x1877727001009920:12345-192.168.204.3@tcp:16:lhsmtool_posix.0 Request processed in 9797us (9928us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740373.259523:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 63 00000100:00100000:0.0:1790740373.265657:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740373.265822:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001010176 00000100:00100000:2.0:1790740373.265832:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001010176 00000100:00100000:2.0:1790740373.265888:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 198 00000100:00100000:2.0:1790740373.265897:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db846b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+19:12379:x1877727001010176:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790740373.265954:0:7760:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740373.265979:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3600/0xb25dda4f4e92e823 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f08 expref: 19 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740373.266016:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98dc887e4100) 00010000:00010000:2.0:1790740373.266021:0:7760:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790740373.266082:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e838 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740373.266097:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e838 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740373.266106:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e838 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790740373.266366:0:7760:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b5c79e4d reply state 000000009485af57 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e838 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740373.266391:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e838 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740373.266399:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98dc887e4100) 00010000:00010000:2.0:1790740373.266401:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790740373.266404:0:7760:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790740373.266576:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db846b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+20:12379:x1877727001010176:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 Request processed in 679us (929us total) trans 4294967463 rc 0/0 00000100:00100000:2.0:1790740373.266585:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 198 00000100:00100000:3.0:1790740373.269358:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740373.269651:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001010304 00000100:00100000:1.0:1790740373.269662:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001010304 00000100:00100000:1.0:1790740373.269724:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 64 00000100:00100000:1.0:1790740373.269752:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8453dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bed19f2-4c98-4684-89e7-a6871565665d+7:2403:x1877727001010304:12345-192.168.204.3@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1790740373.270147:0:8451:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1790740373.270152:0:8451:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1790740373 -> 1790740372 00002000:00010000:1.0:1790740373.270155:0:8451:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1790740370 00002000:00010000:1.0:1790740373.270157:0:8451:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1790740373 -> 1790740372 00002000:00010000:1.0:1790740373.270159:0:8451:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1790740373.270915:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8453dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bed19f2-4c98-4684-89e7-a6871565665d+8:2403:x1877727001010304:12345-192.168.204.3@tcp:2:lhsmtool_posix.0 Request processed in 1162us (1561us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1790740373.270927:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 64 00000100:00100000:3.0:1790740373.286097:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740373.286188:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001010560 00000100:00100000:0.0:1790740373.286199:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001010560 00000100:00100000:0.0:1790740373.286261:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 199 00000100:00100000:0.0:1790740373.286271:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8453ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+20:12379:x1877727001010560:12345-192.168.204.3@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1790740373.286353:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3600/0xb25dda4f4e92e83f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.286372:0:13222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3200/0xb25dda4f4e92e807 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23efa expref: 20 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.286382:0:13222:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3600/0xb25dda4f4e92e83f lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.286420:0:13222:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3200/0xb25dda4f4e92e807 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23efa expref: 20 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.286435:0:13222:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3200/0xb25dda4f4e92e807 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23efa expref: 20 pid: 13222 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740373.286470:0:13222:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db846b7800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13222:1877727022042880:192.168.204.3@tcp:104: 00000100:00100000:0.0:1790740373.286570:0:13222:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc87de3300 going to sleep for 11 seconds 00000100:00100000:0.0:1790740373.300187:0:13222:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db846b7800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13222:1877727022042880:192.168.204.3@tcp:104: 00010000:00010000:0.0:1790740373.300222:0:13222:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3600/0xb25dda4f4e92e83f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740373.300515:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740373.302243:0:9550:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001010688 00000100:00100000:3.0:1790740373.302256:0:9550:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001010688 00010000:00010000:3.0:1790740373.302306:0:9550:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3200/0xb25dda4f4e92e807 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23efa expref: 21 pid: 13222 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740373.302416:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 87 00000100:00100000:3.0:1790740373.302426:0:9550:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7bed19f2-4c98-4684-89e7-a6871565665d+21:2402:x1877727001010688:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790740373.302443:0:9550:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740373.302472:0:9550:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3200/0xb25dda4f4e92e807 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23efa expref: 21 pid: 13222 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.302499:0:9550:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3200/0xb25dda4f4e92e807 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23efa expref: 21 pid: 13222 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.302522:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3200/0xb25dda4f4e92e807 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23efa expref: 21 pid: 13222 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.302538:0:9550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98dc887e4100) 00010000:00010000:3.0:1790740373.302542:0:9550:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3600/0xb25dda4f4e92e83f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.302551:0:9550:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3600/0xb25dda4f4e92e83f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.302559:0:9550:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3600/0xb25dda4f4e92e83f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.302591:0:9550:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740373.302659:0:9550:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7bed19f2-4c98-4684-89e7-a6871565665d+20:2402:x1877727001010688:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 233us (2144us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740373.302666:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 87 00010000:00010000:0.0:1790740373.302733:0:13222:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3600/0xb25dda4f4e92e83f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.302741:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3600/0xb25dda4f4e92e83f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.302780:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3600/0xb25dda4f4e92e83f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.302801:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3600/0xb25dda4f4e92e83f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.302808:0:13222:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3600/0xb25dda4f4e92e83f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.302814:0:13222:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee3600 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:0.0:1790740373.302819:0:13222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3600/0xb25dda4f4e92e83f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.302827:0:13222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3600/0xb25dda4f4e92e83f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.302837:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98dc887e4100) 00010000:00010000:0.0:1790740373.302846:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1790740373.302851:0:13222:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3600/0xb25dda4f4e92e83f lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.302857:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3600/0xb25dda4f4e92e83f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740373.302916:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8453ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+19:12379:x1877727001010560:12345-192.168.204.3@tcp:55:lhsmtool_posix.0 Request processed in 16646us (16829us total) trans 0 rc -22/-22 00000100:00100000:0.0:1790740373.302925:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 199 00000100:00100000:2.0:1790740373.307009:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740373.313635:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001010816 00000100:00100000:3.0:1790740373.313653:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001010816 00000100:00100000:2.0:1790740373.313829:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 65 00000100:00100000:2.0:1790740373.313840:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc98536a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7bed19f2-4c98-4684-89e7-a6871565665d+8:2404:x1877727001010816:12345-192.168.204.3@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1790740373.314113:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c130e9a4/0xb25dda4f4e92e846 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740373.314155:0:9806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000918517f7/0xb25dda4f4e92e831 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f16 expref: 8 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740373.314164:0:9806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740373.314169:0:9806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790740373.314174:0:9806:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c130e9a4/0xb25dda4f4e92e846 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740373.314216:0:9806:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000918517f7/0xb25dda4f4e92e831 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f16 expref: 8 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740373.314231:0:9806:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000918517f7/0xb25dda4f4e92e831 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f16 expref: 8 pid: 8451 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740373.314250:0:9806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ee9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9806:1877727022043008:192.168.204.3@tcp:104: 00000100:00100000:2.0:1790740373.315238:0:9806:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83d05780 going to sleep for 11 seconds 00000100:00100000:0.0:1790740373.325181:0:9806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ee9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9806:1877727022043008:192.168.204.3@tcp:104: 00010000:00010000:0.0:1790740373.325219:0:9806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c130e9a4/0xb25dda4f4e92e846 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740373.343857:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740373.344183:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001010944 00000100:00100000:1.0:1790740373.344194:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001010944 00010000:00010000:1.0:1790740373.344239:0:6521:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000918517f7/0xb25dda4f4e92e831 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f16 expref: 9 pid: 8451 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740373.344286:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 88 00000100:00100000:1.0:1790740373.344296:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc86ac0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7bed19f2-4c98-4684-89e7-a6871565665d+9:2403:x1877727001010944:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740373.344312:0:6521:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740373.344334:0:6521:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000918517f7/0xb25dda4f4e92e831 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f16 expref: 9 pid: 8451 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.344350:0:6521:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000918517f7/0xb25dda4f4e92e831 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f16 expref: 9 pid: 8451 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.344373:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000918517f7/0xb25dda4f4e92e831 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f16 expref: 9 pid: 8451 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.344410:0:6521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790740373.344415:0:6521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790740373.344422:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c130e9a4/0xb25dda4f4e92e846 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.344432:0:6521:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c130e9a4/0xb25dda4f4e92e846 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.344477:0:6521:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790740373.344654:0:9806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c130e9a4/0xb25dda4f4e92e846 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.344675:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c130e9a4/0xb25dda4f4e92e846 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.344838:0:9806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c130e9a4/0xb25dda4f4e92e846 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.344849:0:9806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c130e9a4/0xb25dda4f4e92e846 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.344941:0:9806:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c130e9a4/0xb25dda4f4e92e846 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.344950:0:9806:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f32a00 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:3.0:1790740373.344955:0:9806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c130e9a4/0xb25dda4f4e92e846 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.344967:0:9806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c130e9a4/0xb25dda4f4e92e846 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.345105:0:9806:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c130e9a4/0xb25dda4f4e92e846 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.345115:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c130e9a4/0xb25dda4f4e92e846 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740373.345428:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc98536a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7bed19f2-4c98-4684-89e7-a6871565665d+8:2404:x1877727001010816:12345-192.168.204.3@tcp:1:lhsmtool_posix.0 Request processed in 31584us (38539us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740373.345440:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 65 00000100:00100000:1.0:1790740373.346063:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc86ac0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7bed19f2-4c98-4684-89e7-a6871565665d+8:2403:x1877727001010944:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 240us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740373.346091:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 88 00000100:00100000:3.0:1790740373.354131:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740373.354198:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001011200 00000100:00100000:3.0:1790740373.354213:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001011200 00000100:00100000:3.0:1790740373.354738:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 200 00000100:00100000:3.0:1790740373.354756:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8453e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+19:12379:x1877727001011200:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1790740373.354876:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e84d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.354899:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e694 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e9f expref: 19 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.354910:0:6537:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e84d lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.354958:0:6537:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e694 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e9f expref: 19 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.354977:0:6537:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e694 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e9f expref: 19 pid: 7760 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740373.355007:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db8453e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6537:1877727022043136:192.168.204.3@tcp:104: 00000100:00100000:3.0:1790740373.355178:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82c98180 going to sleep for 11 seconds 00000100:00100000:3.0:1790740373.358284:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db8453e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6537:1877727022043136:192.168.204.3@tcp:104: 00010000:00010000:3.0:1790740373.358360:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e84d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740373.358961:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740373.359339:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001011328 00000100:00100000:1.0:1790740373.359354:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001011328 00010000:00010000:1.0:1790740373.359411:0:6522:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e694 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e9f expref: 20 pid: 7760 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740373.359474:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 89 00000100:00100000:1.0:1790740373.359487:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8453e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7bed19f2-4c98-4684-89e7-a6871565665d+20:2403:x1877727001011328:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740373.359506:0:6522:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740373.359514:0:6522:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e694 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e9f expref: 20 pid: 7760 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.359531:0:6522:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e694 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e9f expref: 20 pid: 7760 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.359650:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e694 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e9f expref: 20 pid: 7760 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.359668:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc887e4700) 00010000:00010000:1.0:1790740373.359674:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e84d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.359683:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e84d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.359691:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e84d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.359723:0:6522:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790740373.359827:0:6537:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e84d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.359856:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e84d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740373.360013:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8453e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7bed19f2-4c98-4684-89e7-a6871565665d+19:2403:x1877727001011328:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 299us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740373.360023:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 89 00010000:00010000:3.0:1790740373.360178:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e854 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.360202:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92e815 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f01 expref: 19 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.360212:0:6537:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e854 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.360265:0:6537:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92e815 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f01 expref: 19 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.360286:0:6537:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92e815 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f01 expref: 19 pid: 6536 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740373.360319:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db8453f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6537:1877727022043264:192.168.204.3@tcp:104: 00000100:00100000:3.0:1790740373.360507:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82c98000 going to sleep for 11 seconds 00000100:00100000:0.0:1790740373.363982:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db8453f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6537:1877727022043264:192.168.204.3@tcp:104: 00010000:00010000:0.0:1790740373.364060:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e854 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740373.369680:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740373.369771:0:9550:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001011456 00000100:00100000:3.0:1790740373.369789:0:9550:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001011456 00010000:00010000:3.0:1790740373.369829:0:9550:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92e815 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f01 expref: 20 pid: 6536 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740373.369871:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 90 00000100:00100000:3.0:1790740373.369893:0:9550:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db846b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7bed19f2-4c98-4684-89e7-a6871565665d+20:2405:x1877727001011456:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790740373.369907:0:9550:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740373.369925:0:9550:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92e815 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f01 expref: 20 pid: 6536 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.369939:0:9550:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92e815 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f01 expref: 20 pid: 6536 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.369961:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92e815 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f01 expref: 20 pid: 6536 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.369975:0:9550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98dc887e4100) 00010000:00010000:3.0:1790740373.369981:0:9550:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e854 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.369989:0:9550:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e854 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.369996:0:9550:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e854 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.370027:0:9550:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740373.370109:0:9550:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db846b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7bed19f2-4c98-4684-89e7-a6871565665d+19:2405:x1877727001011456:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 228us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740373.370116:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 90 00010000:00010000:0.0:1790740373.370630:0:6537:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e854 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.370641:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e854 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790740373.370752:0:6537:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:0.0:1790740373.370872:0:6537:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:0.0:1790740373.370923:0:6537:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:0.0:1790740373.371004:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db846b7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6537:1877727022043392:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1790740373.371103:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740373.371408:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022043392 00000100:00100000:2.0:1790740373.371415:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022043392 00000100:00100000:2.0:1790740373.371459:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1790740373.371477:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db846b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6537:x1877727022043392:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1790740373.371566:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db846b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6537:x1877727022043392:12345-0@lo:1000:mdt00_002.0 Request processed in 91us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740373.371573:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1790740373.371684:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dca0807f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790740373.371713:0:6537:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:0.0:1790740373.371718:0:6537:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98db84461880, transno 4294967316 00000100:00100000:0.0:1790740373.371739:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db846b7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6537:1877727022043392:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1790740373.371853:0:6537:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:0.0:1790740373.372119:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db846b7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6537:1877727022043520:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1790740373.372151:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740373.372169:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc86ae3000 going to sleep for 11 seconds 00000100:00100000:0.0:1790740373.372187:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022043520 00000100:00100000:0.0:1790740373.372192:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022043520 00000100:00100000:0.0:1790740373.372217:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1790740373.372224:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db846b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6537:x1877727022043520:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1790740373.372325:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db846b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6537:x1877727022043520:12345-0@lo:1000:mdt00_002.0 Request processed in 100us (173us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1790740373.372333:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1790740373.372363:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db846b7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6537:1877727022043520:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1790740373.372395:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e854 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.372406:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e854 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.372413:0:6537:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e854 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.372420:0:6537:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc9400 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:0.0:1790740373.372425:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e854 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.372443:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e854 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.372474:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98dc887e4100) 00010000:00010000:0.0:1790740373.372477:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790740373.372484:0:6537:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e854 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.372491:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e854 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.372518:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2800/0xb25dda4f4e92e790 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.372525:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2800/0xb25dda4f4e92e790 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.372532:0:6537:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2800/0xb25dda4f4e92e790 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.376825:0:6537:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee2800 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:0.0:1790740373.376833:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2800/0xb25dda4f4e92e790 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.376845:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2800/0xb25dda4f4e92e790 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.376865:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc887e4700) 00010000:00010000:0.0:1790740373.376868:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790740373.376873:0:6537:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2800/0xb25dda4f4e92e790 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.377054:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2800/0xb25dda4f4e92e790 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.377091:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92e85b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.377108:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e7ac lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ee5 expref: 22 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.377118:0:6537:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92e85b lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.377161:0:6537:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e7ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ee5 expref: 22 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.377179:0:6537:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e7ac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ee5 expref: 22 pid: 7760 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740373.377196:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db846b5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6537:1877727022043648:192.168.204.3@tcp:104: 00000100:00100000:0.0:1790740373.377295:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc99069b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790740373.381768:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740373.382727:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db846b5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6537:1877727022043648:192.168.204.3@tcp:104: 00010000:00010000:2.0:1790740373.382776:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92e85b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740373.385146:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001011584 00000100:00100000:1.0:1790740373.385163:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001011584 00010000:00010000:1.0:1790740373.385214:0:6521:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e7ac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ee5 expref: 23 pid: 7760 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740373.385300:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 91 00000100:00100000:1.0:1790740373.385311:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db846b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7bed19f2-4c98-4684-89e7-a6871565665d+23:2403:x1877727001011584:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740373.385328:0:6521:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740373.385335:0:6521:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e7ac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ee5 expref: 23 pid: 7760 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.385367:0:6521:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e7ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ee5 expref: 23 pid: 7760 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.385391:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e7ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ee5 expref: 23 pid: 7760 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.385409:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc887e4700) 00010000:00010000:1.0:1790740373.385415:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92e85b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.385425:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92e85b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.385434:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92e85b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.385481:0:6521:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790740373.385548:0:6537:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92e85b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740373.385561:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db846b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7bed19f2-4c98-4684-89e7-a6871565665d+22:2403:x1877727001011584:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 251us (3802us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740373.385568:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 91 00010000:00010000:0.0:1790740373.385635:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92e85b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.385649:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92e85b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.385667:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92e85b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.385674:0:6537:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92e85b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.385680:0:6537:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee2400 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:0.0:1790740373.385684:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92e85b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.385693:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92e85b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.385702:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc887e4700) 00010000:00010000:0.0:1790740373.385705:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740373.385709:0:6537:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92e85b lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.385714:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92e85b lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.385726:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e84d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.385731:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e84d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.385736:0:6537:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e84d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.385740:0:6537:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc9e00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:0.0:1790740373.385749:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e84d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.385755:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e84d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.385765:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc887e4700) 00010000:00010000:0.0:1790740373.385768:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790740373.385771:0:6537:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e84d lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.385777:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e84d lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790740373.386114:0:13821:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790740373.386120:0:13821:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790740373.387383:0:13821:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1790740373.387401:0:13821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790740373.388079:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8453e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+21:12379:x1877727001011200:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 Request processed in 33322us (34550us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1790740373.388093:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 200 00000020:00080000:0.0:1790740373.388100:0:6537:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1790740373.392338:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740373.392427:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001011840 00000100:00100000:0.0:1790740373.392438:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001011840 00000100:00100000:0.0:1790740373.392526:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 50 00000100:00100000:0.0:1790740373.392536:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc9925c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+21:12379:x1877727001011840:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1790740373.393090:0:6538:0:(mdd_object.c:4180:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1790740373.393127:0:6538:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:0.0:1790740373.393167:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2800/0xb25dda4f4e92e862 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.393206:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2800/0xb25dda4f4e92e862 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.393219:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2800/0xb25dda4f4e92e862 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.393229:0:6538:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2800/0xb25dda4f4e92e862 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.393235:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2800/0xb25dda4f4e92e862 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.393242:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2800/0xb25dda4f4e92e862 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.393268:0:6538:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790740373.393375:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc9925c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+23:12379:x1877727001011840:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 Request processed in 839us (1048us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1790740373.393383:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 50 00000020:00080000:0.0:1790740373.393388:0:6538:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790740373.393490:0:10357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790740373.393497:0:10357:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2800/0xb25dda4f4e92e862 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740373.393504:0:10357:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee2800 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:2.0:1790740373.393508:0:10357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2800/0xb25dda4f4e92e862 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740373.393516:0:10357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2800/0xb25dda4f4e92e862 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740373.393529:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98dc887e4100) 00010000:00010000:2.0:1790740373.393532:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1790740373.393547:0:10357:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2800/0xb25dda4f4e92e862 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740373.393554:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2800/0xb25dda4f4e92e862 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740373.393568:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740373.393569:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740373.393571:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790740373.840646:0:14730:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790740373.840656:0:14730:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790740373.840691:0:14730:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1790740373.840698:0:14730:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790740373.969173:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740373.969291:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001012096 00000100:00100000:2.0:1790740373.969302:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001012096 00000100:00100000:2.0:1790740373.969361:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 201 00000100:00100000:2.0:1790740373.969370:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8453f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+23:12389:x1877727001012096:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:2.0:1790740373.969396:0:7760:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740373.969416:0:7760:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92e869 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23f1d expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740373.969539:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33400/0xb25dda4f4e92e870 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740373.969554:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33400/0xb25dda4f4e92e870 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740373.969567:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33400/0xb25dda4f4e92e870 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740373.969579:0:7760:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1790740373.969675:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92e869 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f1d expref: 26 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740373.969690:0:7760:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33400/0xb25dda4f4e92e870 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f1d expref: 25 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740373.969697:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98dc887e4800) 00010000:00010000:2.0:1790740373.969700:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790740373.969703:0:7760:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f33400, rc 0) 00000100:00100000:2.0:1790740373.969804:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8453f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+25:12389:x1877727001012096:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 435us (641us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1790740373.969811:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 201 00000100:00100000:3.0:1790740373.978591:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740373.978635:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001012224 00000100:00100000:3.0:1790740373.978645:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001012224 00000100:00100000:3.0:1790740373.978698:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 202 00000100:00100000:3.0:1790740373.978707:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8453fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+25:12389:x1877727001012224:12345-192.168.204.3@tcp:34:lfs.0 00010000:00010000:3.0:1790740373.980135:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e87e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.980162:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e87e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.980174:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e87e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.980194:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e885 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.980201:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e885 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.980207:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e885 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.980306:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e88c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.980316:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e88c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.980322:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e88c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790740373.980381:0:13222:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e88c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.980396:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e87e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.980416:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e87e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.980424:0:13222:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e87e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.980430:0:13222:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc9800 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740373.980436:0:13222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e87e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.980444:0:13222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e87e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.980468:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98dc887e4800) 00010000:00010000:3.0:1790740373.980471:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740373.980477:0:13222:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e87e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.980483:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e87e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.980496:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e885 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.980502:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e885 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.980508:0:13222:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e885 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.980513:0:13222:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc8a00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740373.980521:0:13222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e885 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.980527:0:13222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e885 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.980535:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98dcaf04c000) 00010000:00010000:3.0:1790740373.980537:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740373.980540:0:13222:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e885 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.980546:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e885 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.980560:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e88c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.980567:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e88c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.980572:0:13222:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e88c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.980578:0:13222:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc9e00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740373.980581:0:13222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e88c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.980587:0:13222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e88c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.980593:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dcaf04c300) 00010000:00010000:3.0:1790740373.980595:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740373.980604:0:13222:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e88c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.980610:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e88c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740373.980712:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8453fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+25:12389:x1877727001012224:12345-192.168.204.3@tcp:34:lfs.0 Request processed in 2003us (2126us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740373.980722:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 202 00010000:00010000:3.0:1790740373.995203:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740374.038776:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740374.039006:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001012480 00000100:00100000:0.0:1790740374.039016:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001012480 00000100:00080000:2.0:1790740374.039219:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790740374.039276:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 203 00000100:00100000:1.0:1790740374.039289:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+25:12392:x1877727001012480:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:1.0:1790740374.039310:0:6537:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740374.039332:0:6537:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e893 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23f24 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.039443:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e89a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.039469:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e89a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.039480:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e89a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.039497:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92e8a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.039504:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92e8a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.039510:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92e8a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.039638:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92e8a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.039646:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92e8a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.039653:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92e8a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740374.039663:0:6537:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1790740374.039738:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e89a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.039746:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e89a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.039759:0:6537:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e89a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.039765:0:6537:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc45c00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740374.039769:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e89a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.039777:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e89a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.039800:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98dc887e4800) 00010000:00010000:1.0:1790740374.039804:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740374.039809:0:6537:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e89a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.039815:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e89a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.039827:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92e8a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.039833:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92e8a1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.039839:0:6537:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92e8a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.039843:0:6537:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc45600 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740374.039846:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92e8a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.039860:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92e8a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.039867:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98dc985beb00) 00010000:00010000:1.0:1790740374.039870:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740374.039872:0:6537:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92e8a1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.039886:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92e8a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.039924:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e893 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f24 expref: 28 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.039936:0:6537:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92e8a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f24 expref: 27 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.039943:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc985bee00) 00010000:00010000:1.0:1790740374.039945:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790740374.039947:0:6537:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcbfc44000, rc 0) 00000100:00100000:1.0:1790740374.040010:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+27:12392:x1877727001012480:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 724us (1244us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1790740374.040017:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 203 00000100:00100000:0.0:1790740374.043650:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740374.043711:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001012608 00000100:00100000:3.0:1790740374.043725:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001012608 00000100:00100000:3.0:1790740374.043789:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 204 00000100:00100000:3.0:1790740374.043799:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db846b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+27:12392:x1877727001012608:12345-192.168.204.3@tcp:54:lfs.0 00010000:00010000:3.0:1790740374.043865:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e8b6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.043896:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e8b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.043907:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e8b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.043943:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e8b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.043951:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e8b6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.043959:0:6535:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e8b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.043986:0:6535:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc9e00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740374.043991:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e8b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.044000:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e8b6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.044014:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc985bee00) 00010000:00010000:3.0:1790740374.044018:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790740374.044023:0:6535:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e8b6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.044206:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e8b6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740374.044278:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db846b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+27:12392:x1877727001012608:12345-192.168.204.3@tcp:54:lfs.0 Request processed in 480us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740374.044287:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 204 00000100:00100000:1.0:1790740374.047933:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740374.048119:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001012864 00000100:00100000:0.0:1790740374.048129:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001012864 00000100:00100000:0.0:1790740374.048189:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 51 00000100:00100000:0.0:1790740374.048213:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+27:12392:x1877727001012864:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:0.0:1790740374.048438:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+28:12392:x1877727001012864:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 226us (515us total) trans 4294967473 rc 0/0 00000100:00100000:0.0:1790740374.048458:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 51 00000100:00100000:1.0:1790740374.081432:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740374.081560:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001013120 00000100:00100000:3.0:1790740374.081571:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001013120 00000100:00100000:3.0:1790740374.081631:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 205 00000100:00100000:3.0:1790740374.081641:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+28:11924:x1877727001013120:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:3.0:1790740374.081668:0:6536:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740374.081690:0:6536:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e8bd lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23f2b expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.082104:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e8c4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.082139:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92e8a8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f24 expref: 29 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.082149:0:6536:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e8c4 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.082184:0:6536:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92e8a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f24 expref: 29 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.082199:0:6536:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92e8a8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f24 expref: 29 pid: 6537 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740374.082214:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db8453c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6536:1877727022043776:192.168.204.3@tcp:104: 00000100:00100000:3.0:1790740374.082308:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82c98e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790740374.085277:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740374.085421:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001013248 00000100:00100000:1.0:1790740374.085429:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001013248 00000100:00100000:0.0:1790740374.085441:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db8453c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6536:1877727022043776:192.168.204.3@tcp:104: 00010000:00010000:0.0:1790740374.085480:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e8c4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.085481:0:6522:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92e8a8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f24 expref: 30 pid: 6537 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740374.085530:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 92 00000100:00100000:1.0:1790740374.085540:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8453d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7bed19f2-4c98-4684-89e7-a6871565665d+30:2402:x1877727001013248:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740374.085555:0:6522:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740374.085563:0:6522:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92e8a8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f24 expref: 30 pid: 6537 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.085574:0:6522:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92e8a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f24 expref: 30 pid: 6537 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.085594:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92e8a8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f24 expref: 30 pid: 6537 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.085609:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc985bee00) 00010000:00010000:1.0:1790740374.085614:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e8c4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.085624:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e8c4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.085631:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e8c4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.085662:0:6522:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790740374.085695:0:6536:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e8c4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740374.085703:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e8c4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740374.085712:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8453d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7bed19f2-4c98-4684-89e7-a6871565665d+29:2402:x1877727001013248:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 173us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740374.085718:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 92 00000004:00200000:0.0:1790740374.085720:0:6536:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1790740374.085841:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e8bd lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f2b expref: 30 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740374.085857:0:6536:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e8c4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f2b expref: 29 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740374.085864:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc985bee00) 00010000:00010000:0.0:1790740374.085867:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790740374.085869:0:6536:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc8a00, rc 0) 00000100:00100000:1.0:1790740374.087219:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+29:11924:x1877727001013120:12345-192.168.204.3@tcp:101:bash.0 Request processed in 5573us (5855us total) trans 4294967474 rc 0/0 00000100:00100000:1.0:1790740374.087240:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 205 00000100:00100000:0.0:1790740374.090827:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740374.091203:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001013376 00000100:00100000:1.0:1790740374.091214:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001013376 00000100:00100000:1.0:1790740374.091325:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 206 00000100:00100000:1.0:1790740374.091336:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db846b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+29:11924:x1877727001013376:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:1.0:1790740374.091365:0:6537:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740374.091389:0:6537:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e8d2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23f32 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.091425:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92e8d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.091438:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92e8d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.091459:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92e8d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.091599:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e8d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f32 expref: 31 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.091619:0:6537:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92e8d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f32 expref: 30 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.091627:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc985bee00) 00010000:00010000:1.0:1790740374.091631:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790740374.091635:0:6537:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcbfc45600, rc 0) 00000100:00100000:1.0:1790740374.091704:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db846b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+30:11924:x1877727001013376:12345-192.168.204.3@tcp:101:bash.0 Request processed in 369us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740374.091718:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 206 00000100:00100000:2.0:1790740374.094824:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740374.094981:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001013632 00000100:00100000:0.0:1790740374.094992:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001013632 00000100:00100000:0.0:1790740374.095476:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 207 00000100:00100000:0.0:1790740374.095501:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+30:11924:x1877727001013632:12345-192.168.204.3@tcp:36:bash.0 00010000:00010000:0.0:1790740374.095855:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2e00/0xb25dda4f4e92e8e0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740374.095874:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2e00/0xb25dda4f4e92e8e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740374.095951:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2e00/0xb25dda4f4e92e8e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790740374.096004:0:13222:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:0.0:1790740374.096028:0:13222:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000094a577ef reply state 0000000066644e28 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2e00/0xb25dda4f4e92e8e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740374.096059:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2e00/0xb25dda4f4e92e8e0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740374.096067:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc985bee00) 00010000:00010000:0.0:1790740374.096070:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790740374.096074:0:13222:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1790740374.096113:0:13222:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:0.0:1790740374.096268:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+34:11924:x1877727001013632:12345-192.168.204.3@tcp:36:bash.0 Request processed in 768us (1453us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1790740374.096276:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 207 00000020:00080000:0.0:1790740374.096282:0:13222:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1790740374.098657:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740374.098703:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001013760 00000100:00100000:1.0:1790740374.098713:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001013760 00000100:00100000:1.0:1790740374.098825:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 208 00000100:00100000:1.0:1790740374.098836:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ee9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+34:11924:x1877727001013760:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:1.0:1790740374.098860:0:6536:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740374.098894:0:6536:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92e8e7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23f39 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.098958:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92e8e7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f39 expref: 35 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.098973:0:6536:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92e8e7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f39 expref: 35 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.098994:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc985bee00) 00010000:00010000:1.0:1790740374.098998:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790740374.099003:0:6536:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcbfc44000, rc 0) 00000100:00100000:1.0:1790740374.099097:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ee9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+35:11924:x1877727001013760:12345-192.168.204.3@tcp:101:bash.0 Request processed in 263us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740374.099104:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 208 00000100:00100000:0.0:1790740374.102528:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740374.102675:0:14497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001013888 00000100:00100000:2.0:1790740374.102685:0:14497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001013888 00000100:00100000:2.0:1790740374.102745:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 66 00000100:00100000:2.0:1790740374.102770:0:14497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db846b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7bed19f2-4c98-4684-89e7-a6871565665d+7:11924:x1877727001013888:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:2.0:1790740374.102790:0:14497:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740374.102814:0:14497:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098921d05/0xb25dda4f4e92e8ee lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23f40 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790740374.102841:0:14497:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6abc8794, atime: 0x6abc8792, ctime: 0x6abc8794, blocks: 0x8 00010000:00010000:2.0:1790740374.102864:0:14497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=445s v=(0 0) 00010000:00010000:2.0:1790740374.102945:0:14497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740374.102955:0:14497:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098921d05/0xb25dda4f4e92e8ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f40 expref: 8 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740374.102973:0:14497:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000098921d05/0xb25dda4f4e92e8ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f40 expref: 8 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740374.102987:0:14497:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f32e00, rc 0) 00000100:00100000:2.0:1790740374.103068:0:14497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db846b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7bed19f2-4c98-4684-89e7-a6871565665d+8:11924:x1877727001013888:12345-192.168.204.3@tcp:101:bash.0 Request processed in 299us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740374.103076:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 66 00000100:00100000:2.0:1790740374.107105:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740374.107865:0:8459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001014016 00000100:00100000:3.0:1790740374.107889:0:8459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001014016 00002000:00010000:3.0:1790740374.107941:0:8459:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:3.0:1790740374.107947:0:8459:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98db84461880 with x1877727001014016 ext(0->18446744073709551615) 00002000:00010000:3.0:1790740374.107961:0:8459:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98db84461880. 00000100:00100000:3.0:1790740374.108002:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 5 00000100:00100000:3.0:1790740374.108013:0:8459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7bed19f2-4c98-4684-89e7-a6871565665d+8:2403:x1877727001014016:12345-192.168.204.3@tcp:10:bash.0 00002000:00010000:3.0:1790740374.108704:0:8459:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1790740374.108710:0:8459:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1790740372 -> 1790740374 00002000:00010000:3.0:1790740374.108713:0:8459:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1790740370 -> 1790740370 00002000:00010000:3.0:1790740374.108716:0:8459:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1790740372 -> 1790740374 00002000:00010000:3.0:1790740374.108729:0:8459:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1790740374.108858:0:8459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7bed19f2-4c98-4684-89e7-a6871565665d+9:2403:x1877727001014016:12345-192.168.204.3@tcp:10:bash.0 Request processed in 845us (1761us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1790740374.108878:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 5 00002000:00010000:3.0:1790740374.108883:0:8459:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:3.0:1790740374.108887:0:8459:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98db84461880 with x1877727001014016 ext(0->18446744073709551615) 00002000:00010000:3.0:1790740374.108893:0:8459:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98db84461880. 00000100:00100000:3.0:1790740374.184292:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740374.184486:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001014144 00000100:00100000:1.0:1790740374.184498:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001014144 00000100:00100000:1.0:1790740374.184688:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 209 00000100:00100000:1.0:1790740374.184699:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8453c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+35:12406:x1877727001014144:12345-192.168.204.3@tcp:34:lfs.0 00010000:00010000:1.0:1790740374.184799:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e8f5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.184834:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e8f5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.184846:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e8f5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.184878:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e8fc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.184887:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e8fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.184894:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e8fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.184978:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e903 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.184989:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e903 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.184996:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e903 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790740374.185092:0:6537:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e903 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.185105:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e8f5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.185112:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e8f5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.185142:0:6537:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e8f5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.185149:0:6537:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc45800 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740374.185153:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e8f5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.185160:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e8f5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.185172:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98dc887e4800) 00010000:00010000:1.0:1790740374.185175:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740374.185180:0:6537:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e8f5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.185186:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92e8f5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.185200:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e8fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.185206:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e8fc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.185211:0:6537:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e8fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.185216:0:6537:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc45c00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740374.185219:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e8fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.185235:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e8fc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.185243:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98dc985beb00) 00010000:00010000:1.0:1790740374.185246:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740374.185248:0:6537:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e8fc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.185254:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e8fc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.185269:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e903 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.185276:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e903 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.185282:0:6537:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e903 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.185287:0:6537:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc44400 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740374.185290:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e903 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.185297:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e903 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.185304:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc985bee00) 00010000:00010000:1.0:1790740374.185307:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740374.185310:0:6537:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e903 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.185326:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e903 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740374.186192:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8453c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+35:12406:x1877727001014144:12345-192.168.204.3@tcp:34:lfs.0 Request processed in 1490us (2055us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740374.186203:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 209 00000100:00100000:0.0:1790740374.240824:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740374.241351:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001014400 00000100:00100000:3.0:1790740374.241372:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001014400 00000100:00100000:3.0:1790740374.241441:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 210 00000100:00100000:3.0:1790740374.241462:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db846b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+35:12409:x1877727001014400:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:3.0:1790740374.241487:0:13222:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740374.241509:0:13222:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e90a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23f47 expref: -99 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.241587:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e911 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.241602:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e911 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.241614:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e911 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.241628:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e918 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.241636:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e918 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.241658:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e918 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.241775:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e91f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.241802:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e91f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.241811:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e91f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740374.241823:0:13222:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1790740374.241919:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e911 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.241928:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e911 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.241935:0:13222:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e911 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.241942:0:13222:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc9400 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740374.241947:0:13222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e911 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.241954:0:13222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e911 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.241979:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98dc887e4800) 00010000:00010000:3.0:1790740374.241982:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740374.241994:0:13222:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e911 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.242002:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e911 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.242021:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e918 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.242028:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e918 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.242091:0:13222:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e918 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.242097:0:13222:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc9c00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740374.242100:0:13222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e918 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.242107:0:13222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e918 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.242116:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98dcaf04c300) 00010000:00010000:3.0:1790740374.242119:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740374.242122:0:13222:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e918 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.242128:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e918 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.242171:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e90a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f47 expref: 38 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.242200:0:13222:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e91f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f47 expref: 37 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.242208:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc985bee00) 00010000:00010000:3.0:1790740374.242210:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1790740374.242213:0:13222:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc8200, rc 0) 00000100:00100000:3.0:1790740374.242556:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db846b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+37:12409:x1877727001014400:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 1094us (1739us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1790740374.242564:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 210 00000100:00100000:0.0:1790740374.249579:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740374.249686:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001014528 00000100:00100000:1.0:1790740374.249697:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001014528 00000100:00100000:1.0:1790740374.249817:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 211 00000100:00100000:1.0:1790740374.249829:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db846b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+37:12409:x1877727001014528:12345-192.168.204.3@tcp:54:lfs.0 00010000:00010000:1.0:1790740374.250222:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e92d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.250240:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e8c4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f2b expref: 37 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.250251:0:6536:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e92d lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.250295:0:6536:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e8c4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f2b expref: 37 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.250311:0:6536:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e8c4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f2b expref: 37 pid: 6536 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740374.250325:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db8468c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6536:1877727022043904:192.168.204.3@tcp:104: 00000100:00100000:1.0:1790740374.250437:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb62b0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790740374.257213:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740374.257377:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db8468c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6536:1877727022043904:192.168.204.3@tcp:104: 00010000:00010000:1.0:1790740374.257406:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e92d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740374.257524:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001014784 00000100:00100000:3.0:1790740374.257532:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001014784 00000100:00100000:3.0:1790740374.257586:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 52 00000100:00100000:3.0:1790740374.257595:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db846b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+38:10783:x1877727001014784:12345-192.168.204.3@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1790740374.258252:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db846b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+39:10783:x1877727001014784:12345-192.168.204.3@tcp:35:ldlm_bl.0 Request processed in 656us (1048us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1790740374.258261:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 52 00000100:00100000:0.0:1790740374.261762:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740374.262195:0:6520:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001014912 00000100:00100000:3.0:1790740374.262206:0:6520:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001014912 00010000:00010000:3.0:1790740374.262251:0:6520:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e8c4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f2b expref: 39 pid: 6536 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740374.262296:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 93 00000100:00100000:3.0:1790740374.262306:0:6520:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db846b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7bed19f2-4c98-4684-89e7-a6871565665d+39:2402:x1877727001014912:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790740374.262328:0:6520:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740374.262356:0:6520:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e8c4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f2b expref: 39 pid: 6536 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.262434:0:6520:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e8c4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f2b expref: 39 pid: 6536 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.262468:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e8c4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f2b expref: 39 pid: 6536 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.262485:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc985bee00) 00010000:00010000:3.0:1790740374.262491:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e92d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.262501:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e92d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.262509:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e92d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.262588:0:6520:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740374.262647:0:6520:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db846b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7bed19f2-4c98-4684-89e7-a6871565665d+38:2402:x1877727001014912:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 342us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740374.262655:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 93 00010000:00010000:1.0:1790740374.264577:0:6536:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e92d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.264593:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e92d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.264639:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e92d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.264647:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e92d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.264654:0:6536:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e92d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.264660:0:6536:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc44400 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740374.264665:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e92d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.264673:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e92d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.264689:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc985bee00) 00010000:00010000:1.0:1790740374.264692:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790740374.264697:0:6536:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e92d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.264703:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92e92d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740374.265208:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db846b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+37:12409:x1877727001014528:12345-192.168.204.3@tcp:54:lfs.0 Request processed in 15376us (15633us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740374.265219:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 211 00000100:00100000:0.0:1790740374.268729:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740374.269193:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001015168 00000100:00100000:1.0:1790740374.269204:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001015168 00000100:00100000:1.0:1790740374.269300:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 53 00000100:00100000:1.0:1790740374.269314:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db846b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+37:12409:x1877727001015168:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:1.0:1790740374.269618:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db846b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+38:12409:x1877727001015168:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 307us (898us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1790740374.269627:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 53 00000100:00100000:1.0:1790740374.375636:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740374.375751:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001015424 00000100:00100000:2.0:1790740374.375761:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001015424 00000100:00100000:2.0:1790740374.375843:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 212 00000100:00100000:2.0:1790740374.375853:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+38:12420:x1877727001015424:12345-192.168.204.3@tcp:101:cat.0 00010000:00010000:2.0:1790740374.375883:0:6537:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740374.375906:0:6537:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92e934 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23f4e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740374.376000:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92e93b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740374.376016:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92e93b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740374.376027:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92e93b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740374.376082:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92e942 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740374.376090:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92e942 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740374.376097:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92e942 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740374.376214:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92e949 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740374.376223:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92e949 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740374.376230:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92e949 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740374.376240:0:6537:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:2.0:1790740374.376316:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92e93b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740374.376324:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92e93b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740374.376337:0:6537:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92e93b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740374.376343:0:6537:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f32400 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740374.376348:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92e93b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740374.376356:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92e93b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740374.376368:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98dc887e4800) 00010000:00010000:2.0:1790740374.376371:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740374.376377:0:6537:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92e93b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740374.376382:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92e93b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740374.376398:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92e942 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740374.376404:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92e942 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740374.376410:0:6537:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92e942 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740374.376415:0:6537:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f33000 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740374.376418:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92e942 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740374.376435:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92e942 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740374.376453:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98dcaf045400) 00010000:00010000:2.0:1790740374.376456:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740374.376459:0:6537:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92e942 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740374.376465:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92e942 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740374.376508:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92e934 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f4e expref: 41 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740374.376520:0:6537:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92e949 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f4e expref: 40 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740374.376527:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc985bee00) 00010000:00010000:2.0:1790740374.376529:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790740374.376532:0:6537:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f33600, rc 0) 00000100:00100000:2.0:1790740374.376607:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+40:12420:x1877727001015424:12345-192.168.204.3@tcp:101:cat.0 Request processed in 755us (980us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1790740374.376616:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 212 00000100:00100000:0.0:1790740374.389583:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740374.389646:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001015680 00000100:00100000:3.0:1790740374.389657:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001015680 00000100:00100000:3.0:1790740374.389715:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 54 00000100:00100000:3.0:1790740374.389723:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db846b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+40:12420:x1877727001015680:12345-192.168.204.3@tcp:35:cat.0 00000100:00100000:3.0:1790740374.390263:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db846b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+41:12420:x1877727001015680:12345-192.168.204.3@tcp:35:cat.0 Request processed in 539us (689us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1790740374.390291:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 54 00000100:00100000:3.0:1790740374.424495:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740374.424675:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001015936 00000100:00100000:0.0:1790740374.424686:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001015936 00000100:00100000:0.0:1790740374.424757:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 213 00000100:00100000:0.0:1790740374.424766:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8453f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+41:12421:x1877727001015936:12345-192.168.204.3@tcp:36:rm.0 00010000:00010000:0.0:1790740374.424831:0:13222:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1790740374.424857:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44000/0xb25dda4f4e92e8e7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f39 expref: 41 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740374.425016:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92e949 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f4e expref: 40 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740374.425086:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e91f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f47 expref: 39 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740374.425106:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45600/0xb25dda4f4e92e8d9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f32 expref: 38 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740374.425117:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc985bee00) 00010000:00010000:0.0:1790740374.425122:0:13222:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790740374.425147:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3a00/0xb25dda4f4e92e957 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740374.425162:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3a00/0xb25dda4f4e92e957 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740374.425171:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3a00/0xb25dda4f4e92e957 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740374.425207:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3600/0xb25dda4f4e92e95e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740374.425215:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3600/0xb25dda4f4e92e95e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740374.425222:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3600/0xb25dda4f4e92e95e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740374.425306:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2c00/0xb25dda4f4e92e965 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740374.425315:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2c00/0xb25dda4f4e92e965 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740374.425323:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2c00/0xb25dda4f4e92e965 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790740374.429870:0:13222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:1.0:1790740374.429886:0:13222:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 445715853416ns, next at 446715850815ns, rc = 0 00010000:00010000:1.0:1790740374.429958:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e96c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.429977:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e96c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.429989:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e96c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.429998:0:13222:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e96c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.430004:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e96c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.430028:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e96c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.430068:0:13222:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790740374.430092:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2c00/0xb25dda4f4e92e965 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.430098:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2c00/0xb25dda4f4e92e965 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.430104:0:13222:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2c00/0xb25dda4f4e92e965 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.430110:0:13222:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee2c00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740374.430115:0:13222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2c00/0xb25dda4f4e92e965 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.430123:0:13222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2c00/0xb25dda4f4e92e965 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.430136:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc985bee00) 00010000:00010000:1.0:1790740374.430140:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1790740374.430144:0:13222:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2c00/0xb25dda4f4e92e965 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.430150:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2c00/0xb25dda4f4e92e965 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.430152:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740374.430158:0:6523:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e96c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.430163:0:6523:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc45c00 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:3.0:1790740374.430166:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e96c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.430170:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3a00/0xb25dda4f4e92e957 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.430173:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e96c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.430176:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3a00/0xb25dda4f4e92e957 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.430182:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc985bee00) 00010000:00010000:3.0:1790740374.430185:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790740374.430188:0:6523:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e96c lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.430189:0:13222:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3a00/0xb25dda4f4e92e957 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.430194:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92e96c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.430194:0:13222:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee3a00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740374.430197:0:13222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3a00/0xb25dda4f4e92e957 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.430202:0:13222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3a00/0xb25dda4f4e92e957 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.430205:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740374.430207:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740374.430208:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740374.430210:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98dc887e4800) 00010000:00010000:1.0:1790740374.430212:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740374.430214:0:13222:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3a00/0xb25dda4f4e92e957 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.430220:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3a00/0xb25dda4f4e92e957 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790740374.430230:0:13222:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007c20194f reply state 000000003a85f3a9 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3600/0xb25dda4f4e92e95e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.430241:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3600/0xb25dda4f4e92e95e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.430248:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98dc887e4700) 00010000:00010000:1.0:1790740374.430250:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790740374.430253:0:13222:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790740374.430359:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8453f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+39:12421:x1877727001015936:12345-192.168.204.3@tcp:36:rm.0 Request processed in 5589us (5872us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1790740374.430369:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 213 00000100:00100000:1.0:1790740374.520814:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740374.520964:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001016192 00000100:00100000:3.0:1790740374.520976:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001016192 00000100:00100000:3.0:1790740374.521088:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 214 00000100:00100000:3.0:1790740374.521098:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+39:12427:x1877727001016192:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:3.0:1790740374.521128:0:6536:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740374.521175:0:6536:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e973 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23f55 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.521318:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e97a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.521338:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e97a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.521352:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e97a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.521363:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e981 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.521370:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e981 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.521375:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e981 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790740374.521761:0:6536:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:3.0:1790740374.521951:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e988 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.521962:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e988 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.521969:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e988 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.522001:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e97a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.522021:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e97a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.522054:0:6536:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e97a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.522062:0:6536:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc9800 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740374.522067:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e97a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.522076:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e97a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.522088:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98dc887e4800) 00010000:00010000:3.0:1790740374.522092:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740374.522098:0:6536:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e97a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.522103:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e97a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790740374.522119:0:6536:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002cfe1e5e reply state 00000000a5e61c13 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e981 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.522130:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e981 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.522135:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98dc887e4700) 00010000:00010000:3.0:1790740374.522138:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790740374.522140:0:6536:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790740374.522174:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e973 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f55 expref: 42 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.522197:0:6536:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e988 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f55 expref: 41 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.522204:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98dcaf04c300) 00010000:00010000:3.0:1790740374.522207:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790740374.522209:0:6536:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc9400, rc 0) 00000100:00100000:3.0:1790740374.522309:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+42:12427:x1877727001016192:12345-192.168.204.3@tcp:101:bash.0 Request processed in 1212us (1504us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1790740374.522316:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 214 00000100:00100000:3.0:1790740374.529715:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740374.529833:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001016320 00000100:00100000:1.0:1790740374.529843:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001016320 00000100:00100000:1.0:1790740374.530121:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 67 00000100:00100000:1.0:1790740374.530133:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bed19f2-4c98-4684-89e7-a6871565665d+7:2403:x1877727001016320:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:1.0:1790740374.530154:0:8451:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740374.530177:0:8451:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ea21cfa/0xb25dda4f4e92e996 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23f5c expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790740374.530206:0:8451:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790740374.530230:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=445s v=(0 0) 00010000:00010000:1.0:1790740374.530235:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790740374.530245:0:8451:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ea21cfa/0xb25dda4f4e92e996 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f5c expref: 8 pid: 8451 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.530264:0:8451:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004ea21cfa/0xb25dda4f4e92e996 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f5c expref: 8 pid: 8451 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.530279:0:8451:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcbfc45800, rc 0) 00000100:00100000:1.0:1790740374.530349:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bed19f2-4c98-4684-89e7-a6871565665d+8:2403:x1877727001016320:12345-192.168.204.3@tcp:101:bash.0 Request processed in 219us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740374.530357:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 67 00000100:00080000:2.0:1790740374.531757:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790740374.534255:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740374.534352:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001016448 00000100:00100000:3.0:1790740374.534362:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001016448 00000100:00100000:3.0:1790740374.534429:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 68 00000100:00100000:3.0:1790740374.534450:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db846b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7bed19f2-4c98-4684-89e7-a6871565665d+8:12427:x1877727001016448:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:3.0:1790740374.534471:0:9806:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740374.534495:0:9806:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3e8613a/0xb25dda4f4e92e99d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23f63 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.534536:0:9806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004ea21cfa/0xb25dda4f4e92e996 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f5c expref: 9 pid: 8451 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.534546:0:9806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790740374.534550:0:9806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790740374.534557:0:9806:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3e8613a/0xb25dda4f4e92e99d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f63 expref: 9 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.534619:0:9806:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004ea21cfa/0xb25dda4f4e92e996 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f5c expref: 9 pid: 8451 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.534634:0:9806:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004ea21cfa/0xb25dda4f4e92e996 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f5c expref: 9 pid: 8451 timeout: 545 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740374.534650:0:9806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84650e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9806:1877727022044032:192.168.204.3@tcp:104: 00000100:00100000:3.0:1790740374.534775:0:9806:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82c98300 going to sleep for 11 seconds 00000100:00100000:0.0:1790740374.538142:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740374.538241:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001016576 00000100:00100000:1.0:1790740374.538252:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001016576 00010000:00010000:1.0:1790740374.538295:0:6521:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004ea21cfa/0xb25dda4f4e92e996 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f5c expref: 10 pid: 8451 timeout: 545 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740374.538361:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 94 00000100:00100000:1.0:1790740374.538371:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82f99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7bed19f2-4c98-4684-89e7-a6871565665d+10:2403:x1877727001016576:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740374.538386:0:6521:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740374.538407:0:6521:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004ea21cfa/0xb25dda4f4e92e996 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f5c expref: 10 pid: 8451 timeout: 545 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.538421:0:6521:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004ea21cfa/0xb25dda4f4e92e996 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f5c expref: 10 pid: 8451 timeout: 545 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.538456:0:6521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790740374.538462:0:6521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790740374.538471:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b3e8613a/0xb25dda4f4e92e99d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f63 expref: 10 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.538483:0:6521:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3e8613a/0xb25dda4f4e92e99d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f63 expref: 10 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.538525:0:6521:0:(ldlm_lockd.c:1085:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b3e8613a/0xb25dda4f4e92e99d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f63 expref: 10 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740374.538540:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db8468f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6521:1877727022044160:192.168.204.3@tcp:105: 00000100:00100000:1.0:1790740374.538636:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb62b03c0 going to sleep for 11 seconds 00010000:00010000:3.0:1790740374.539242:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ea21cfa/0xb25dda4f4e92e996 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f5c expref: 10 pid: 8451 timeout: 545 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740374.539262:0:9806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84650e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9806:1877727022044032:192.168.204.3@tcp:104: 00010000:00010000:3.0:1790740374.539290:0:9806:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b3e8613a/0xb25dda4f4e92e99d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f63 expref: 9 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.539303:0:9806:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc8a00, rc 0) 00000100:00100000:3.0:1790740374.539350:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db846b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7bed19f2-4c98-4684-89e7-a6871565665d+9:12427:x1877727001016448:12345-192.168.204.3@tcp:101:bash.0 Request processed in 4912us (5110us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740374.539359:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 68 00000100:00100000:1.0:1790740374.545951:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db8468f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6521:1877727022044160:192.168.204.3@tcp:105: 00010000:00010000:1.0:1790740374.546009:0:6521:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740374.546175:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82f99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7bed19f2-4c98-4684-89e7-a6871565665d+8:2403:x1877727001016576:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 7802us (8041us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740374.546192:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 94 00000100:00100000:2.0:1790740374.549186:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740374.550329:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001016832 00000100:00100000:1.0:1790740374.550346:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001016832 00000100:00100000:1.0:1790740374.550552:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 55 00000100:00100000:1.0:1790740374.550564:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+42:12427:x1877727001016832:12345-192.168.204.3@tcp:35:bash.0 00000100:00100000:1.0:1790740374.551114:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+43:12427:x1877727001016832:12345-192.168.204.3@tcp:35:bash.0 Request processed in 551us (1937us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1790740374.551124:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 55 00000100:00100000:0.0:1790740374.884333:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740374.885340:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001016960 00000100:00100000:3.0:1790740374.885363:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001016960 00000100:00100000:3.0:1790740374.885448:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 215 00000100:00100000:3.0:1790740374.885459:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84532a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+43:12443:x1877727001016960:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:3.0:1790740374.885501:0:6535:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740374.885536:0:6535:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e9a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23f6a expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.885613:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e9ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.885629:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e9ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.885642:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e9ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740374.885691:0:6535:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1790740374.885695:0:6535:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790740374.885714:0:6535:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e9ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.885740:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e9a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f6a expref: 45 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.885761:0:6535:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e9ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f6a expref: 44 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.885771:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98dc887e4800) 00010000:00010000:3.0:1790740374.885786:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790740374.885791:0:6535:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc8200, rc 0) 00000100:00100000:3.0:1790740374.886291:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84532a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+44:12443:x1877727001016960:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 831us (1967us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740374.886299:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 215 00000100:00100000:0.0:1790740374.892289:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740374.896619:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001017216 00000100:00100000:1.0:1790740374.896634:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001017216 00000100:00100000:1.0:1790740374.896972:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 216 00000100:00100000:1.0:1790740374.896985:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+44:12443:x1877727001017216:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:1.0:1790740374.897007:0:13222:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740374.897049:0:13222:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92e9b2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23f71 expref: -99 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.898487:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e9b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.898512:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e9b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.898596:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e9b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740374.898638:0:13222:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1790740374.898801:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92e9b2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f71 expref: 47 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.898826:0:13222:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e9b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f71 expref: 46 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.898836:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98dcaf04c300) 00010000:00010000:1.0:1790740374.898839:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790740374.898843:0:13222:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcbfc44c00, rc 0) 00000100:00100000:1.0:1790740374.899745:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+46:12443:x1877727001017216:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 2758us (7462us total) trans 4294967486 rc 0/0 00000100:00100000:1.0:1790740374.899756:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 216 00000100:00100000:0.0:1790740374.921580:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740374.921638:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740374.921741:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001017472 00000100:00100000:3.0:1790740374.921752:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001017472 00000100:00100000:3.0:1790740374.921821:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 217 00000100:00100000:3.0:1790740374.921831:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84532680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+46:12443:x1877727001017472:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:3.0:1790740374.921878:0:6536:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740374.921906:0:6536:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e9c7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23f78 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.922021:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e9ce lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.922078:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e9ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.922091:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e9ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740374.922103:0:6536:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1790740374.922226:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e9c7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f78 expref: 49 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.922249:0:6536:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e9ce lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f78 expref: 48 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.922259:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98dcaf04c300) 00010000:00010000:3.0:1790740374.922263:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1790740374.922267:0:6536:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc9e00, rc 0) 00000100:00100000:3.0:1790740374.922323:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84532680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+48:12443:x1877727001017472:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 493us (753us total) trans 4294967487 rc 0/0 00000100:00100000:3.0:1790740374.922347:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 217 00000100:00100000:1.0:1790740374.922625:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001017600 00000100:00100000:1.0:1790740374.922632:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001017600 00000100:00100000:1.0:1790740374.922677:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 16 00000100:00100000:1.0:1790740374.922685:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc9a489c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7bed19f2-4c98-4684-89e7-a6871565665d+48:2404:x1877727001017600:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740374.922710:0:6522:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740374.922725:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92e9b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f71 expref: 48 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740374.922738:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98dcaf04c300) 00010000:00010000:1.0:1790740374.922742:0:6522:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740374.922764:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc9a489c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7bed19f2-4c98-4684-89e7-a6871565665d+47:2404:x1877727001017600:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 81us (1125us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740374.922771:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 16 00000100:00100000:0.0:1790740374.935467:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740374.935574:0:14497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001017728 00000100:00100000:2.0:1790740374.935584:0:14497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001017728 00000100:00100000:2.0:1790740374.935652:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 69 00000100:00100000:2.0:1790740374.935670:0:14497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84533100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7bed19f2-4c98-4684-89e7-a6871565665d+8:2402:x1877727001017728:12345-192.168.204.3@tcp:1:lfs.0 00010000:00010000:2.0:1790740374.935722:0:14497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ea25463/0xb25dda4f4e92e9dc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740374.935746:0:14497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b3e8613a/0xb25dda4f4e92e99d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f63 expref: 8 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740374.935755:0:14497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1790740374.935761:0:14497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790740374.935766:0:14497:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ea25463/0xb25dda4f4e92e9dc lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740374.935819:0:14497:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b3e8613a/0xb25dda4f4e92e99d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f63 expref: 8 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740374.935835:0:14497:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b3e8613a/0xb25dda4f4e92e99d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f63 expref: 8 pid: 9806 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740374.935850:0:14497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5df0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14497:1877727022044288:192.168.204.3@tcp:104: 00000100:00100000:2.0:1790740374.936884:0:14497:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83d05900 going to sleep for 11 seconds 00000100:00100000:0.0:1790740374.952731:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740374.953260:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001017856 00000100:00100000:3.0:1790740374.953270:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001017856 00002000:00100000:3.0:1790740374.953326:0:8457:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff98db84533800 x1877727001017856/t0(0) o4->7bed19f2-4c98-4684-89e7-a6871565665d@192.168.204.3@tcp:430/0 lens 504/0 e 0 to 0 dl 1790740385 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790740374.953336:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98db84533800 with x1877727001017856 ext(0->8) 00010000:00010000:3.0:1790740374.953346:0:8457:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b3e8613a/0xb25dda4f4e92e99d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f63 expref: 9 pid: 9806 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.953374:0:8457:0:(ldlm_lockd.c:610:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b3e8613a/0xb25dda4f4e92e99d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f63 expref: 9 pid: 9806 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790740374.953383:0:8457:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98db84533800 00000100:00100000:3.0:1790740374.953419:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 3 00000100:00100000:3.0:1790740374.953429:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84533800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7bed19f2-4c98-4684-89e7-a6871565665d+9:2403:x1877727001017856:12345-192.168.204.3@tcp:4:lfs.0 00000100:00100000:2.0:1790740374.954633:0:14497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5df0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14497:1877727022044288:192.168.204.3@tcp:104: 00010000:00010000:2.0:1790740374.954662:0:14497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009ea25463/0xb25dda4f4e92e9dc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740374.955099:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84533800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7bed19f2-4c98-4684-89e7-a6871565665d+11:2403:x1877727001017856:12345-192.168.204.3@tcp:4:lfs.0 Request processed in 1669us (2376us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1790740374.955125:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 3 00002000:00100000:2.0:1790740374.955138:0:8457:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff98db84533800 x1877727001017856/t4294967309(0) o4->7bed19f2-4c98-4684-89e7-a6871565665d@192.168.204.3@tcp:430/0 lens 504/448 e 0 to 0 dl 1790740385 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790740374.955148:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98db84533800 with x1877727001017856 ext(0->8) 00010000:00010000:2.0:1790740374.955156:0:8457:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b3e8613a/0xb25dda4f4e92e99d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f63 expref: 11 pid: 9806 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740374.955171:0:8457:0:(ldlm_lockd.c:610:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b3e8613a/0xb25dda4f4e92e99d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f63 expref: 11 pid: 9806 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790740374.955178:0:8457:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98db84533800 00000100:00100000:0.0:1790740374.961727:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740374.962071:0:6520:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001017984 00000100:00100000:3.0:1790740374.962082:0:6520:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001017984 00010000:00010000:3.0:1790740374.962125:0:6520:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b3e8613a/0xb25dda4f4e92e99d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f63 expref: 11 pid: 9806 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740374.962160:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 95 00000100:00100000:3.0:1790740374.962171:0:6520:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84533b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7bed19f2-4c98-4684-89e7-a6871565665d+11:2402:x1877727001017984:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790740374.962188:0:6520:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1790740374.962206:0:6520:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1790740374.962210:0:6520:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1790740374 00002000:00010000:3.0:1790740374.962225:0:6520:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1790740375 00002000:00010000:3.0:1790740374.962227:0:6520:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1790740374 00002000:00010000:3.0:1790740374.962229:0:6520:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1790740374.962239:0:6520:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b3e8613a/0xb25dda4f4e92e99d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f63 expref: 11 pid: 9806 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.962254:0:6520:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b3e8613a/0xb25dda4f4e92e99d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f63 expref: 11 pid: 9806 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.962283:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3e8613a/0xb25dda4f4e92e99d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f63 expref: 11 pid: 9806 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.962303:0:6520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790740374.962308:0:6520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790740374.962314:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009ea25463/0xb25dda4f4e92e9dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.962325:0:6520:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ea25463/0xb25dda4f4e92e9dc lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.962377:0:6520:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740374.962451:0:6520:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84533b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7bed19f2-4c98-4684-89e7-a6871565665d+10:2402:x1877727001017984:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 281us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740374.962458:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 95 00010000:00010000:2.0:1790740374.963133:0:14497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009ea25463/0xb25dda4f4e92e9dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740374.963145:0:14497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ea25463/0xb25dda4f4e92e9dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740374.963167:0:14497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ea25463/0xb25dda4f4e92e9dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740374.963175:0:14497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ea25463/0xb25dda4f4e92e9dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740374.963182:0:14497:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ea25463/0xb25dda4f4e92e9dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740374.963221:0:14497:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f32400 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:2.0:1790740374.963225:0:14497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ea25463/0xb25dda4f4e92e9dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740374.963233:0:14497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ea25463/0xb25dda4f4e92e9dc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740374.963248:0:14497:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ea25463/0xb25dda4f4e92e9dc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740374.963255:0:14497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ea25463/0xb25dda4f4e92e9dc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740374.963324:0:14497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84533100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7bed19f2-4c98-4684-89e7-a6871565665d+9:2402:x1877727001017728:12345-192.168.204.3@tcp:1:lfs.0 Request processed in 27655us (27867us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740374.963332:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 69 00000100:00100000:0.0:1790740374.966517:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740374.966714:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001018240 00000100:00100000:3.0:1790740374.966725:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001018240 00000100:00100000:3.0:1790740374.966800:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 56 00000100:00100000:3.0:1790740374.966810:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc9925f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+47:12443:x1877727001018240:12345-192.168.204.3@tcp:35:lfs.0 00000004:00010000:3.0:1790740374.966917:0:6539:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e9ce lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f78 expref: 47 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790740374.967411:0:6539:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:3.0:1790740374.967460:0:6539:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1790740374.971993:0:6539:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:3.0:1790740374.972118:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e9e3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.972141:0:6539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e988 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f55 expref: 51 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.972151:0:6539:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e9e3 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.972199:0:6539:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e988 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f55 expref: 51 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.972216:0:6539:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e988 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f55 expref: 51 pid: 6536 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740374.972230:0:6539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84650e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6539:1877727022044416:192.168.204.3@tcp:104: 00000100:00100000:3.0:1790740374.972328:0:6539:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82c98300 going to sleep for 11 seconds 00000100:00100000:1.0:1790740374.976908:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740374.977130:0:6539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84650e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6539:1877727022044416:192.168.204.3@tcp:104: 00010000:00010000:3.0:1790740374.977159:0:6539:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e9e3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740374.977290:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001018368 00000100:00100000:2.0:1790740374.977298:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001018368 00010000:00010000:2.0:1790740374.977336:0:6521:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e988 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f55 expref: 52 pid: 6536 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740374.977383:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 96 00000100:00100000:2.0:1790740374.977393:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7bed19f2-4c98-4684-89e7-a6871565665d+52:2403:x1877727001018368:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790740374.977407:0:6521:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740374.977414:0:6521:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e988 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f55 expref: 52 pid: 6536 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740374.977452:0:6521:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e988 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f55 expref: 52 pid: 6536 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740374.977475:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92e988 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f55 expref: 52 pid: 6536 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740374.977493:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98dcaf04c300) 00010000:00010000:2.0:1790740374.977497:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e9e3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740374.977506:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e9e3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740374.977513:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e9e3 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740374.977542:0:6521:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740374.977598:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7bed19f2-4c98-4684-89e7-a6871565665d+51:2403:x1877727001018368:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 206us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740374.977605:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 96 00010000:00010000:3.0:1790740374.977714:0:6539:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e9e3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.977728:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e9e3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790740374.977844:0:6539:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:3.0:1790740374.977978:0:6539:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:3.0:1790740374.978101:0:6539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84650e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6539:1877727022044544:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1790740374.978146:0:6539:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740374.978172:0:6539:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82c986c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790740374.979072:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022044544 00000100:00100000:0.0:1790740374.979083:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022044544 00000100:00100000:0.0:1790740374.979161:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1790740374.979169:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84652d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6539:x1877727022044544:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790740374.979277:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84652d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6539:x1877727022044544:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 109us (1130us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740374.979286:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00080000:3.0:1790740374.979964:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790740374.980004:0:6539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84650e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6539:1877727022044544:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1790740374.980184:0:6539:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:3.0:1790740374.980255:0:6539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84650e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6539:1877727022044672:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1790740374.980301:0:6539:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740374.980327:0:6539:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82c98cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740374.980461:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022044672 00000100:00100000:2.0:1790740374.980467:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022044672 00000100:00100000:2.0:1790740374.980500:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1790740374.980508:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84651880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6539:x1877727022044672:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1790740374.980633:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84651880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6539:x1877727022044672:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 126us (331us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1790740374.980640:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1790740374.981014:0:6539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84650e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6539:1877727022044672:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1790740374.981091:0:6539:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:3.0:1790740374.981122:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e9e3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.981132:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e9e3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.981140:0:6539:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e9e3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.981147:0:6539:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc9800 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740374.981151:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e9e3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.981165:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e9e3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.981182:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98dcaf04c300) 00010000:00010000:3.0:1790740374.981185:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1790740374.981189:0:6539:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e9e3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.981195:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92e9e3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790740374.981281:0:6539:0:(mdd_object.c:4180:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1790740374.981335:0:6539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1790740374.981539:0:6539:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 446267506465ns, next at 447267311091ns, rc = 0 00000001:00080000:2.0:1790740374.981549:0:6539:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:2.0:1790740374.981576:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98dcaf04c300) 00010000:00010000:2.0:1790740374.981579:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790740374.981587:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92e9ce lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f78 expref: 55 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740374.981689:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc9925f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+54:12443:x1877727001018240:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 14880us (15181us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1790740374.981697:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 56 00000020:00080000:2.0:1790740374.981701:0:6539:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1790740374.984328:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740374.984518:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001018496 00000100:00100000:3.0:1790740374.984528:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001018496 00000100:00100000:3.0:1790740374.984589:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 218 00000100:00100000:3.0:1790740374.984600:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+54:12443:x1877727001018496:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:3.0:1790740374.984625:0:6535:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740374.984647:0:6535:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e9ea lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23f7f expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.984705:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e9ea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f7f expref: 55 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.984721:0:6535:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e9ea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f7f expref: 55 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740374.984740:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98dcaf04c000) 00010000:00010000:3.0:1790740374.984756:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790740374.984760:0:6535:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc8a00, rc 0) 00000100:00100000:3.0:1790740374.984838:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+55:12443:x1877727001018496:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 239us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740374.984844:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 218 00000100:00100000:0.0:1790740374.989768:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740374.989886:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001018752 00000100:00100000:1.0:1790740374.989904:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001018752 00000100:00100000:1.0:1790740374.989963:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 57 00000100:00100000:1.0:1790740374.989974:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+55:12443:x1877727001018752:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:1.0:1790740374.990250:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+56:12443:x1877727001018752:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 278us (494us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1790740374.990258:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 57 00010000:00010000:2.0:1790740375.020735:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740375.103563:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740375.103751:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001018880 00000100:00100000:1.0:1790740375.103760:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001018880 00000100:00100000:1.0:1790740375.103832:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 219 00000100:00100000:1.0:1790740375.103842:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+56:12453:x1877727001018880:12345-192.168.204.3@tcp:34:lfs.0 00010000:00010000:1.0:1790740375.104183:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92e9f1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.104202:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92e9f1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.104214:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92e9f1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.104225:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92e9f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.104232:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92e9f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.104238:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92e9f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.104330:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e9ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.104339:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e9ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.104360:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e9ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790740375.104410:0:13222:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e9ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.104423:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92e9f1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.104450:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92e9f1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.104458:0:13222:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92e9f1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.104464:0:13222:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc44800 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740375.104468:0:13222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92e9f1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.104476:0:13222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92e9f1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.104487:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98dc887e4800) 00010000:00010000:1.0:1790740375.104490:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740375.104495:0:13222:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92e9f1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.104508:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92e9f1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.104521:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92e9f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.104528:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92e9f8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.104533:0:13222:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92e9f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.104537:0:13222:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc45a00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740375.104540:0:13222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92e9f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.104545:0:13222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92e9f8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.104552:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98dc887e4700) 00010000:00010000:1.0:1790740375.104555:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740375.104557:0:13222:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92e9f8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.104562:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92e9f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.104572:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e9ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.104577:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e9ff lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.104589:0:13222:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e9ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.104593:0:13222:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc45200 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740375.104596:0:13222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e9ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.104602:0:13222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e9ff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.104610:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98dcaf04c000) 00010000:00010000:1.0:1790740375.104612:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740375.104614:0:13222:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e9ff lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.104619:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92e9ff lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740375.105131:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+56:12453:x1877727001018880:12345-192.168.204.3@tcp:34:lfs.0 Request processed in 1286us (1575us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740375.105141:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 219 00000100:00100000:2.0:1790740375.146273:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790740375.146295:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84650a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022044800:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790740375.146377:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740375.152555:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022044800 00000100:00100000:0.0:1790740375.152573:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022044800 00000100:00100000:0.0:1790740375.152636:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1790740375.152647:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc82f1c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022044800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790740375.152690:0:6541:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1790740375.152790:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc82f1c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022044800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 145us (6413us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740375.152798:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1790740375.153293:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84650a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022044800:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790740375.164139:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740375.164318:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001019136 00000100:00100000:2.0:1790740375.164329:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001019136 00000100:00100000:2.0:1790740375.164424:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 220 00000100:00100000:2.0:1790740375.164457:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84531500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+56:12456:x1877727001019136:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:2.0:1790740375.164479:0:7760:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740375.164502:0:7760:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92ea06 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23f86 expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.164581:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32a00/0xb25dda4f4e92ea0d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.164595:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32a00/0xb25dda4f4e92ea0d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.164626:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32a00/0xb25dda4f4e92ea0d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.164637:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92ea14 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.164644:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92ea14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.164651:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92ea14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.164756:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92ea1b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.164765:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92ea1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.164959:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92ea1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740375.164971:0:7760:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1790740375.165109:0:7760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32a00/0xb25dda4f4e92ea0d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.165117:0:7760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32a00/0xb25dda4f4e92ea0d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.165124:0:7760:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32a00/0xb25dda4f4e92ea0d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.165130:0:7760:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f32a00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740375.165143:0:7760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32a00/0xb25dda4f4e92ea0d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.165151:0:7760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32a00/0xb25dda4f4e92ea0d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.165164:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98dc887e4800) 00010000:00010000:2.0:1790740375.165167:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740375.165173:0:7760:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32a00/0xb25dda4f4e92ea0d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.165178:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32a00/0xb25dda4f4e92ea0d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.165190:0:7760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92ea14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.165195:0:7760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92ea14 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.165200:0:7760:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92ea14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.165204:0:7760:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f32c00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740375.165207:0:7760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92ea14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.165212:0:7760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92ea14 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.165219:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98dc887e4700) 00010000:00010000:2.0:1790740375.165221:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740375.165229:0:7760:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92ea14 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.165235:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92ea14 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.165272:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92ea06 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f86 expref: 59 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.165285:0:7760:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92ea1b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f86 expref: 58 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.165292:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98dcaf04c000) 00010000:00010000:2.0:1790740375.165294:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790740375.165296:0:7760:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f32000, rc 0) 00000100:00100000:2.0:1790740375.165365:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84531500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+58:12456:x1877727001019136:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 923us (1235us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1790740375.165373:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 220 00000100:00100000:0.0:1790740375.171796:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740375.175964:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001019264 00000100:00100000:2.0:1790740375.175984:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001019264 00000100:00100000:2.0:1790740375.176083:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 221 00000100:00100000:2.0:1790740375.176095:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+58:12456:x1877727001019264:12345-192.168.204.3@tcp:54:lfs.0 00010000:00010000:2.0:1790740375.176167:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92ea29 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.176186:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92ea29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.176200:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92ea29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.176263:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92ea29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.176271:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92ea29 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.176278:0:6537:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92ea29 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.176285:0:6537:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f32400 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740375.176289:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92ea29 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.176297:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92ea29 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.176309:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98dcaf04c000) 00010000:00010000:2.0:1790740375.176312:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790740375.176318:0:6537:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92ea29 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.176325:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92ea29 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740375.176410:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+58:12456:x1877727001019264:12345-192.168.204.3@tcp:54:lfs.0 Request processed in 317us (4638us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740375.176418:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 221 00000100:00100000:1.0:1790740375.188120:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740375.188202:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001019520 00000100:00100000:0.0:1790740375.188212:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001019520 00000100:00100000:0.0:1790740375.188302:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 58 00000100:00100000:0.0:1790740375.188312:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+58:12456:x1877727001019520:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:0.0:1790740375.188598:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+59:12456:x1877727001019520:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 287us (488us total) trans 4294967499 rc 0/0 00000100:00100000:0.0:1790740375.188605:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 58 00000100:00100000:0.0:1790740375.276639:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740375.278374:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001019776 00000100:00100000:1.0:1790740375.278389:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001019776 00000100:00100000:1.0:1790740375.278476:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 222 00000100:00100000:1.0:1790740375.278487:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+59:12466:x1877727001019776:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:1.0:1790740375.278514:0:13222:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740375.278517:0:13222:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1790740375.278547:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92e9ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f6a expref: 59 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.278586:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98dc887e4800) 00010000:00010000:1.0:1790740375.278592:0:13222:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790740375.278614:0:13222:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92ea30 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23f8d expref: -99 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.278736:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92ea37 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.278751:0:13222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92ea1b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f86 expref: 59 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.278759:0:13222:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92ea37 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.278810:0:13222:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92ea1b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f86 expref: 59 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.278825:0:13222:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92ea1b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f86 expref: 59 pid: 7760 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740375.278839:0:13222:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db8468e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13222:1877727022044928:192.168.204.3@tcp:104: 00000100:00100000:1.0:1790740375.278950:0:13222:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb62b0180 going to sleep for 11 seconds 00000100:00100000:3.0:1790740375.281834:0:13222:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db8468e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13222:1877727022044928:192.168.204.3@tcp:104: 00010000:00010000:3.0:1790740375.281920:0:13222:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92ea37 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740375.287828:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740375.288342:0:10416:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001019904 00000100:00100000:2.0:1790740375.288352:0:10416:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001019904 00010000:00010000:2.0:1790740375.288400:0:10416:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92ea1b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f86 expref: 60 pid: 7760 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740375.288466:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 97 00000100:00100000:2.0:1790740375.288477:0:10416:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84532d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7bed19f2-4c98-4684-89e7-a6871565665d+60:2402:x1877727001019904:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790740375.288493:0:10416:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740375.288501:0:10416:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92ea1b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f86 expref: 60 pid: 7760 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.288515:0:10416:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92ea1b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f86 expref: 60 pid: 7760 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.288538:0:10416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92ea1b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f86 expref: 60 pid: 7760 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.288554:0:10416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98dcaf04c000) 00010000:00010000:2.0:1790740375.288560:0:10416:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92ea37 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.288570:0:10416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92ea37 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.288578:0:10416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92ea37 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.288677:0:10416:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740375.288756:0:10416:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84532d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7bed19f2-4c98-4684-89e7-a6871565665d+59:2402:x1877727001019904:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 281us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740375.288764:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 97 00010000:00010000:1.0:1790740375.289590:0:13222:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92ea37 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.289602:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92ea37 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740375.289741:0:13222:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1790740375.289895:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92ea30 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f8d expref: 60 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.289916:0:13222:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92ea37 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f8d expref: 59 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.289924:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98dcaf04c000) 00010000:00010000:1.0:1790740375.289926:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790740375.289929:0:13222:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcbfc44800, rc 0) 00000100:00100000:1.0:1790740375.289972:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+59:12466:x1877727001019776:12345-192.168.204.3@tcp:101:bash.0 Request processed in 11487us (13342us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1790740375.289980:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 222 00000100:00100000:1.0:1790740375.296559:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740375.296618:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001020032 00000100:00100000:2.0:1790740375.296692:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001020032 00000100:00100000:2.0:1790740375.296769:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 223 00000100:00100000:2.0:1790740375.296780:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+59:12466:x1877727001020032:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:2.0:1790740375.296807:0:7760:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740375.296843:0:7760:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92ea45 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23f94 expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.297006:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32a00/0xb25dda4f4e92ea4c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.297021:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32a00/0xb25dda4f4e92ea4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.297273:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32a00/0xb25dda4f4e92ea4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.297449:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92ea45 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f94 expref: 61 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.297470:0:7760:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32a00/0xb25dda4f4e92ea4c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f94 expref: 60 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.297478:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98dcaf04c000) 00010000:00010000:2.0:1790740375.297481:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790740375.297484:0:7760:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f32a00, rc 0) 00000100:00100000:2.0:1790740375.297595:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+60:12466:x1877727001020032:12345-192.168.204.3@tcp:101:bash.0 Request processed in 816us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740375.297603:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 223 00000100:00100000:0.0:1790740375.304617:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740375.304726:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001020288 00000100:00100000:3.0:1790740375.304737:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001020288 00000100:00100000:3.0:1790740375.304831:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 224 00000100:00100000:3.0:1790740375.304843:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+60:12466:x1877727001020288:12345-192.168.204.3@tcp:36:bash.0 00010000:00010000:3.0:1790740375.305145:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92ea53 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.305163:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92ea53 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.305175:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92ea53 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790740375.305220:0:6536:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:3.0:1790740375.305244:0:6536:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ef762585 reply state 0000000000a9b859 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92ea53 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.305256:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92ea53 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.305288:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98dcaf04c000) 00010000:00010000:3.0:1790740375.305291:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790740375.305295:0:6536:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790740375.305476:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+63:12466:x1877727001020288:12345-192.168.204.3@tcp:36:bash.0 Request processed in 635us (871us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1790740375.305485:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 224 00000020:00080000:3.0:1790740375.305491:0:6536:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1790740375.309740:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740375.310000:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001020416 00000100:00100000:1.0:1790740375.310011:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001020416 00000100:00100000:1.0:1790740375.310090:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 225 00000100:00100000:1.0:1790740375.310099:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcad23c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+63:12466:x1877727001020416:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:1.0:1790740375.310123:0:13222:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740375.310144:0:13222:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44e00/0xb25dda4f4e92ea5a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23f9b expref: -99 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.310239:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92ea61 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.310254:0:13222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92ea37 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f8d expref: 64 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.310296:0:13222:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92ea61 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.310332:0:13222:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92ea37 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f8d expref: 64 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.310345:0:13222:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92ea37 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f8d expref: 64 pid: 13222 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740375.310373:0:13222:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db8468f100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13222:1877727022045056:192.168.204.3@tcp:104: 00000100:00100000:1.0:1790740375.310470:0:13222:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb62b03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790740375.313889:0:13222:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db8468f100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13222:1877727022045056:192.168.204.3@tcp:104: 00010000:00010000:3.0:1790740375.313922:0:13222:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92ea61 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740375.315763:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740375.315856:0:9550:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001020544 00000100:00100000:3.0:1790740375.315866:0:9550:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001020544 00010000:00010000:3.0:1790740375.315910:0:9550:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92ea37 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f8d expref: 65 pid: 13222 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740375.315954:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 98 00000100:00100000:3.0:1790740375.315965:0:9550:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84530a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7bed19f2-4c98-4684-89e7-a6871565665d+65:2403:x1877727001020544:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790740375.315979:0:9550:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740375.315986:0:9550:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92ea37 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f8d expref: 65 pid: 13222 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.315998:0:9550:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92ea37 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f8d expref: 65 pid: 13222 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.316021:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92ea37 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f8d expref: 65 pid: 13222 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.316089:0:9550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98dcaf04c000) 00010000:00010000:3.0:1790740375.316094:0:9550:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92ea61 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.316105:0:9550:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92ea61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.316113:0:9550:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92ea61 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.316146:0:9550:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740375.316196:0:9550:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84530a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7bed19f2-4c98-4684-89e7-a6871565665d+64:2403:x1877727001020544:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 233us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740375.316204:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 98 00010000:00010000:1.0:1790740375.316543:0:13222:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92ea61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.316552:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92ea61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740375.316605:0:13222:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1790740375.316609:0:13222:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790740375.316629:0:13222:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92ea61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.316661:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44e00/0xb25dda4f4e92ea5a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f9b expref: 64 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.316675:0:13222:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92ea61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f9b expref: 63 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.316696:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98dcaf04c000) 00010000:00010000:1.0:1790740375.316698:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790740375.316701:0:13222:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcbfc45a00, rc 0) 00000100:00100000:1.0:1790740375.316727:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcad23c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+63:12466:x1877727001020416:12345-192.168.204.3@tcp:101:bash.0 Request processed in 6630us (6997us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740375.316733:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 225 00000100:00100000:1.0:1790740375.324864:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740375.325126:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001020800 00000100:00100000:2.0:1790740375.325149:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001020800 00000100:00100000:2.0:1790740375.325224:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 59 00000100:00100000:2.0:1790740375.325235:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+63:12466:x1877727001020800:12345-192.168.204.3@tcp:35:bash.0 00000100:00100000:2.0:1790740375.325502:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+64:12466:x1877727001020800:12345-192.168.204.3@tcp:35:bash.0 Request processed in 268us (660us total) trans 4294967503 rc 0/0 00000100:00100000:2.0:1790740375.325511:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 59 00000100:00100000:0.0:1790740375.413367:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740375.413489:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001020928 00000100:00100000:2.0:1790740375.413500:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001020928 00000100:00100000:2.0:1790740375.413560:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 226 00000100:00100000:2.0:1790740375.413570:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+64:12472:x1877727001020928:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:2.0:1790740375.413599:0:7760:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740375.413633:0:7760:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92ea68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23fa2 expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.413710:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92ea6f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.413831:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92ea6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.413846:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92ea6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740375.413894:0:7760:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1790740375.413897:0:7760:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790740375.413916:0:7760:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92ea6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.413941:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92ea68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fa2 expref: 66 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.413980:0:7760:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92ea6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fa2 expref: 65 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.413989:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98dc887e4800) 00010000:00010000:2.0:1790740375.413992:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790740375.413996:0:7760:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f32000, rc 0) 00000100:00100000:2.0:1790740375.414288:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+65:12472:x1877727001020928:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 718us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740375.414296:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 226 00000100:00100000:3.0:1790740375.429362:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740375.429479:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001021056 00000100:00100000:1.0:1790740375.429490:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001021056 00000100:00100000:1.0:1790740375.429551:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 227 00000100:00100000:1.0:1790740375.429560:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84650a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+65:12472:x1877727001021056:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:1.0:1790740375.429581:0:6536:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740375.429603:0:6536:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44e00/0xb25dda4f4e92ea76 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23fa9 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.429680:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92ea7d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.429694:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92ea7d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.429705:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92ea7d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.429715:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92ea84 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.429735:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92ea84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.429756:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92ea84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.429825:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92ea8b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.429833:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92ea8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.429840:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92ea8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740375.430006:0:6536:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1790740375.430011:0:6536:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790740375.430060:0:6536:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92ea8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.430073:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92ea8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.430080:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92ea7d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.430086:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92ea7d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.430093:0:6536:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92ea7d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.430098:0:6536:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc45200 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740375.430102:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92ea7d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.430118:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92ea7d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.430130:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98dc887e4800) 00010000:00010000:1.0:1790740375.430133:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740375.430138:0:6536:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92ea7d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.430144:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92ea7d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.430160:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92ea84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.430166:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92ea84 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.430172:0:6536:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92ea84 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.430176:0:6536:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc44c00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740375.430179:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92ea84 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.430185:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92ea84 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.430192:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98dc887e4700) 00010000:00010000:1.0:1790740375.430194:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740375.430197:0:6536:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92ea84 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.430213:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92ea84 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.430244:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44e00/0xb25dda4f4e92ea76 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fa9 expref: 67 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.430255:0:6536:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92ea8b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fa9 expref: 66 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.430262:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98dcaf04c000) 00010000:00010000:1.0:1790740375.430265:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790740375.430267:0:6536:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcbfc45800, rc 0) 00000100:00100000:1.0:1790740375.430481:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84650a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+66:12472:x1877727001021056:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 920us (1137us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740375.430489:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 227 00000100:00100000:2.0:1790740375.440143:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740375.440248:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001021184 00000100:00100000:1.0:1790740375.440258:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001021184 00000100:00100000:1.0:1790740375.440324:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 17 00000100:00100000:1.0:1790740375.440334:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7bed19f2-4c98-4684-89e7-a6871565665d+66:2405:x1877727001021184:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740375.440356:0:6522:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740375.440381:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92ea8b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fa9 expref: 66 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.440403:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98dcaf04c000) 00010000:00010000:1.0:1790740375.440408:0:6522:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740375.440473:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7bed19f2-4c98-4684-89e7-a6871565665d+65:2405:x1877727001021184:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 141us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740375.440495:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 17 00000100:00100000:3.0:1790740375.440736:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740375.442807:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001021440 00000100:00100000:1.0:1790740375.442822:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001021440 00000100:00100000:1.0:1790740375.442895:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 228 00000100:00100000:1.0:1790740375.442905:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84650700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+65:12472:x1877727001021440:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:1.0:1790740375.442926:0:13222:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740375.442946:0:13222:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44e00/0xb25dda4f4e92ea92 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23fb0 expref: -99 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.443072:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92ea99 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.443087:0:13222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92ea61 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f9b expref: 66 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.443097:0:13222:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92ea99 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.443130:0:13222:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92ea61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f9b expref: 66 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.443143:0:13222:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92ea61 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f9b expref: 66 pid: 13222 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740375.443157:0:13222:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db8468ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13222:1877727022045184:192.168.204.3@tcp:104: 00000100:00100000:1.0:1790740375.443263:0:13222:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb62b0480 going to sleep for 11 seconds 00000100:00100000:0.0:1790740375.447701:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740375.447844:0:6520:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001021568 00000100:00100000:3.0:1790740375.447865:0:6520:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001021568 00010000:00010000:3.0:1790740375.447909:0:6520:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92ea61 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f9b expref: 67 pid: 13222 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740375.447956:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 99 00000100:00100000:3.0:1790740375.447965:0:6520:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84530000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7bed19f2-4c98-4684-89e7-a6871565665d+67:2402:x1877727001021568:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790740375.447980:0:6520:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740375.447987:0:6520:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92ea61 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f9b expref: 67 pid: 13222 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.448023:0:6520:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92ea61 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f9b expref: 67 pid: 13222 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.448079:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98dcaf04c000) 00010000:00010000:3.0:1790740375.448085:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92ea99 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.448095:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92ea99 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.448103:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92ea99 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.448123:0:6520:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740375.448174:0:6520:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84530000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7bed19f2-4c98-4684-89e7-a6871565665d+67:2402:x1877727001021568:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 210us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740375.448182:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 99 00010000:00010000:1.0:1790740375.449327:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92ea61 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f9b expref: 66 pid: 13222 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740375.449361:0:13222:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db8468ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13222:1877727022045184:192.168.204.3@tcp:104: 00010000:00010000:1.0:1790740375.449388:0:13222:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92ea99 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.449398:0:13222:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92ea99 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.449405:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92ea99 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740375.449438:0:13222:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1790740375.449584:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44e00/0xb25dda4f4e92ea92 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fb0 expref: 67 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.449598:0:13222:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92ea99 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fb0 expref: 66 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.449606:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98dcaf04c000) 00010000:00010000:1.0:1790740375.449608:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790740375.449610:0:13222:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcbfc44c00, rc 0) 00000100:00100000:1.0:1790740375.449678:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84650700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+66:12472:x1877727001021440:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 6774us (8942us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1790740375.449689:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 228 00000100:00100000:0.0:1790740375.455411:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740375.455671:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001021824 00000100:00100000:2.0:1790740375.455747:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001021824 00000100:00100000:2.0:1790740375.455819:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 18 00000100:00100000:2.0:1790740375.455830:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc9a488850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7bed19f2-4c98-4684-89e7-a6871565665d+66:12472:x1877727001021824:12345-192.168.204.3@tcp:103:lfs.0 00010000:00010000:2.0:1790740375.455846:0:6521:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740375.455943:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92e9ea lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f7f expref: 66 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.455964:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98dcaf04c000) 00010000:00010000:2.0:1790740375.455969:0:6521:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740375.456117:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc9a488850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7bed19f2-4c98-4684-89e7-a6871565665d+65:12472:x1877727001021824:12345-192.168.204.3@tcp:103:lfs.0 Request processed in 288us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740375.456124:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 18 00000100:00100000:3.0:1790740375.461001:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740375.461343:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001021952 00000100:00100000:0.0:1790740375.461354:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001021952 00000100:00100000:0.0:1790740375.461419:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 229 00000100:00100000:0.0:1790740375.461440:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84650000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+65:12472:x1877727001021952:12345-192.168.204.3@tcp:58:lfs.0 00010000:00010000:0.0:1790740375.461549:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2800/0xb25dda4f4e92eaa7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740375.461998:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2800/0xb25dda4f4e92eaa7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740375.462011:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2800/0xb25dda4f4e92eaa7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790740375.462143:0:6535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1790740375.462298:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84650000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+65:12472:x1877727001021952:12345-192.168.204.3@tcp:58:lfs.0 Request processed in 858us (1303us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740375.462306:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 229 00000040:00080000:0.0:1790740375.466552:0:13821:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790740375.466574:0:13821:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790740375.466600:0:13821:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1790740375.466609:0:13821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790740375.467001:0:13821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84533480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13821:1877727022045312:192.168.204.3@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790740375.467112:0:13821:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82c75840 going to sleep for 11 seconds 00000100:00100000:2.0:1790740375.468015:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740375.468713:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001022080 00000100:00100000:1.0:1790740375.468723:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001022080 00000100:00100000:1.0:1790740375.468778:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 230 00000100:00100000:1.0:1790740375.468788:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+66:12472:x1877727001022080:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:1.0:1790740375.468827:0:6537:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740375.468861:0:6537:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44e00/0xb25dda4f4e92eaae lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23fb7 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.468912:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2800/0xb25dda4f4e92eaa7 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.468924:0:6537:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44e00/0xb25dda4f4e92eaae lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fb7 expref: 67 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.468944:0:6537:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2800/0xb25dda4f4e92eaa7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.468957:0:6537:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44e00/0xb25dda4f4e92eaae lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fb7 expref: 67 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.468971:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98dcaf04c000) 00010000:00010000:1.0:1790740375.468974:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790740375.468978:0:6537:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44e00/0xb25dda4f4e92eaae lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fb7 expref: 67 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.468985:0:6537:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcbfc44e00, rc 0) 00000100:00100000:1.0:1790740375.469054:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+67:12472:x1877727001022080:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 243us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740375.469062:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 230 00000100:00100000:0.0:1790740375.474511:0:13821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84533480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13821:1877727022045312:192.168.204.3@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790740375.475299:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740375.475567:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001022208 00000100:00100000:1.0:1790740375.475576:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001022208 00000100:00100000:1.0:1790740375.475650:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 231 00000100:00100000:1.0:1790740375.475661:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+66:12473:x1877727001022208:12345-192.168.204.3@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790740375.475711:0:13222:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790740375.475944:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+66:12473:x1877727001022208:12345-192.168.204.3@tcp:53:lhsmtool_posix.0 Request processed in 284us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740375.475954:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 231 00000100:00100000:2.0:1790740375.481585:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740375.482069:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001022336 00000100:00100000:0.0:1790740375.482079:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001022336 00000100:00100000:0.0:1790740375.482146:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 232 00000100:00100000:0.0:1790740375.482155:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+66:12473:x1877727001022336:12345-192.168.204.3@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1790740375.482235:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92eab5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740375.482254:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92eab5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740375.482266:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92eab5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740375.482282:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2000/0xb25dda4f4e92eabc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740375.482289:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2000/0xb25dda4f4e92eabc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740375.482295:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2000/0xb25dda4f4e92eabc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740375.482317:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2200/0xb25dda4f4e92eac3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740375.482327:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2200/0xb25dda4f4e92eac3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740375.482334:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2200/0xb25dda4f4e92eac3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790740375.482384:0:6535:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1790740375.482400:0:6535:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790740375.482415:0:6535:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2200/0xb25dda4f4e92eac3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740375.482440:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92eab5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740375.482447:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92eab5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740375.482455:0:6535:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92eab5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740375.482460:0:6535:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee2400 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:0.0:1790740375.482465:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92eab5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740375.482472:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92eab5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740375.482484:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98db82949800) 00010000:00010000:0.0:1790740375.482486:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740375.482491:0:6535:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92eab5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740375.482497:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2400/0xb25dda4f4e92eab5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740375.482516:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2000/0xb25dda4f4e92eabc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740375.482522:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2000/0xb25dda4f4e92eabc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740375.482538:0:6535:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2000/0xb25dda4f4e92eabc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740375.482544:0:6535:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee2000 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:0.0:1790740375.482547:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2000/0xb25dda4f4e92eabc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740375.482553:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2000/0xb25dda4f4e92eabc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740375.483286:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff98dc887e4600) 00010000:00010000:0.0:1790740375.483290:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740375.483294:0:6535:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2000/0xb25dda4f4e92eabc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740375.483301:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2000/0xb25dda4f4e92eabc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740375.483319:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2200/0xb25dda4f4e92eac3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740375.483326:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2200/0xb25dda4f4e92eac3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740375.483332:0:6535:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2200/0xb25dda4f4e92eac3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740375.483339:0:6535:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee2200 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:0.0:1790740375.483342:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2200/0xb25dda4f4e92eac3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740375.483361:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2200/0xb25dda4f4e92eac3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740375.483369:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98dcaf04c000) 00010000:00010000:0.0:1790740375.483372:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740375.483375:0:6535:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2200/0xb25dda4f4e92eac3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740375.483381:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2200/0xb25dda4f4e92eac3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740375.483492:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+66:12473:x1877727001022336:12345-192.168.204.3@tcp:34:lhsmtool_posix.0 Request processed in 1335us (1916us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740375.483502:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 232 00000100:00100000:0.0:1790740375.489840:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740375.489963:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001022592 00000100:00100000:2.0:1790740375.489973:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001022592 00000100:00100000:2.0:1790740375.490139:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 233 00000100:00100000:2.0:1790740375.490150:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+66:12473:x1877727001022592:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790740375.490171:0:7760:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740375.490193:0:7760:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92eaca lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23fbe expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.490302:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92ead1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.490318:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92ead1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.490329:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92ead1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740375.490340:0:7760:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1790740375.490445:0:7760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92ead1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.490453:0:7760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92ead1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.490460:0:7760:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92ead1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.490467:0:7760:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f33e00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740375.490471:0:7760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92ead1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.490511:0:7760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92ead1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.490524:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98dcaf04c000) 00010000:00010000:2.0:1790740375.490536:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790740375.490543:0:7760:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92ead1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.490549:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92ead1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.490592:0:7760:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92eaca lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fbe expref: 68 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.490603:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98db82949800) 00010000:00010000:2.0:1790740375.490605:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790740375.490609:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33600/0xb25dda4f4e92eaca lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fbe expref: 68 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.490618:0:7760:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f33600, rc 0) 00000100:00100000:2.0:1790740375.490712:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+67:12473:x1877727001022592:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 564us (883us total) trans 4294967505 rc 301/301 00000100:00100000:2.0:1790740375.490719:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 233 00000100:00100000:3.0:1790740375.497179:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740375.497314:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001022720 00000100:00100000:2.0:1790740375.497325:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001022720 00000100:00100000:2.0:1790740375.497401:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 234 00000100:00100000:2.0:1790740375.497412:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84653480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+67:12473:x1877727001022720:12345-192.168.204.3@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790740375.497489:0:6536:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790740375.497609:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84653480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+67:12473:x1877727001022720:12345-192.168.204.3@tcp:53:lhsmtool_posix.0 Request processed in 197us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740375.497617:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 234 00000100:00100000:3.0:1790740375.500896:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740375.501209:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001022976 00000100:00100000:1.0:1790740375.501223:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001022976 00000100:00100000:1.0:1790740375.501293:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 235 00000100:00100000:1.0:1790740375.501305:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84651c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+67:12473:x1877727001022976:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790740375.501328:0:6535:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740375.501332:0:6535:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1790740375.501375:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32000/0xb25dda4f4e92ea6f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fa2 expref: 67 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.501402:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98dc887e4800) 00010000:00010000:1.0:1790740375.501408:0:6535:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790740375.501434:0:6535:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92eadf lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23fc5 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790740375.501800:0:6535:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:1.0:1790740375.501933:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92eae6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.501948:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92eae6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.501958:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92eae6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.502025:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92eadf lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fc5 expref: 69 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.502077:0:6535:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92eae6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fc5 expref: 68 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.502085:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98dc985be800) 00010000:00010000:1.0:1790740375.502088:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790740375.502091:0:6535:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcbfc45800, rc 0) 00000100:00100000:1.0:1790740375.502156:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84651c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+68:12473:x1877727001022976:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 854us (1272us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1790740375.502164:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 235 00000100:00100000:0.0:1790740375.506401:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740375.506502:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001023232 00000100:00100000:2.0:1790740375.506514:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001023232 00000100:00100000:2.0:1790740375.506582:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 236 00000100:00100000:2.0:1790740375.506593:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+68:12473:x1877727001023232:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790740375.506668:0:7760:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740375.506699:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92eae6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fc5 expref: 68 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.506732:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98dc985be800) 00010000:00010000:2.0:1790740375.506746:0:7760:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790740375.506770:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92eaf4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.506786:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92eaf4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.506796:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92eaf4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.506813:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92eafb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x32434dea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.506822:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92eafb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x32434dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.506868:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92eafb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x32434dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.506923:0:7760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92eaf4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.506931:0:7760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92eaf4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.506938:0:7760:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92eaf4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.506945:0:7760:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f32400 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740375.506949:0:7760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92eaf4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.506956:0:7760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92eaf4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.506965:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98dc887e4800) 00010000:00010000:2.0:1790740375.506968:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740375.506972:0:7760:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92eaf4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.506978:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32400/0xb25dda4f4e92eaf4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.506988:0:7760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92eafb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x32434dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.506993:0:7760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92eafb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x32434dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.507005:0:7760:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92eafb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x32434dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.507009:0:7760:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f32c00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740375.507012:0:7760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92eafb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x32434dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.507017:0:7760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92eafb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x32434dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.507025:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x32434dea (ffff98dcaf045400) 00010000:00010000:2.0:1790740375.507028:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740375.507068:0:7760:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92eafb lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x32434dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.507075:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92eafb lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x32434dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740375.507312:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+67:12473:x1877727001023232:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 Request processed in 720us (923us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790740375.507320:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 236 00000100:00100000:3.0:1790740375.510692:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740375.510777:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001023360 00000100:00100000:1.0:1790740375.510805:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001023360 00000100:00100000:1.0:1790740375.510902:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 237 00000100:00100000:1.0:1790740375.510914:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84652a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+67:12473:x1877727001023360:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790740375.510945:0:6537:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740375.510971:0:6537:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92eb02 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23fcc expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.511018:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92eb09 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.511052:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92eb09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.511065:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92eb09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.511205:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92eb02 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fcc expref: 69 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.511227:0:6537:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92eb09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fcc expref: 68 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.511235:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98dc985be700) 00010000:00010000:1.0:1790740375.511238:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790740375.511241:0:6537:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcbfc45c00, rc 0) 00000100:00100000:1.0:1790740375.511302:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84652a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+68:12473:x1877727001023360:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 392us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740375.511309:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 237 00000100:00100000:2.0:1790740375.516717:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740375.517484:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001023616 00000100:00100000:3.0:1790740375.517497:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001023616 00000100:00100000:3.0:1790740375.517596:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 238 00000100:00100000:3.0:1790740375.517607:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+68:12473:x1877727001023616:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790740375.517705:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92eb10 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.517760:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92eb10 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.517773:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92eb10 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790740375.517967:0:13222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:3.0:1790740375.517977:0:13222:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 446803945183ns, next at 447803942709ns, rc = 0 00000004:00010000:3.0:1790740375.518081:0:13222:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a282aacf reply state 0000000047fd2338 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92eb10 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.518095:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92eb10 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.518103:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98dc985be700) 00010000:00010000:3.0:1790740375.518106:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1790740375.518109:0:13222:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790740375.518215:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+70:12473:x1877727001023616:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 Request processed in 609us (1509us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1790740375.518224:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 238 00000100:00100000:0.0:1790740375.522016:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740375.525236:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001023744 00000100:00100000:2.0:1790740375.525258:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001023744 00000100:00100000:2.0:1790740375.525395:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 239 00000100:00100000:2.0:1790740375.525407:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84533b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+70:12473:x1877727001023744:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790740375.525446:0:7760:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740375.525469:0:7760:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92eb17 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23fd3 expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.525546:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92eb17 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fd3 expref: 71 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.525562:0:7760:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92eb17 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fd3 expref: 71 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.525581:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98dc985be700) 00010000:00010000:2.0:1790740375.525584:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790740375.525588:0:7760:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f32c00, rc 0) 00000100:00100000:2.0:1790740375.525676:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84533b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+71:12473:x1877727001023744:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 272us (3672us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740375.525684:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 239 00000100:00100000:3.0:1790740375.528807:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740375.528934:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001023872 00000100:00100000:1.0:1790740375.528945:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001023872 00000100:00100000:1.0:1790740375.529014:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 70 00000100:00100000:1.0:1790740375.529023:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84652300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bed19f2-4c98-4684-89e7-a6871565665d+9:2405:x1877727001023872:12345-192.168.204.3@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1790740375.529275:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84652300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bed19f2-4c98-4684-89e7-a6871565665d+10:2405:x1877727001023872:12345-192.168.204.3@tcp:2:lhsmtool_posix.0 Request processed in 252us (477us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1790740375.529283:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 70 00000100:00080000:1.0:1790740375.529308:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790740375.532190:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740375.532692:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001024128 00000100:00100000:2.0:1790740375.532701:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001024128 00000100:00100000:2.0:1790740375.532767:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 60 00000100:00100000:2.0:1790740375.532776:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84652680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+71:12473:x1877727001024128:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790740375.533062:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84652680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+72:12473:x1877727001024128:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 Request processed in 285us (887us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1790740375.533069:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 60 00000100:00100000:0.0:1790740375.536862:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740375.536964:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001024384 00000100:00100000:1.0:1790740375.536974:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001024384 00000100:00100000:1.0:1790740375.537074:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 240 00000100:00100000:1.0:1790740375.537084:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+72:12473:x1877727001024384:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790740375.537199:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+72:12473:x1877727001024384:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 Request processed in 116us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740375.537223:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 240 00000100:00100000:3.0:1790740375.546314:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740375.546578:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001024512 00000100:00100000:1.0:1790740375.546589:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001024512 00000100:00100000:1.0:1790740375.546655:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 241 00000100:00100000:1.0:1790740375.546667:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84653100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+72:12473:x1877727001024512:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790740375.546690:0:13222:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740375.546712:0:13222:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92eb1e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23fda expref: -99 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.546804:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92eb25 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.546821:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92eb25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.546833:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92eb25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740375.546892:0:13222:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790740375.546912:0:13222:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92eb25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.546942:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92eb1e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fda expref: 74 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.546961:0:13222:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92eb25 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fda expref: 73 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.546971:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98dc985be700) 00010000:00010000:1.0:1790740375.546985:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1790740375.546989:0:13222:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcbfc45a00, rc 0) 00000100:00100000:1.0:1790740375.547121:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84653100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+73:12473:x1877727001024512:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 456us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740375.547128:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 241 00000100:00100000:3.0:1790740375.551620:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740375.551964:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001024640 00000100:00100000:0.0:1790740375.551979:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001024640 00000100:00100000:0.0:1790740375.552081:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 71 00000100:00100000:0.0:1790740375.552093:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84653800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7bed19f2-4c98-4684-89e7-a6871565665d+10:2402:x1877727001024640:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790740375.552117:0:9806:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740375.552147:0:9806:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007168e057/0xb25dda4f4e92eb2c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23fe1 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790740375.552185:0:9806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abc8797, blocks: 0x0 00010000:00010000:0.0:1790740375.552215:0:9806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=446s v=(0 0) 00010000:00010000:0.0:1790740375.552240:0:9806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740375.552251:0:9806:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007168e057/0xb25dda4f4e92eb2c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fe1 expref: 11 pid: 9806 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740375.552271:0:9806:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007168e057/0xb25dda4f4e92eb2c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fe1 expref: 11 pid: 9806 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740375.552288:0:9806:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaeee3e00, rc 0) 00000100:00100000:0.0:1790740375.552355:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84653800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7bed19f2-4c98-4684-89e7-a6871565665d+11:2402:x1877727001024640:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 263us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740375.552363:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 71 00000100:00100000:3.0:1790740375.555710:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740375.555808:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001024896 00000100:00100000:2.0:1790740375.555819:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001024896 00000100:00100000:2.0:1790740375.555895:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 242 00000100:00100000:2.0:1790740375.555906:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84653b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+73:12473:x1877727001024896:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790740375.556023:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84653b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+73:12473:x1877727001024896:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 Request processed in 119us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740375.556076:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 242 00000100:00100000:3.0:1790740375.559777:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740375.559877:0:14497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001025024 00000100:00100000:2.0:1790740375.559890:0:14497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001025024 00000100:00100000:2.0:1790740375.559965:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 72 00000100:00100000:2.0:1790740375.559976:0:14497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84650380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7bed19f2-4c98-4684-89e7-a6871565665d+11:12473:x1877727001025024:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790740375.559999:0:14497:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740375.560022:0:14497:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ea25463/0xb25dda4f4e92eb33 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23fe8 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.560089:0:14497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007168e057/0xb25dda4f4e92eb2c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fe1 expref: 12 pid: 9806 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.560099:0:14497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740375.560104:0:14497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740375.560111:0:14497:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ea25463/0xb25dda4f4e92eb33 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fe8 expref: 12 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.560148:0:14497:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007168e057/0xb25dda4f4e92eb2c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fe1 expref: 12 pid: 9806 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.560163:0:14497:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007168e057/0xb25dda4f4e92eb2c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fe1 expref: 12 pid: 9806 timeout: 546 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740375.560180:0:14497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5df2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14497:1877727022045440:192.168.204.3@tcp:104: 00000100:00100000:2.0:1790740375.560297:0:14497:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83d056c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790740375.568237:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740375.568362:0:10416:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001025152 00000100:00100000:0.0:1790740375.568372:0:10416:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001025152 00010000:00010000:0.0:1790740375.568413:0:10416:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007168e057/0xb25dda4f4e92eb2c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fe1 expref: 13 pid: 9806 timeout: 546 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740375.568469:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 100 00000100:00100000:0.0:1790740375.568480:0:10416:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84651180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7bed19f2-4c98-4684-89e7-a6871565665d+13:2403:x1877727001025152:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790740375.568498:0:10416:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740375.568522:0:10416:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007168e057/0xb25dda4f4e92eb2c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fe1 expref: 13 pid: 9806 timeout: 546 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740375.568536:0:10416:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007168e057/0xb25dda4f4e92eb2c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fe1 expref: 13 pid: 9806 timeout: 546 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740375.568564:0:10416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740375.568585:0:10416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740375.568594:0:10416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009ea25463/0xb25dda4f4e92eb33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fe8 expref: 13 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740375.568604:0:10416:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ea25463/0xb25dda4f4e92eb33 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fe8 expref: 13 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740375.568644:0:10416:0:(ldlm_lockd.c:1085:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009ea25463/0xb25dda4f4e92eb33 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fe8 expref: 13 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740375.568659:0:10416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84530a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10416:1877727022045568:192.168.204.3@tcp:105: 00000100:00100000:0.0:1790740375.568751:0:10416:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82c75840 going to sleep for 11 seconds 00010000:00010000:2.0:1790740375.570635:0:14497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007168e057/0xb25dda4f4e92eb2c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fe1 expref: 13 pid: 9806 timeout: 546 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740375.570660:0:14497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5df2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14497:1877727022045440:192.168.204.3@tcp:104: 00010000:00010000:2.0:1790740375.570698:0:14497:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009ea25463/0xb25dda4f4e92eb33 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fe8 expref: 12 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.570712:0:14497:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f32400, rc 0) 00000100:00100000:2.0:1790740375.570809:0:14497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84650380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7bed19f2-4c98-4684-89e7-a6871565665d+12:12473:x1877727001025024:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 10835us (11042us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740375.570817:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 72 00000100:00100000:1.0:1790740375.571697:0:10416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84530a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10416:1877727022045568:192.168.204.3@tcp:105: 00010000:00010000:1.0:1790740375.571713:0:10416:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740375.571758:0:10416:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84651180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7bed19f2-4c98-4684-89e7-a6871565665d+11:2403:x1877727001025152:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 3280us (3533us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740375.571768:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 100 00000100:00100000:0.0:1790740375.577496:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740375.577936:0:8459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001025280 00000100:00100000:3.0:1790740375.577947:0:8459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001025280 00002000:00100000:3.0:1790740375.578017:0:8459:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff98db84530000 x1877727001025280/t0(0) o4->7bed19f2-4c98-4684-89e7-a6871565665d@192.168.204.3@tcp:431/0 lens 504/0 e 0 to 0 dl 1790740386 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790740375.578059:0:8459:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98db84530000 with x1877727001025280 ext(0->12) 00002000:00010000:3.0:1790740375.578067:0:8459:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98db84530000 00000100:00100000:3.0:1790740375.578101:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 6 00000100:00100000:3.0:1790740375.578112:0:8459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84530000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7bed19f2-4c98-4684-89e7-a6871565665d+11:2402:x1877727001025280:12345-192.168.204.3@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1790740375.580257:0:8459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84530000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7bed19f2-4c98-4684-89e7-a6871565665d+13:2402:x1877727001025280:12345-192.168.204.3@tcp:4:lhsmtool_posix.0 Request processed in 2134us (2759us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1790740375.580272:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 6 00002000:00100000:3.0:1790740375.580284:0:8459:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff98db84530000 x1877727001025280/t4294967321(0) o4->7bed19f2-4c98-4684-89e7-a6871565665d@192.168.204.3@tcp:431/0 lens 504/448 e 0 to 0 dl 1790740386 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790740375.580294:0:8459:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98db84530000 with x1877727001025280 ext(0->12) 00002000:00010000:3.0:1790740375.580300:0:8459:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98db84530000 00000100:00100000:2.0:1790740375.589001:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740375.589135:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001025408 00000100:00100000:1.0:1790740375.589147:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001025408 00000100:00100000:1.0:1790740375.589218:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 243 00000100:00100000:1.0:1790740375.589229:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+73:12473:x1877727001025408:12345-192.168.204.3@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1790740375.591536:0:6514:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:0.0:1790740375.591555:0:6514:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:0.0:1790740375.591594:0:6514:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1790740375.591617:0:6514:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98db82c986c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1790740375.591622:0:6514:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98dc8557d000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98db82c989c0 00000020:00080000:0.0:1790740375.591626:0:6514:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98dc8557d200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98dc8a450000 00000004:00080000:0.0:1790740375.591651:0:6514:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:0.0:1790740375.591675:0:6514:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98dca0807b40 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1790740375.591679:0:6514:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98dc8137b600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98dc896a93c0 00000020:00080000:0.0:1790740375.591681:0:6514:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98dc8137b500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98db83fb5400 00000020:00080000:0.0:1790740375.591704:0:6567:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1790740375.591764:0:6567:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1790740375.591939:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790740375.591958:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84651500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022045696:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1790740375.592025:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740375.592083:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790740375.592092:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84652d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022045824:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1790740375.592117:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740375.592208:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022045696 00000100:00100000:0.0:1790740375.592227:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022045696 00000100:00100000:0.0:1790740375.592284:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022045824 00000100:00100000:0.0:1790740375.592287:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022045824 00000100:00100000:0.0:1790740375.592307:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790740375.592315:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84651880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3638:x1877727022045696:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1790740375.592354:0:9806:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:0.0:1790740375.592379:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003731b4fa/0xb25dda4f4e92eb3a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740375.592402:0:9806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000098921d05/0xb25dda4f4e92e8ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f40 expref: 12 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740375.592411:0:9806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1790740375.592416:0:9806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790740375.592433:0:9806:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003731b4fa/0xb25dda4f4e92eb3a lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740375.592463:0:9806:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000098921d05/0xb25dda4f4e92e8ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f40 expref: 12 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740375.592478:0:9806:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000098921d05/0xb25dda4f4e92e8ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f40 expref: 12 pid: 14497 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740375.592489:0:9806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84532a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9806:1877727022045952:192.168.204.3@tcp:104: 00000100:00100000:0.0:1790740375.592551:0:9806:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82c756c0 going to sleep for 11 seconds 00000100:00080000:3.0:1790740375.592776:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790740375.592913:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790740375.592923:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb6f3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3641:x1877727022045824:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1790740375.593024:0:8453:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1790740375.593028:0:8453:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1790740375 00002000:00010000:1.0:1790740375.593053:0:8453:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1790740375.593056:0:8453:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1790740375 -> 1790740375 00002000:00010000:1.0:1790740375.593058:0:8453:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1790740375.593098:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb6f3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3641:x1877727022045824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 177us (979us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1790740375.593106:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790740375.593203:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+27:12473:x1877727001025408:12345-192.168.204.3@tcp:44:lhsmtool_posix.0 Request processed in 3976us (4213us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740375.593225:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 243 00000100:00100000:0.0:1790740375.593347:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790740375.593358:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db8468ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022046080:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1790740375.593394:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740375.593833:0:14497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022046080 00000100:00100000:1.0:1790740375.593840:0:14497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022046080 00000100:00100000:1.0:1790740375.593885:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790740375.593892:0:14497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84532300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3640:x1877727022046080:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1790740375.593910:0:14497:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:1.0:1790740375.593937:0:14497:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6abc8796, atime: 0x6abc8797, ctime: 0x6abc8796, blocks: 0x8 00010000:00010000:1.0:1790740375.593945:0:14497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc041cf6/0xb25dda4f4e92eb41 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.593956:0:14497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1790740375.593960:0:14497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790740375.593967:0:14497:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc041cf6/0xb25dda4f4e92eb41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.593981:0:14497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc041cf6/0xb25dda4f4e92eb41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.593991:0:14497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc041cf6/0xb25dda4f4e92eb41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.594000:0:14497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc041cf6/0xb25dda4f4e92eb41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.594021:0:14497:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790740375.594157:0:14497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84532300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3640:x1877727022046080:12345-0@lo:6:osp-syn-1-0.0 Request processed in 265us (762us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1790740375.594171:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:1.0:1790740375.594191:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790740375.594198:0:6524:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc041cf6/0xb25dda4f4e92eb41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.594208:0:6524:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc44400 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:1.0:1790740375.594212:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc041cf6/0xb25dda4f4e92eb41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.594223:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc041cf6/0xb25dda4f4e92eb41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.594239:0:6524:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc041cf6/0xb25dda4f4e92eb41 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.594247:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc041cf6/0xb25dda4f4e92eb41 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.594267:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740375.594269:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740375.594271:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1790740375.594360:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98db8468ed80/2, rc 0, transno 4294967311 00000100:00100000:0.0:1790740375.594367:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db8468ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022046080:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1790740375.594575:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98db84652d80/2, rc 0, transno 4294967322 00000100:00100000:3.0:1790740375.594582:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84652d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022045824:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1790740375.597963:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00010000:00010000:2.0:1790740375.598164:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e838 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.598177:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e838 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.598186:0:3625:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e838 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.598192:0:3625:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f33200 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740375.598198:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e838 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.598206:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e838 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.598224:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98dc887e4100) 00010000:00010000:2.0:1790740375.598244:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740375.598251:0:3625:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e838 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.598258:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33200/0xb25dda4f4e92e838 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.598311:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2e00/0xb25dda4f4e92e8e0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.598318:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2e00/0xb25dda4f4e92e8e0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.598324:0:3625:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2e00/0xb25dda4f4e92e8e0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.598330:0:3625:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee2e00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740375.598333:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2e00/0xb25dda4f4e92e8e0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.598353:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2e00/0xb25dda4f4e92e8e0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.598362:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98dc985bee00) 00010000:00010000:2.0:1790740375.598365:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740375.598368:0:3625:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2e00/0xb25dda4f4e92e8e0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.598378:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2e00/0xb25dda4f4e92e8e0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.598397:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3600/0xb25dda4f4e92e95e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.598413:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3600/0xb25dda4f4e92e95e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.598431:0:3625:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3600/0xb25dda4f4e92e95e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.598436:0:3625:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee3600 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740375.598439:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3600/0xb25dda4f4e92e95e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.598445:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3600/0xb25dda4f4e92e95e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.598453:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98dc887e4700) 00010000:00010000:2.0:1790740375.598456:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740375.598459:0:3625:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3600/0xb25dda4f4e92e95e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.598464:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee3600/0xb25dda4f4e92e95e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.598478:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e981 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.598485:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e981 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.598490:0:3625:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e981 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.598495:0:3625:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc9c00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740375.598506:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e981 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.598512:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e981 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.598520:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98dc887e4700) 00010000:00010000:2.0:1790740375.598522:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740375.598525:0:3625:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e981 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.598530:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92e981 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.598557:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92ea53 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.598563:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92ea53 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.598568:0:3625:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92ea53 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.598573:0:3625:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc9800 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740375.598575:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92ea53 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.598580:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92ea53 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.598588:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98dcaf04c000) 00010000:00010000:2.0:1790740375.598590:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740375.598600:0:3625:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92ea53 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.598606:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92ea53 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.598619:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92eb10 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.598625:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92eb10 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.598631:0:3625:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92eb10 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.598636:0:3625:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc8200 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740375.598639:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92eb10 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.598643:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92eb10 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.598652:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98dc985be700) 00010000:00010000:2.0:1790740375.598654:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790740375.598656:0:3625:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92eb10 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.598661:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92eb10 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740375.599386:0:9806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84532a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9806:1877727022045952:192.168.204.3@tcp:104: 00010000:00010000:0.0:1790740375.599413:0:9806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003731b4fa/0xb25dda4f4e92eb3a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740375.600576:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001025536 00000100:00100000:1.0:1790740375.600588:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001025536 00000100:00100000:1.0:1790740375.600644:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 76 00000100:00100000:1.0:1790740375.600654:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb81b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bed19f2-4c98-4684-89e7-a6871565665d+13:2403:x1877727001025536:12345-192.168.204.3@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1790740375.601147:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740375.602388:0:9550:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001025664 00000100:00100000:1.0:1790740375.602411:0:9550:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001025664 00010000:00010000:1.0:1790740375.602461:0:9550:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000098921d05/0xb25dda4f4e92e8ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f40 expref: 14 pid: 14497 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740375.602501:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 101 00000100:00100000:1.0:1790740375.602511:0:9550:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84532a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7bed19f2-4c98-4684-89e7-a6871565665d+14:2402:x1877727001025664:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740375.602524:0:9550:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740375.602530:0:9550:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000098921d05/0xb25dda4f4e92e8ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f40 expref: 14 pid: 14497 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.602544:0:9550:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000098921d05/0xb25dda4f4e92e8ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f40 expref: 14 pid: 14497 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.602567:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098921d05/0xb25dda4f4e92e8ee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f40 expref: 14 pid: 14497 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.602585:0:9550:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790740375.602590:0:9550:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790740375.602596:0:9550:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003731b4fa/0xb25dda4f4e92eb3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.602608:0:9550:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003731b4fa/0xb25dda4f4e92eb3a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.602633:0:9550:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740375.602693:0:9550:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84532a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7bed19f2-4c98-4684-89e7-a6871565665d+13:2402:x1877727001025664:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 183us (1547us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740375.602710:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 101 00010000:00010000:0.0:1790740375.603172:0:9806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003731b4fa/0xb25dda4f4e92eb3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740375.603185:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003731b4fa/0xb25dda4f4e92eb3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740375.603196:0:9806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003731b4fa/0xb25dda4f4e92eb3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740375.603206:0:9806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003731b4fa/0xb25dda4f4e92eb3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740375.603229:0:9806:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790740375.603413:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84651880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3638:x1877727022045696:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11098us (11388us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1790740375.603433:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000004:00080000:0.0:1790740375.603668:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98db84651500/2, rc 0, transno 4294967323 00000100:00100000:0.0:1790740375.603676:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84651500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022045696:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1790740375.604663:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790740375.604674:0:6523:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003731b4fa/0xb25dda4f4e92eb3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.604687:0:6523:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee2600 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:1.0:1790740375.604692:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003731b4fa/0xb25dda4f4e92eb3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.604703:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003731b4fa/0xb25dda4f4e92eb3a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.604724:0:6523:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003731b4fa/0xb25dda4f4e92eb3a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.604732:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003731b4fa/0xb25dda4f4e92eb3a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.604760:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740375.604761:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740375.604763:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790740375.606286:0:8446:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:0.0:1790740375.606299:0:8446:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:1.0:1790740375.606545:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb81b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bed19f2-4c98-4684-89e7-a6871565665d+7:2403:x1877727001025536:12345-192.168.204.3@tcp:16:lhsmtool_posix.0 Request processed in 5887us (8587us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740375.606557:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 76 00000100:00100000:0.0:1790740375.609815:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740375.609949:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001025920 00000100:00100000:1.0:1790740375.609962:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001025920 00000100:00100000:1.0:1790740375.610077:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 244 00000100:00100000:1.0:1790740375.610087:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84533100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+21:12473:x1877727001025920:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790740375.610144:0:6535:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740375.610172:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92eb25 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fda expref: 21 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.610194:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98dc985be700) 00010000:00010000:1.0:1790740375.610199:0:6535:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790740375.610229:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92eb48 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.610243:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92eb48 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.610252:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92eb48 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790740375.610391:0:6535:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b69be0ce reply state 00000000d3949cb7 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92eb48 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.610404:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92eb48 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.610410:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98dc985be700) 00010000:00010000:1.0:1790740375.610413:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790740375.610415:0:6535:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790740375.610538:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84533100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+22:12473:x1877727001025920:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 Request processed in 452us (733us total) trans 4294967509 rc 0/0 00000100:00100000:1.0:1790740375.610546:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 244 00000100:00100000:3.0:1790740375.613210:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740375.613310:0:14497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001026048 00000100:00100000:1.0:1790740375.613343:0:14497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001026048 00000100:00100000:1.0:1790740375.613452:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 77 00000100:00100000:1.0:1790740375.613462:0:14497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb81b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7bed19f2-4c98-4684-89e7-a6871565665d+7:2403:x1877727001026048:12345-192.168.204.3@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1790740375.613591:0:14497:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1790740375.613595:0:14497:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1790740375 -> 1790740375 00002000:00010000:1.0:1790740375.613598:0:14497:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1790740375 00002000:00010000:1.0:1790740375.613600:0:14497:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1790740375 -> 1790740375 00002000:00010000:1.0:1790740375.613603:0:14497:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1790740375.613666:0:14497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb81b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7bed19f2-4c98-4684-89e7-a6871565665d+8:2403:x1877727001026048:12345-192.168.204.3@tcp:2:lhsmtool_posix.0 Request processed in 205us (466us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1790740375.613674:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 77 00000100:00100000:3.0:1790740375.615610:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740375.615718:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001026304 00000100:00100000:2.0:1790740375.615727:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001026304 00000100:00100000:2.0:1790740375.615781:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 245 00000100:00100000:2.0:1790740375.615805:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb81b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+22:12473:x1877727001026304:12345-192.168.204.3@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1790740375.615876:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92eb4f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.615894:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92eb09 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fcc expref: 22 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.615904:0:6537:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92eb4f lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.615939:0:6537:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92eb09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fcc expref: 22 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.615953:0:6537:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92eb09 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fcc expref: 22 pid: 6537 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740375.615968:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5df3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6537:1877727022046208:192.168.204.3@tcp:104: 00000100:00100000:2.0:1790740375.616063:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83d05780 going to sleep for 11 seconds 00000100:00100000:2.0:1790740375.619199:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740375.619228:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001026432 00000100:00100000:2.0:1790740375.619236:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001026432 00010000:00010000:2.0:1790740375.619276:0:6521:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92eb09 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fcc expref: 23 pid: 6537 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740375.619312:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 102 00000100:00100000:2.0:1790740375.619321:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7bed19f2-4c98-4684-89e7-a6871565665d+23:2402:x1877727001026432:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790740375.619410:0:6521:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740375.619439:0:6521:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92eb09 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fcc expref: 23 pid: 6537 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.619454:0:6521:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92eb09 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fcc expref: 23 pid: 6537 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.619477:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98dc985be700) 00010000:00010000:2.0:1790740375.619483:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92eb4f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.619493:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92eb4f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.619502:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92eb4f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.619521:0:6521:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740375.619564:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7bed19f2-4c98-4684-89e7-a6871565665d+23:2402:x1877727001026432:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 244us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740375.619572:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 102 00010000:00010000:3.0:1790740375.619733:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45c00/0xb25dda4f4e92eb09 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fcc expref: 22 pid: 6537 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740375.619749:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5df3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6537:1877727022046208:192.168.204.3@tcp:104: 00010000:00010000:3.0:1790740375.619768:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92eb4f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.619777:0:6537:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92eb4f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.619799:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92eb4f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.619835:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92eb4f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.619843:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92eb4f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.619850:0:6537:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92eb4f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.619857:0:6537:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f33e00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740375.619860:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92eb4f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.619867:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92eb4f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.619876:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98dc985be700) 00010000:00010000:3.0:1790740375.619879:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1790740375.619892:0:6537:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92eb4f lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.619899:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33e00/0xb25dda4f4e92eb4f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740375.619957:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb81b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+21:12473:x1877727001026304:12345-192.168.204.3@tcp:55:lhsmtool_posix.0 Request processed in 4153us (4354us total) trans 0 rc -22/-22 00000100:00100000:3.0:1790740375.619965:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 245 00000100:00100000:2.0:1790740375.623851:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740375.623929:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001026560 00000100:00100000:3.0:1790740375.623939:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001026560 00000100:00100000:3.0:1790740375.623998:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 78 00000100:00100000:3.0:1790740375.624008:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bed19f2-4c98-4684-89e7-a6871565665d+8:2402:x1877727001026560:12345-192.168.204.3@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1790740375.624079:0:8454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5fd727f/0xb25dda4f4e92eb56 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.624101:0:8454:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009ea25463/0xb25dda4f4e92eb33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fe8 expref: 8 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.624110:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790740375.624115:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790740375.624120:0:8454:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5fd727f/0xb25dda4f4e92eb56 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.624155:0:8454:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009ea25463/0xb25dda4f4e92eb33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fe8 expref: 8 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.624170:0:8454:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009ea25463/0xb25dda4f4e92eb33 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fe8 expref: 8 pid: 14497 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740375.624200:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb81b4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8454:1877727022046336:192.168.204.3@tcp:104: 00000100:00100000:3.0:1790740375.624283:0:8454:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82c98480 going to sleep for 11 seconds 00000100:00100000:3.0:1790740375.627298:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb81b4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8454:1877727022046336:192.168.204.3@tcp:104: 00010000:00010000:3.0:1790740375.627329:0:8454:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5fd727f/0xb25dda4f4e92eb56 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740375.629138:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740375.631973:0:10416:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001026688 00000100:00100000:1.0:1790740375.631988:0:10416:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001026688 00010000:00010000:1.0:1790740375.632049:0:10416:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009ea25463/0xb25dda4f4e92eb33 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fe8 expref: 9 pid: 14497 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740375.632149:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 103 00000100:00100000:1.0:1790740375.632160:0:10416:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7bed19f2-4c98-4684-89e7-a6871565665d+9:2405:x1877727001026688:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740375.632175:0:10416:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740375.632197:0:10416:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009ea25463/0xb25dda4f4e92eb33 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fe8 expref: 9 pid: 14497 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.632212:0:10416:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009ea25463/0xb25dda4f4e92eb33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fe8 expref: 9 pid: 14497 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.632236:0:10416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ea25463/0xb25dda4f4e92eb33 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fe8 expref: 9 pid: 14497 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.632271:0:10416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790740375.632276:0:10416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790740375.632283:0:10416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5fd727f/0xb25dda4f4e92eb56 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.632294:0:10416:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5fd727f/0xb25dda4f4e92eb56 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.632340:0:10416:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740375.632408:0:10416:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7bed19f2-4c98-4684-89e7-a6871565665d+8:2405:x1877727001026688:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 249us (3279us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740375.632426:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 103 00010000:00010000:3.0:1790740375.632840:0:8454:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5fd727f/0xb25dda4f4e92eb56 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.632861:0:8454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5fd727f/0xb25dda4f4e92eb56 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.632884:0:8454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5fd727f/0xb25dda4f4e92eb56 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.632891:0:8454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5fd727f/0xb25dda4f4e92eb56 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.632899:0:8454:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5fd727f/0xb25dda4f4e92eb56 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.632906:0:8454:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc9e00 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:3.0:1790740375.632910:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5fd727f/0xb25dda4f4e92eb56 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.632933:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5fd727f/0xb25dda4f4e92eb56 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.632948:0:8454:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5fd727f/0xb25dda4f4e92eb56 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.632956:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5fd727f/0xb25dda4f4e92eb56 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740375.633059:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bed19f2-4c98-4684-89e7-a6871565665d+7:2402:x1877727001026560:12345-192.168.204.3@tcp:1:lhsmtool_posix.0 Request processed in 9023us (9194us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740375.633067:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 78 00000100:00100000:2.0:1790740375.636814:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740375.636909:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001026944 00000100:00100000:1.0:1790740375.636921:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001026944 00000100:00100000:1.0:1790740375.636988:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 246 00000100:00100000:1.0:1790740375.636998:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+21:12473:x1877727001026944:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1790740375.637120:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92eb5d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.637137:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32a00/0xb25dda4f4e92ea4c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f94 expref: 21 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.637146:0:6536:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92eb5d lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.637181:0:6536:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32a00/0xb25dda4f4e92ea4c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f94 expref: 21 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.637213:0:6536:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32a00/0xb25dda4f4e92ea4c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f94 expref: 21 pid: 7760 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740375.637228:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db8468ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6536:1877727022046464:192.168.204.3@tcp:104: 00000100:00100000:1.0:1790740375.637304:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb62b0480 going to sleep for 11 seconds 00000100:00100000:1.0:1790740375.640133:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db8468ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6536:1877727022046464:192.168.204.3@tcp:104: 00010000:00010000:1.0:1790740375.640166:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92eb5d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740375.641913:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740375.641999:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001027072 00000100:00100000:3.0:1790740375.642009:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001027072 00010000:00010000:3.0:1790740375.642072:0:6522:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32a00/0xb25dda4f4e92ea4c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f94 expref: 22 pid: 7760 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740375.642113:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 104 00000100:00100000:3.0:1790740375.642122:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7bed19f2-4c98-4684-89e7-a6871565665d+22:2402:x1877727001027072:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790740375.642137:0:6522:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740375.642143:0:6522:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32a00/0xb25dda4f4e92ea4c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f94 expref: 22 pid: 7760 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.642155:0:6522:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32a00/0xb25dda4f4e92ea4c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f94 expref: 22 pid: 7760 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.642196:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32a00/0xb25dda4f4e92ea4c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f94 expref: 22 pid: 7760 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.642213:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98dcaf04c000) 00010000:00010000:3.0:1790740375.642219:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44e00/0xb25dda4f4e92eaae lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fb7 expref: 21 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.642231:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92eb5d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.642239:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92eb5d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.642249:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92eb5d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.642279:0:6522:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740375.642352:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7bed19f2-4c98-4684-89e7-a6871565665d+21:2402:x1877727001027072:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 230us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740375.642360:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 104 00010000:00010000:1.0:1790740375.642602:0:6536:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92eb5d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.642612:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92eb5d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.642785:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92eb64 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.642798:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92eb17 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fd3 expref: 21 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.642806:0:6536:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92eb64 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.642837:0:6536:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92eb17 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fd3 expref: 21 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.642850:0:6536:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92eb17 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fd3 expref: 21 pid: 7760 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740375.642875:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db8468ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6536:1877727022046592:192.168.204.3@tcp:104: 00000100:00100000:1.0:1790740375.642945:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83ce4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790740375.646592:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db8468ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6536:1877727022046592:192.168.204.3@tcp:104: 00010000:00010000:1.0:1790740375.646626:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92eb64 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740375.648340:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740375.648559:0:6520:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001027200 00000100:00100000:2.0:1790740375.648568:0:6520:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001027200 00010000:00010000:2.0:1790740375.648611:0:6520:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92eb17 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fd3 expref: 22 pid: 7760 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740375.648642:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 105 00000100:00100000:2.0:1790740375.648665:0:6520:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84532680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7bed19f2-4c98-4684-89e7-a6871565665d+22:2402:x1877727001027200:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790740375.648680:0:6520:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740375.648687:0:6520:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92eb17 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fd3 expref: 22 pid: 7760 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.648698:0:6520:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92eb17 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fd3 expref: 22 pid: 7760 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.648719:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32c00/0xb25dda4f4e92eb17 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fd3 expref: 22 pid: 7760 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.648735:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98dc985be700) 00010000:00010000:2.0:1790740375.648740:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92eb64 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.648749:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92eb64 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.648757:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92eb64 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.648800:0:6520:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790740375.648941:0:6536:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92eb64 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740375.648949:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92eb64 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790740375.649085:0:6536:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:1.0:1790740375.649203:0:6536:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:1.0:1790740375.649238:0:6536:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:1.0:1790740375.649313:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db8468ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6536:1877727022046720:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1790740375.649404:0:6536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740375.649444:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83ce4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790740375.649513:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022046720 00000100:00100000:0.0:1790740375.649517:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022046720 00000100:00100000:0.0:1790740375.649558:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1790740375.649566:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6536:x1877727022046720:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1790740375.649637:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6536:x1877727022046720:12345-0@lo:1000:mdt00_001.0 Request processed in 72us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740375.649645:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1790740375.649731:0:6520:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84532680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7bed19f2-4c98-4684-89e7-a6871565665d+24:2402:x1877727001027200:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 1065us (1405us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740375.649738:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 105 00000100:00100000:1.0:1790740375.650736:0:6536:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:1.0:1790740375.650743:0:6536:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:1.0:1790740375.650783:0:6536:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98db84652d80, transno 4294967322 00000100:00100000:1.0:1790740375.650802:0:6536:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff98db84651500 x1877727022045696/t4294967323(4294967323) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1790740391 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740375.650815:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db8468ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6536:1877727022046720:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1790740375.650953:0:6536:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:1.0:1790740375.651011:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db8468ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6536:1877727022046848:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1790740375.651084:0:6536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740375.651105:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83ce49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790740375.651284:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022046848 00000100:00100000:0.0:1790740375.651290:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022046848 00000100:00100000:0.0:1790740375.651339:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1790740375.651349:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6536:x1877727022046848:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1790740375.651480:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6536:x1877727022046848:12345-0@lo:1000:mdt00_001.0 Request processed in 133us (396us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1790740375.651490:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1790740375.651617:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db8468ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6536:1877727022046848:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1790740375.651653:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92eb64 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.651663:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92eb64 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.651670:0:6536:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92eb64 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.651684:0:6536:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc45a00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740375.651688:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92eb64 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.651695:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92eb64 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.651709:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98dc985be700) 00010000:00010000:3.0:1790740375.651712:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790740375.651716:0:6536:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92eb64 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.651723:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45a00/0xb25dda4f4e92eb64 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.651746:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2800/0xb25dda4f4e92eaa7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.651752:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2800/0xb25dda4f4e92eaa7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.651757:0:6536:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2800/0xb25dda4f4e92eaa7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.651761:0:6536:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee2800 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740375.651763:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2800/0xb25dda4f4e92eaa7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.651769:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2800/0xb25dda4f4e92eaa7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.651785:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98dcaf04c000) 00010000:00010000:3.0:1790740375.651788:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790740375.651794:0:6536:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44e00/0xb25dda4f4e92eaae lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fb7 expref: 24 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.651805:0:6536:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44e00/0xb25dda4f4e92eaae lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fb7 expref: 24 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.651814:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44e00/0xb25dda4f4e92eaae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fb7 expref: 24 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.651851:0:6536:0:(ldlm_lockd.c:1085:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44e00/0xb25dda4f4e92eaae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fb7 expref: 24 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740375.651865:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb81b4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6536:1877727022046976:192.168.204.3@tcp:105: 00000100:00100000:3.0:1790740375.651934:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82c98480 going to sleep for 11 seconds 00000100:00100000:3.0:1790740375.655279:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb81b4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6536:1877727022046976:192.168.204.3@tcp:105: 00010000:00010000:3.0:1790740375.655322:0:6536:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2800/0xb25dda4f4e92eaa7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.655346:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2800/0xb25dda4f4e92eaa7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.655388:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92eb6b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.655404:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92eb6b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.655442:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92eb6b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.655452:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92eb6b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.655459:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92eb6b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.655466:0:6536:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92eb6b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.655473:0:6536:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc9e00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740375.655477:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92eb6b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.655484:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92eb6b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.655496:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98dcaf04c000) 00010000:00010000:3.0:1790740375.655499:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740375.655503:0:6536:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92eb6b lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.655509:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92eb6b lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.655521:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92eb5d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.655527:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92eb5d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.655543:0:6536:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92eb5d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.655548:0:6536:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc45000 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740375.655551:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92eb5d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.655557:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92eb5d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.655565:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98dcaf04c000) 00010000:00010000:3.0:1790740375.655568:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790740375.655570:0:6536:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92eb5d lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.655576:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45000/0xb25dda4f4e92eb5d lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740375.655764:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+24:12473:x1877727001026944:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 Request processed in 18765us (18959us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1790740375.655775:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 246 00000020:00080000:3.0:1790740375.655782:0:6536:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1790740375.656355:0:13821:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790740375.656361:0:13821:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790740375.657907:0:13821:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1790740375.657927:0:13821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790740375.658340:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790740375.658361:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db8468dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022047104:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790740375.658438:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740375.658512:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022047104 00000100:00100000:1.0:1790740375.658519:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022047104 00000100:00100000:1.0:1790740375.658581:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1790740375.658589:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb81b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022047104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790740375.658612:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:1.0:1790740375.658657:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb81b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022047104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740375.658664:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1790740375.658712:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db8468dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022047104:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1790740375.659511:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790740375.659914:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790740375.659931:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db8468dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022047232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790740375.659980:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740375.660072:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022047232 00000100:00100000:1.0:1790740375.660079:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022047232 00000100:00100000:1.0:1790740375.660121:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1790740375.660129:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84531180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1877727022047232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790740375.660145:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:1.0:1790740375.660187:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84531180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1877727022047232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740375.660194:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1790740375.660232:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db8468dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022047232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790740375.661665:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740375.661755:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740375.661954:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001027328 00000100:00100000:3.0:1790740375.661962:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001027328 00000100:00100000:3.0:1790740375.661996:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001027584 00000100:00100000:3.0:1790740375.662013:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001027584 00000100:00100000:3.0:1790740375.662057:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 61 00000100:00100000:3.0:1790740375.662067:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+25:12472:x1877727001027328:12345-192.168.204.3@tcp:49:lfs.0 00000100:00100000:3.0:1790740375.662199:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+25:12472:x1877727001027328:12345-192.168.204.3@tcp:49:lfs.0 Request processed in 134us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740375.662207:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 61 00000100:00100000:3.0:1790740375.662225:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 62 00000100:00100000:3.0:1790740375.662232:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc9925ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+24:12473:x1877727001027584:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1790740375.662503:0:6539:0:(mdd_object.c:4180:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1790740375.662541:0:6539:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:3.0:1790740375.662577:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92eb72 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.662595:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92eb72 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.662607:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92eb72 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.662617:0:6539:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92eb72 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.662624:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92eb72 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.662632:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92eb72 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.662708:0:6539:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790740375.662764:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc9925ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+26:12473:x1877727001027584:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 Request processed in 533us (1008us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1790740375.662779:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 62 00000020:00080000:3.0:1790740375.662783:0:6539:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1790740375.665650:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740375.665743:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001027840 00000100:00100000:0.0:1790740375.665753:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001027840 00000100:00100000:0.0:1790740375.665823:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 247 00000100:00100000:0.0:1790740375.665832:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+26:12472:x1877727001027840:12345-192.168.204.3@tcp:58:lfs.0 00000040:00080000:0.0:1790740375.666011:0:7760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1790740375.666112:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+26:12472:x1877727001027840:12345-192.168.204.3@tcp:58:lfs.0 Request processed in 281us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740375.666120:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 247 00010000:00010000:2.0:1790740375.667169:0:10357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790740375.667181:0:10357:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92eb72 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.667201:0:10357:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc9400 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:2.0:1790740375.667206:0:10357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92eb72 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.667214:0:10357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92eb72 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.667230:0:10357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98dc985be700) 00010000:00010000:2.0:1790740375.667233:0:10357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1790740375.667238:0:10357:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92eb72 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.667244:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92eb72 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.667261:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740375.667263:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740375.667264:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740375.704759:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740375.704862:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001027968 00000100:00100000:3.0:1790740375.704872:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001027968 00000100:00100000:3.0:1790740375.704931:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 248 00000100:00100000:3.0:1790740375.704941:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84531500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+26:12475:x1877727001027968:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:3.0:1790740375.704963:0:6537:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740375.704986:0:6537:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92eb79 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23fef expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.705086:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92eb80 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.705106:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92eb80 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.705119:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92eb80 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.705134:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92eb87 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.705141:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92eb87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.705148:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92eb87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.705223:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92eb8e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.705254:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92ea99 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fb0 expref: 27 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.705262:0:6537:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92eb8e lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.705296:0:6537:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92ea99 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fb0 expref: 27 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740375.705310:0:6537:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92ea99 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fb0 expref: 27 pid: 13222 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740375.705325:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb81b5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6537:1877727022047360:192.168.204.3@tcp:104: 00000100:00100000:3.0:1790740375.705399:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82c98840 going to sleep for 11 seconds 00000100:00100000:1.0:1790740375.709213:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740375.709313:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001028224 00000100:00100000:2.0:1790740375.709324:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001028224 00000100:00100000:2.0:1790740375.709390:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 63 00000100:00100000:2.0:1790740375.709400:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+28:6197:x1877727001028224:12345-192.168.204.3@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1790740375.709630:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+29:6197:x1877727001028224:12345-192.168.204.3@tcp:35:ldlm_bl.0 Request processed in 230us (425us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1790740375.709638:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 63 00000100:00100000:3.0:1790740375.710263:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb81b5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6537:1877727022047360:192.168.204.3@tcp:104: 00010000:00010000:3.0:1790740375.710286:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92eb8e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740375.713439:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740375.713543:0:10416:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001028352 00000100:00100000:0.0:1790740375.713554:0:10416:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001028352 00010000:00010000:0.0:1790740375.713597:0:10416:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92ea99 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fb0 expref: 29 pid: 13222 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740375.713637:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 106 00000100:00100000:0.0:1790740375.713646:0:10416:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc88c6b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7bed19f2-4c98-4684-89e7-a6871565665d+29:2402:x1877727001028352:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790740375.713660:0:10416:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740375.713667:0:10416:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92ea99 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fb0 expref: 29 pid: 13222 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740375.713680:0:10416:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92ea99 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fb0 expref: 29 pid: 13222 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740375.713701:0:10416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44c00/0xb25dda4f4e92ea99 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fb0 expref: 29 pid: 13222 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740375.713716:0:10416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98dcaf04c000) 00010000:00010000:0.0:1790740375.713722:0:10416:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92eb8e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740375.713749:0:10416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92eb8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740375.713757:0:10416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92eb8e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740375.713912:0:10416:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790740375.714069:0:6537:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92eb8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.714079:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92eb8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740375.714134:0:6537:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1790740375.714139:0:6537:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790740375.714158:0:6537:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92eb8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.714169:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92eb8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.714178:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92eb80 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.714185:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92eb80 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.714193:0:6537:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92eb80 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.714199:0:6537:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc9400 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740375.714203:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92eb80 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.714210:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92eb80 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.714219:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98dc887e4800) 00010000:00010000:2.0:1790740375.714222:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740375.714226:0:6537:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92eb80 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.714231:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9400/0xb25dda4f4e92eb80 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.714256:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92eb87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.714263:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92eb87 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.714269:0:6537:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92eb87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.714274:0:6537:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc8200 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740375.714276:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92eb87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.714282:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92eb87 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.714290:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98dcaf04ca00) 00010000:00010000:2.0:1790740375.714292:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740375.714295:0:6537:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92eb87 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.714301:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92eb87 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.714335:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92eb79 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fef expref: 29 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.714349:0:6537:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92eb8e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fef expref: 28 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740375.714366:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98dcaf04c000) 00010000:00010000:2.0:1790740375.714368:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790740375.714371:0:6537:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc9800, rc 0) 00000100:00100000:0.0:1790740375.716888:0:10416:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc88c6b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7bed19f2-4c98-4684-89e7-a6871565665d+28:2402:x1877727001028352:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 3223us (3451us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740375.716906:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 106 00000100:00100000:2.0:1790740375.719561:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84531500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+27:12475:x1877727001027968:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 14610us (14799us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740375.719573:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 248 00010000:00010000:1.0:1790740376.042264:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1790740376.061420:0:9531:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:3.0:1790740376.061438:0:9531:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000040:00080000:2.0:1790740376.364261:0:13823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1790740376.684911:0:13821:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790740376.684925:0:13821:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790740376.684979:0:13821:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1790740376.684992:0:13821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790740376.685219:0:13821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb81b5c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13821:1877727022047488:192.168.204.3@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790740376.685341:0:13821:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82c98540 going to sleep for 11 seconds 00000100:00100000:1.0:1790740376.704640:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740376.704714:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001028480 00000100:00100000:1.0:1790740376.704746:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001028480 00000100:00100000:1.0:1790740376.704844:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 249 00000100:00100000:1.0:1790740376.704857:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+28:12487:x1877727001028480:12345-192.168.204.3@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790740376.704909:0:6536:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790740376.705094:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+28:12487:x1877727001028480:12345-192.168.204.3@tcp:53:lhsmtool_posix.0 Request processed in 240us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740376.705103:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 249 00000100:00080000:1.0:1790740376.705134:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790740376.706240:0:13821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb81b5c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13821:1877727022047488:192.168.204.3@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790740376.712024:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740376.712519:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001028736 00000100:00100000:3.0:1790740376.712533:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001028736 00000100:00100000:3.0:1790740376.712620:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 250 00000100:00100000:3.0:1790740376.712634:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84532a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+27:12487:x1877727001028736:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790740376.712671:0:13222:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740376.712704:0:13222:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92eb95 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23ff6 expref: -99 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740376.712864:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92eb9c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740376.712886:0:13222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92eb9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740376.712899:0:13222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92eb9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740376.712914:0:13222:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1790740376.713110:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92eb95 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ff6 expref: 30 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740376.713135:0:13222:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92eb9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ff6 expref: 29 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740376.713144:0:13222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98dcaf04c000) 00010000:00010000:3.0:1790740376.713147:0:13222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790740376.713151:0:13222:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc8a00, rc 0) 00000100:00100000:3.0:1790740376.713248:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84532a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+29:12487:x1877727001028736:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 617us (1241us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1790740376.713277:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 250 00000100:00100000:3.0:1790740376.716558:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740376.716640:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740376.716686:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001029120 00000100:00100000:3.0:1790740376.716701:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001029120 00000100:00100000:3.0:1790740376.716773:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 251 00000100:00100000:3.0:1790740376.716784:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb81b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+29:12487:x1877727001029120:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1790740376.716916:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92ebaa lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740376.716940:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92ebaa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740376.716955:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92ebaa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740376.717219:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92ebaa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740376.717230:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92ebaa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740376.717238:0:6537:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92ebaa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740376.717246:0:6537:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc9e00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740376.717252:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92ebaa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740376.717261:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92ebaa lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740376.717291:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98dcaf04c000) 00010000:00010000:3.0:1790740376.717295:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790740376.717303:0:6537:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92ebaa lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740376.717310:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9e00/0xb25dda4f4e92ebaa lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740376.717494:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb81b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+30:12487:x1877727001029120:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 Request processed in 711us (852us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1790740376.717505:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 251 00000040:00080000:3.0:1790740376.717645:0:13821:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790740376.717650:0:13821:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790740376.721138:0:13821:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1790740376.721171:0:13821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790740376.721426:0:6521:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001028864 00000100:00100000:0.0:1790740376.721441:0:6521:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001028864 00000100:00100000:0.0:1790740376.721543:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 19 00000100:00100000:0.0:1790740376.721555:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb81b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7bed19f2-4c98-4684-89e7-a6871565665d+30:2403:x1877727001028864:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790740376.721576:0:6521:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740376.721610:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8a00/0xb25dda4f4e92eb9c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ff6 expref: 30 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740376.721634:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98dcaf04c000) 00010000:00010000:0.0:1790740376.721641:0:6521:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740376.721708:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb81b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7bed19f2-4c98-4684-89e7-a6871565665d+29:2403:x1877727001028864:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 157us (5170us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740376.721716:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 19 00000100:00100000:3.0:1790740376.725582:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740376.725679:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001029376 00000100:00100000:0.0:1790740376.725694:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001029376 00000100:00100000:0.0:1790740376.725770:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 64 00000100:00100000:0.0:1790740376.725797:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb81b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+29:12487:x1877727001029376:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1790740376.726149:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb81b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+30:12487:x1877727001029376:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 Request processed in 354us (581us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1790740376.726158:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 64 00000040:00080000:0.0:1790740376.776582:0:14781:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790740376.776594:0:14781:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790740376.776631:0:14781:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1790740376.776637:0:14781:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790740376.978725:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740376.979099:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001029632 00000100:00100000:1.0:1790740376.979115:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001029632 00000100:00100000:1.0:1790740376.979196:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 252 00000100:00100000:1.0:1790740376.979210:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84532680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+30:12500:x1877727001029632:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:1.0:1790740376.979246:0:7760:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740376.979278:0:7760:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92ebb1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae23ffd expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740376.979442:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92ebb8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740376.979462:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92ebb8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740376.979477:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92ebb8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740376.979493:0:7760:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1790740376.979639:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44800/0xb25dda4f4e92ebb1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ffd expref: 33 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740376.979681:0:7760:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92ebb8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ffd expref: 32 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740376.979690:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98dcaf04c000) 00010000:00010000:1.0:1790740376.979694:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1790740376.979697:0:7760:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcbfc45800, rc 0) 00000100:00100000:1.0:1790740376.980932:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84532680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+32:12500:x1877727001029632:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 577us (1075us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1790740376.980948:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 252 00000100:00100000:0.0:1790740376.984678:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740376.984767:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001029760 00000100:00100000:1.0:1790740376.984781:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001029760 00000100:00100000:1.0:1790740376.984872:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 253 00000100:00100000:1.0:1790740376.984884:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+32:12500:x1877727001029760:12345-192.168.204.3@tcp:54:lfs.0 00010000:00010000:1.0:1790740376.984981:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92ebc6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740376.985003:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92ebc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740376.985020:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92ebc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740376.985103:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92ebc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740376.985113:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92ebc6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740376.985143:0:6535:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92ebc6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740376.985150:0:6535:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc45200 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740376.985156:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92ebc6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740376.985166:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92ebc6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740376.985182:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98dcaf04c000) 00010000:00010000:1.0:1790740376.985186:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790740376.985191:0:6535:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92ebc6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740376.985199:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45200/0xb25dda4f4e92ebc6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740376.985299:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+32:12500:x1877727001029760:12345-192.168.204.3@tcp:54:lfs.0 Request processed in 417us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740376.985318:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 253 00000100:00100000:0.0:1790740376.987980:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740376.988066:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740376.988107:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740376.988132:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740376.988166:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740376.988194:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740376.988224:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001030144 00000100:00100000:0.0:1790740376.988237:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001030144 00000100:00100000:0.0:1790740376.988290:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001030272 00000100:00100000:0.0:1790740376.988294:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001030272 00000100:00100000:1.0:1790740376.988431:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001029888 00000100:00100000:1.0:1790740376.988436:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001029888 00000100:00100000:1.0:1790740376.988478:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 392 00000100:00100000:1.0:1790740376.988489:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99056850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:2402:x1877727001029888:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1790740376.988584:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99056850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:2402:x1877727001029888:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 96us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740376.988594:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 392 00000100:00100000:1.0:1790740376.988655:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001030400 00000100:00100000:1.0:1790740376.988659:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001030400 00000100:00100000:3.0:1790740376.988731:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 142 00000100:00100000:3.0:1790740376.988742:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84530e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bed19f2-4c98-4684-89e7-a6871565665d+7:2402:x1877727001030144:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740376.988780:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84530e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bed19f2-4c98-4684-89e7-a6871565665d+7:2402:x1877727001030144:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 41us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740376.988787:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 142 00000100:00100000:3.0:1790740376.988811:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001030016 00000100:00100000:3.0:1790740376.988815:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001030016 00000100:00100000:0.0:1790740376.988873:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 143 00000100:00100000:0.0:1790740376.988881:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84530a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bed19f2-4c98-4684-89e7-a6871565665d+5:2402:x1877727001030272:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1790740376.988913:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84530a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bed19f2-4c98-4684-89e7-a6871565665d+5:2402:x1877727001030272:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 34us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740376.988920:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 143 00000100:00100000:2.0:1790740376.993198:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001030528 00000100:00100000:2.0:1790740376.993218:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001030528 00000100:00080000:1.0:1790740376.996989:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790740376.997004:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790740376.997009:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790740376.998589:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 338 00000100:00100000:1.0:1790740376.998610:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2402:x1877727001030400:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1790740376.998721:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2402:x1877727001030400:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 119us (10611us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740376.998729:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 338 00000100:00100000:0.0:1790740377.005694:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 339 00000100:00100000:0.0:1790740377.005730:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84651180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2402:x1877727001030528:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1790740377.005875:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84651180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2402:x1877727001030528:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 165us (17680us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740377.005883:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 339 00000100:00100000:3.0:1790740377.007732:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 340 00000100:00100000:3.0:1790740377.007749:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+5:2402:x1877727001030016:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740377.007871:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+5:2402:x1877727001030016:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 127us (19737us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740377.007899:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 340 00010000:00010000:1.0:1790740377.075017:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740377.089462:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740377.089702:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001030656 00000100:00100000:3.0:1790740377.089716:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001030656 00000100:00100000:3.0:1790740377.090005:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 79 00000100:00100000:3.0:1790740377.090019:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bed19f2-4c98-4684-89e7-a6871565665d+7:2404:x1877727001030656:12345-192.168.204.3@tcp:101:cat.0 00000100:00080000:1.0:1790740377.090084:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790740377.090087:0:8454:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740377.090115:0:8454:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5fd727f/0xb25dda4f4e92ebcd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae24004 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790740377.090157:0:8454:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6abc8797, atime: 0x6abc8797, ctime: 0x6abc8797, blocks: 0x8 00010000:00010000:3.0:1790740377.090187:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=448s v=(0 0) 00010000:00010000:3.0:1790740377.090192:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790740377.090206:0:8454:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5fd727f/0xb25dda4f4e92ebcd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24004 expref: 8 pid: 8454 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740377.090230:0:8454:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5fd727f/0xb25dda4f4e92ebcd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24004 expref: 8 pid: 8454 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740377.090252:0:8454:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc9e00, rc 0) 00000100:00100000:2.0:1790740377.093632:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bed19f2-4c98-4684-89e7-a6871565665d+8:2404:x1877727001030656:12345-192.168.204.3@tcp:101:cat.0 Request processed in 3598us (4166us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740377.093652:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 79 00000100:00100000:3.0:1790740377.100252:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740377.100425:0:8457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001030784 00000100:00100000:2.0:1790740377.100439:0:8457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001030784 00002000:00100000:2.0:1790740377.100725:0:8457:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff98dcb81b4700 x1877727001030784/t0(0) o3->7bed19f2-4c98-4684-89e7-a6871565665d@192.168.204.3@tcp:433/0 lens 488/0 e 0 to 0 dl 1790740388 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790740377.100738:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98dcb81b4700 with x1877727001030784 ext(0->4095) 00002000:00010000:2.0:1790740377.100745:0:8457:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98dcb81b4700 00000100:00100000:2.0:1790740377.100934:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 7 00000100:00100000:2.0:1790740377.100947:0:8457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb81b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7bed19f2-4c98-4684-89e7-a6871565665d+8:2402:x1877727001030784:12345-192.168.204.3@tcp:3:cat.0 00000100:00100000:2.0:1790740377.101240:0:8457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb81b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7bed19f2-4c98-4684-89e7-a6871565665d+8:2402:x1877727001030784:12345-192.168.204.3@tcp:3:cat.0 Request processed in 294us (1104us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1790740377.101249:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 7 00002000:00100000:2.0:1790740377.101257:0:8457:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff98dcb81b4700 x1877727001030784/t0(0) o3->7bed19f2-4c98-4684-89e7-a6871565665d@192.168.204.3@tcp:433/0 lens 488/4536 e 0 to 0 dl 1790740388 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790740377.101287:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98dcb81b4700 with x1877727001030784 ext(0->4095) 00002000:00010000:2.0:1790740377.101291:0:8457:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98dcb81b4700 00000100:00100000:1.0:1790740377.194417:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790740377.194875:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db8468c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022047616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790740377.194982:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740377.195263:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5df3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3641:1877727022047744:0@lo:400:kworker.0 00000100:00100000:2.0:1790740377.195396:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740377.195549:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022047744 00000100:00100000:2.0:1790740377.195560:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022047744 00000100:00100000:2.0:1790740377.195636:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1790740377.195646:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99054450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3641:x1877727022047744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740377.195718:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99054450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3641:x1877727022047744:12345-0@lo:400:kworker.0 Request processed in 73us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740377.195727:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1790740377.196523:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790740377.196540:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb81b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022047872:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790740377.196597:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740377.196692:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb81b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877727022048000:0@lo:400:kworker.0 00000100:00100000:3.0:1790740377.196722:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740377.197016:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022047616 00000100:00100000:1.0:1790740377.197024:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022047616 00000100:00100000:1.0:1790740377.197111:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022047872 00000100:00100000:1.0:1790740377.197115:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022047872 00000100:00100000:1.0:1790740377.197132:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1790740377.197141:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022047616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790740377.197181:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790740377.197559:0:10118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1790740377.197572:0:10118:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb81b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022047872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790740377.197587:0:10118:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790740377.197680:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb81b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022048128:0@lo:400:kworker.0 00000100:00100000:1.0:1790740377.197776:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022047616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 636us (2794us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740377.197785:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:1.0:1790740377.197815:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790740377.198202:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022048000 00000100:00100000:1.0:1790740377.198227:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022048000 00000100:00100000:1.0:1790740377.198281:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1790740377.198290:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb81b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877727022048000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740377.198513:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb81b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877727022048000:12345-0@lo:400:kworker.0 Request processed in 224us (1790us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740377.198521:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1790740377.198578:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb81b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877727022048000:0@lo:400:kworker.0 00000100:00100000:1.0:1790740377.198835:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5df3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3641:1877727022047744:0@lo:400:kworker.0 00000100:00100000:1.0:1790740377.198851:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:1.0:1790740377.198857:0:3641:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:1.0:1790740377.198892:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98db845bce00, transno 4294967308 00000004:00080000:1.0:1790740377.198906:0:3641:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:1.0:1790740377.198922:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98db8468ed80, transno 4294967311 00000100:00100000:1.0:1790740377.198938:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db8468c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022047616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790740377.199206:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db8468ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877727022048256:0@lo:400:kworker.0 00000100:00100000:1.0:1790740377.199253:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740377.199290:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022048256 00000100:00100000:1.0:1790740377.199296:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022048256 00000100:00100000:1.0:1790740377.200296:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1790740377.200646:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877727022048256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740377.200732:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877727022048256:12345-0@lo:400:kworker.0 Request processed in 93us (1478us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740377.200740:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1790740377.200862:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db8468ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877727022048256:0@lo:400:kworker.0 00000100:00100000:1.0:1790740377.200931:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db8468ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022048384:0@lo:400:kworker.0 00000100:00100000:1.0:1790740377.200986:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740377.201027:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022048384 00000100:00100000:1.0:1790740377.201059:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022048384 00000100:00100000:1.0:1790740377.201247:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1790740377.201255:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022048384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740377.201297:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022048384:12345-0@lo:400:kworker.0 Request processed in 43us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740377.201376:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1790740377.201416:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db8468ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022048384:0@lo:400:kworker.0 00000100:00100000:1.0:1790740377.201596:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db8468ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1877727022048512:0@lo:400:kworker.0 00000100:00100000:1.0:1790740377.201633:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740377.201681:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790740377.201688:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db8468df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1877727022048640:0@lo:400:kworker.0 00000100:00100000:1.0:1790740377.201717:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740377.201742:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022048512 00000100:00100000:1.0:1790740377.201747:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022048512 00000100:00100000:2.0:1790740377.202067:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022048640 00000100:00100000:2.0:1790740377.202073:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022048640 00000100:00100000:2.0:1790740377.202130:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1790740377.202141:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1877727022048640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740377.202191:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1877727022048640:12345-0@lo:400:kworker.0 Request processed in 54us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740377.202199:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00080000:2.0:1790740377.202220:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1790740377.202243:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db8468df80 x1877727022048640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740377.202256:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db8468df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1877727022048640:0@lo:400:kworker.0 00000100:00100000:1.0:1790740377.202498:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1790740377.202506:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1877727022048512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740377.202718:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1877727022048512:12345-0@lo:400:kworker.0 Request processed in 212us (1082us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740377.202725:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1790740377.202771:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db8468ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1877727022048512:0@lo:400:kworker.0 00000100:00100000:1.0:1790740377.202832:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db8468f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022048896:0@lo:400:kworker.0 00000100:00100000:1.0:1790740377.203022:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790740377.203137:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790740377.203148:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db8468ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022048768:0@lo:400:kworker.0 00000100:00100000:1.0:1790740377.203441:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db8468d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1877727022049024:0@lo:400:kworker.0 00000100:00100000:1.0:1790740377.203477:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740377.203555:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022048896 00000100:00100000:1.0:1790740377.203562:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022048896 00000100:00100000:1.0:1790740377.203614:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1790740377.203622:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3638:x1877727022048896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740377.203669:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3638:x1877727022048896:12345-0@lo:400:kworker.0 Request processed in 49us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740377.203677:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:1.0:1790740377.203695:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790740377.203714:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db8468f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022048896:0@lo:400:kworker.0 00000100:00100000:2.0:1790740377.204484:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740377.204534:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790740377.204543:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db8468df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1877727022049152:0@lo:400:kworker.0 00000100:00100000:2.0:1790740377.204589:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740377.204629:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022049024 00000100:00100000:2.0:1790740377.204637:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022049024 00000100:00100000:2.0:1790740377.204686:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022049152 00000100:00100000:2.0:1790740377.204689:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022049152 00000100:00100000:2.0:1790740377.204711:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1790740377.204718:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1877727022049024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740377.204780:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1877727022049024:12345-0@lo:400:kworker.0 Request processed in 62us (1302us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740377.204787:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1790740377.204804:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1790740377.204810:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1877727022049152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740377.204842:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1877727022049152:12345-0@lo:400:kworker.0 Request processed in 32us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740377.204848:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00080000:2.0:1790740377.204863:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790740377.204867:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1790740377.204898:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db8468df80 x1877727022049152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740377.204912:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db8468df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1877727022049152:0@lo:400:kworker.0 00000100:00100000:0.0:1790740377.205165:0:10118:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb81b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022047872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 7590us (8559us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740377.205175:0:10118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1790740377.205426:0:14497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022048768 00000100:00100000:1.0:1790740377.205432:0:14497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022048768 00000100:00100000:1.0:1790740377.205485:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1790740377.205493:0:14497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022048768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740377.205540:0:14497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022048768:12345-0@lo:400:kworker.0 Request processed in 48us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740377.205546:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1790740377.205582:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db8468d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1877727022049024:0@lo:400:kworker.0 00000100:00100000:1.0:1790740377.205607:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb81b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022047872:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1790740377.206677:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790740377.206738:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db8468ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022048768:0@lo:400:kworker.0 00000100:00100000:3.0:1790740377.207406:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740377.207672:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022048128 00000100:00100000:1.0:1790740377.207682:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022048128 00000100:00100000:1.0:1790740377.207861:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1790740377.207874:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb81b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022048128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740377.207958:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb81b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022048128:12345-0@lo:400:kworker.0 Request processed in 86us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740377.207989:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1790740377.208089:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb81b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022048128:0@lo:400:kworker.0 00010000:00010000:2.0:1790740378.091899:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740378.220071:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84652680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022049280:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790740378.226440:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740378.226883:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022049280 00000100:00100000:1.0:1790740378.226906:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022049280 00000100:00100000:1.0:1790740378.226969:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1790740378.226980:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022049280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790740378.227066:0:7846:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790740378.227403:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022049280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 424us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740378.227412:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1790740378.227570:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84652680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022049280:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1790740379.114277:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740380.138915:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740380.269004:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790740380.269064:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84652d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022049408:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790740380.269174:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740380.271976:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022049408 00000100:00100000:2.0:1790740380.271999:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022049408 00000100:00100000:2.0:1790740380.272115:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1790740380.272129:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84651f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022049408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790740380.272188:0:6540:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1790740380.273675:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84651f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022049408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1542us (4493us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740380.273689:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1790740380.278004:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84652d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022049408:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790740380.778567:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790740380.778598:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db8468f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022049536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790740380.778693:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740380.778784:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022049536 00000100:00100000:1.0:1790740380.778793:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022049536 00000100:00100000:1.0:1790740380.778859:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1790740380.778870:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1877727022049536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790740380.778907:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1790740380.778955:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1877727022049536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740380.778962:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1790740380.779020:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db8468f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022049536:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790740380.779154:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790740380.779353:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84652d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022049664:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790740380.779395:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740380.779459:0:10118:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022049664 00000100:00100000:0.0:1790740380.779464:0:10118:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022049664 00000100:00100000:0.0:1790740380.779499:0:10118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1790740380.779506:0:10118:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022049664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790740380.779520:0:10118:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1790740380.786624:0:10118:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022049664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 7103us (7212us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740380.786643:0:10118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:3.0:1790740380.789228:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790740380.804660:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84652d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022049664:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1790740381.164550:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790740381.808689:0:8446:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:1.0:1790740381.808710:0:8446:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:2.0:1790740381.809092:0:6514:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:2.0:1790740381.809142:0:6514:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98db83ce4b40 refcount 2 committed 0 result 0 batchid 8 00010000:00010000:1.0:1790740381.809144:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92eb48 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1790740381.809150:0:6514:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98db83c97800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98db83ce40c0 00000020:00080000:2.0:1790740381.809154:0:6514:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98db83c97a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98db844c5a00 00010000:00010000:1.0:1790740381.809175:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92eb48 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740381.809185:0:3624:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92eb48 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1790740381.809186:0:6514:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:1.0:1790740381.809201:0:3624:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc44400 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740381.809207:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92eb48 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740381.809217:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92eb48 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1790740381.809226:0:6567:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00010000:00010000:1.0:1790740381.809239:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98dc985be700) 00010000:00010000:1.0:1790740381.809245:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740381.809251:0:3624:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92eb48 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740381.809259:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44400/0xb25dda4f4e92eb48 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1790740381.809331:0:6567:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:2.0:1790740382.109975:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740382.110027:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740382.110257:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740382.110289:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740382.110350:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001030912 00000100:00100000:2.0:1790740382.110362:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001030912 00000100:00100000:2.0:1790740382.110429:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 394 00000100:00100000:2.0:1790740382.110440:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99057450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:2403:x1877727001030912:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1790740382.110546:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99057450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:2403:x1877727001030912:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 107us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740382.110555:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 394 00000100:00100000:2.0:1790740382.110596:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001031168 00000100:00100000:2.0:1790740382.110600:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001031168 00000100:00100000:2.0:1790740382.110644:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001031040 00000100:00100000:2.0:1790740382.110648:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001031040 00000100:00100000:2.0:1790740382.110673:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 347 00000100:00100000:2.0:1790740382.110680:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+5:2403:x1877727001031168:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1790740382.110799:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+5:2403:x1877727001031168:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 42us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740382.110808:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 347 00000100:00100000:2.0:1790740382.110822:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 348 00000100:00100000:2.0:1790740382.111052:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+18:2403:x1877727001031040:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1790740382.111089:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7bed19f2-4c98-4684-89e7-a6871565665d+18:2403:x1877727001031040:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 261us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740382.111096:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 348 00000100:00100000:2.0:1790740382.111126:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001031296 00000100:00100000:2.0:1790740382.111131:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001031296 00000100:00100000:2.0:1790740382.111168:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 146 00000100:00100000:2.0:1790740382.111175:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bed19f2-4c98-4684-89e7-a6871565665d+7:2403:x1877727001031296:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1790740382.111210:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7bed19f2-4c98-4684-89e7-a6871565665d+7:2403:x1877727001031296:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 36us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740382.111217:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 146 00000100:00100000:2.0:1790740382.117130:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740382.117271:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740382.117346:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740382.117678:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001031424 00000100:00100000:2.0:1790740382.117703:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001031424 00000100:00100000:0.0:1790740382.117721:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001031552 00000100:00100000:0.0:1790740382.117737:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001031552 00000100:00100000:0.0:1790740382.117814:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001031680 00000100:00100000:0.0:1790740382.117818:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001031680 00000100:00100000:2.0:1790740382.118014:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 147 00000100:00100000:2.0:1790740382.118050:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7bed19f2-4c98-4684-89e7-a6871565665d+5:2402:x1877727001031424:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1790740382.118149:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7bed19f2-4c98-4684-89e7-a6871565665d+5:2402:x1877727001031424:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 124us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740382.118158:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 147 00000100:00100000:2.0:1790740382.118198:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 349 00000100:00100000:2.0:1790740382.118207:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2402:x1877727001031552:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1790740382.118241:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2402:x1877727001031552:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 36us (1126us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740382.118248:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 349 00000100:00100000:0.0:1790740382.121679:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 350 00000100:00100000:0.0:1790740382.121706:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2402:x1877727001031680:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1790740382.121826:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2402:x1877727001031680:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 132us (4478us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740382.121837:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 350 00000100:00080000:2.0:1790740382.122175:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790740382.122187:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790740382.122192:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790740382.122196:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1790740382.188443:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740382.314983:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db8468f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022049792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790740382.315116:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740382.315369:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790740382.315381:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb81b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022049920:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790740382.315426:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740382.315947:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84653800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877727022050176:0@lo:400:kworker.0 00000100:00100000:0.0:1790740382.315993:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740382.316020:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84652680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1877727022050688:0@lo:400:kworker.0 00000100:00100000:0.0:1790740382.316065:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740382.316090:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83eea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1877727022051200:0@lo:400:kworker.0 00000100:00100000:0.0:1790740382.316111:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740382.316136:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1790740382.316141:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84650380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022050304:0@lo:400:kworker.0 00000100:00100000:0.0:1790740382.316168:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740382.316185:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84650e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1877727022050816:0@lo:400:kworker.0 00000100:00100000:0.0:1790740382.316206:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740382.316222:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83eeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1877727022051328:0@lo:400:kworker.0 00000100:00100000:0.0:1790740382.316243:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740382.316271:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022050176 00000100:00100000:0.0:1790740382.316281:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022050176 00000100:00100000:0.0:1790740382.316344:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022050688 00000100:00100000:0.0:1790740382.316348:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022050688 00000100:00100000:0.0:1790740382.316376:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022051200 00000100:00100000:0.0:1790740382.316379:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022051200 00000100:00100000:0.0:1790740382.316396:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022050816 00000100:00100000:0.0:1790740382.316399:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022050816 00000100:00100000:0.0:1790740382.316604:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022051328 00000100:00100000:0.0:1790740382.316607:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022051328 00000100:00100000:0.0:1790740382.316626:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1790740382.316636:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ee8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877727022050176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740382.316755:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ee8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877727022050176:12345-0@lo:400:kworker.0 Request processed in 119us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740382.316763:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1790740382.316782:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1790740382.316789:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877727022050688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740382.316816:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877727022050688:12345-0@lo:400:kworker.0 Request processed in 28us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740382.316822:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1790740382.316833:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1790740382.316839:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877727022051200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740382.316861:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877727022051200:12345-0@lo:400:kworker.0 Request processed in 23us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740382.316867:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1790740382.316877:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1790740382.316882:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877727022050816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740382.316905:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877727022050816:12345-0@lo:400:kworker.0 Request processed in 23us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740382.316911:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1790740382.316923:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1790740382.316929:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877727022051328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740382.316955:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877727022051328:12345-0@lo:400:kworker.0 Request processed in 27us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740382.316970:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00080000:0.0:1790740382.317009:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790740382.317014:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790740382.317026:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84651880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877727022050432:0@lo:400:kworker.0 00000100:00100000:0.0:1790740382.317079:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740382.317100:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ee8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022050944:0@lo:400:kworker.0 00000100:00100000:0.0:1790740382.317123:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740382.317143:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1790740382.317149:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84652300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727022050048:0@lo:400:kworker.0 00000100:00100000:0.0:1790740382.317176:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740382.317203:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84652d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022050560:0@lo:400:kworker.0 00000100:00100000:0.0:1790740382.317223:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740382.317239:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ee8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022051072:0@lo:400:kworker.0 00000100:00100000:0.0:1790740382.317257:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740382.317282:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022050944 00000100:00100000:0.0:1790740382.317287:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022050944 00000100:00100000:0.0:1790740382.317334:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022051072 00000100:00100000:0.0:1790740382.317337:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022051072 00000100:00100000:0.0:1790740382.317357:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1790740382.317364:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022050944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740382.317399:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022050944:12345-0@lo:400:kworker.0 Request processed in 36us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740382.317405:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1790740382.320668:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1790740382.320695:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ee9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022051072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740382.320835:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ee9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022051072:12345-0@lo:400:kworker.0 Request processed in 152us (3576us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740382.320845:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1790740382.320891:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022050304 00000100:00100000:0.0:1790740382.320900:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022050304 00000100:00100000:0.0:1790740382.320951:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022050560 00000100:00100000:0.0:1790740382.320954:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022050560 00000100:00100000:0.0:1790740382.320968:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1790740382.320974:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022050304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740382.321011:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022050304:12345-0@lo:400:kworker.0 Request processed in 38us (4842us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740382.321018:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1790740382.321028:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1790740382.321049:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022050560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740382.321079:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022050560:12345-0@lo:400:kworker.0 Request processed in 31us (3856us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740382.321085:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1790740382.322420:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022049792 00000100:00100000:1.0:1790740382.322430:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022049792 00000100:00100000:1.0:1790740382.322484:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022049920 00000100:00100000:1.0:1790740382.322487:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022049920 00000100:00100000:1.0:1790740382.322503:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1790740382.322511:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022049792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790740382.322545:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790740382.322619:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022049792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (7503us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740382.322641:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1790740382.322659:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1790740382.322665:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb81b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022049920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790740382.322679:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790740382.322710:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb81b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022049920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (7295us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740382.322716:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1790740382.322789:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb81b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022049920:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1790740382.322853:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790740382.322859:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790740382.322886:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db8468f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022049792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790740382.322909:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022050432 00000100:00100000:1.0:1790740382.322913:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022050432 00000100:00100000:1.0:1790740382.322951:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1790740382.322958:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877727022050432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740382.322996:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877727022050432:12345-0@lo:400:kworker.0 Request processed in 39us (5917us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740382.323003:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1790740382.323075:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84652d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022050560:0@lo:400:kworker.0 00000100:00100000:1.0:1790740382.323087:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:1.0:1790740382.323093:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98db84651500, transno 4294967323 00000004:00080000:1.0:1790740382.323112:0:3638:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:1.0:1790740382.323132:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ee8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022051072:0@lo:400:kworker.0 00000100:00100000:1.0:1790740382.323145:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84651880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877727022050432:0@lo:400:kworker.0 00000100:00100000:1.0:1790740382.323170:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ee8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022050944:0@lo:400:kworker.0 00000100:00100000:2.0:1790740382.323732:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84653800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877727022050176:0@lo:400:kworker.0 00000100:00100000:2.0:1790740382.323884:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022050048 00000100:00100000:2.0:1790740382.323890:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022050048 00000100:00100000:2.0:1790740382.323981:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:2.0:1790740382.323989:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99056c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3638:x1877727022050048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740382.324086:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99056c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3638:x1877727022050048:12345-0@lo:400:kworker.0 Request processed in 98us (6909us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740382.324094:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:0.0:1790740382.327317:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84652300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727022050048:0@lo:400:kworker.0 00000100:00100000:2.0:1790740382.328735:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84652680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1877727022050688:0@lo:400:kworker.0 00000100:00100000:2.0:1790740382.328758:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83eea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1877727022051200:0@lo:400:kworker.0 00000100:00100000:2.0:1790740382.328807:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84650380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022050304:0@lo:400:kworker.0 00010000:00080000:2.0:1790740382.328825:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db84650e00 x1877727022050816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740382.328837:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84650e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1877727022050816:0@lo:400:kworker.0 00010000:00080000:2.0:1790740382.328852:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83eeb480 x1877727022051328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740382.328860:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83eeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1877727022051328:0@lo:400:kworker.0 00000100:00100000:2.0:1790740382.553007:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740382.553079:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001031808 00000100:00100000:0.0:1790740382.553092:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001031808 00000100:00100000:0.0:1790740382.553179:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 254 00000100:00100000:0.0:1790740382.553191:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+18:12161:x1877727001031808:12345-192.168.204.3@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1790740382.553355:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7bed19f2-4c98-4684-89e7-a6871565665d+18:12161:x1877727001031808:12345-192.168.204.3@tcp:60:lhsmtool_posix.0 Request processed in 166us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740382.553371:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 254 00000100:00100000:3.0:1790740382.556870:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740382.556938:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001031936 00000100:00100000:0.0:1790740382.556952:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001031936 00000100:00100000:0.0:1790740382.557027:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 255 00000100:00100000:0.0:1790740382.557078:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb81b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+5:12161:x1877727001031936:12345-192.168.204.3@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1790740382.557209:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb81b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+5:12161:x1877727001031936:12345-192.168.204.3@tcp:60:lhsmtool_posix.0 Request processed in 134us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740382.557217:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 255 00000100:00100000:2.0:1790740382.562747:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740382.562864:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001032192 00000100:00100000:0.0:1790740382.562877:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001032192 00000100:00100000:0.0:1790740382.564528:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 65 00000100:00100000:3.0:1790740382.564539:0:6538:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:3.0:1790740382.564551:0:6538:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:0.0:1790740382.565199:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+18:12161:x1877727001032192:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1790740382.566520:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+19:12161:x1877727001032192:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 Request processed in 1967us (3779us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1790740382.566534:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 65 00010000:00010000:0.0:1790740383.211384:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740383.338563:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb81b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022051456:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790740383.338678:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740383.338846:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022051456 00000100:00100000:2.0:1790740383.338857:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022051456 00000100:00100000:2.0:1790740383.338920:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1790740383.338930:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022051456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790740383.338977:0:6541:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790740383.339062:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022051456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 132us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740383.339070:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1790740383.339192:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb81b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022051456:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1790740384.239074:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790740384.731103:0:14980:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 23:53:03 (1790740383) 00010000:00010000:1.0:1790740385.259898:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740385.386361:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ee9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022051584:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790740385.386463:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740385.386628:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022051584 00000100:00100000:0.0:1790740385.386638:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022051584 00000100:00100000:0.0:1790740385.386711:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1790740385.386723:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022051584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790740385.386775:0:6540:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1790740385.386842:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022051584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 121us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740385.386851:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1790740385.386957:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ee9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022051584:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790740385.900518:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022051712:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790740385.900617:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740385.900876:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022051712 00000100:00100000:1.0:1790740385.900887:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022051712 00000100:00100000:1.0:1790740385.900957:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1790740385.900969:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022051712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790740385.901014:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1790740385.901103:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022051712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 136us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740385.901112:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:1.0:1790740385.901140:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790740385.901188:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022051712:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790740385.901387:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022051840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790740385.901420:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740385.901495:0:10118:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022051840 00000100:00100000:2.0:1790740385.901500:0:10118:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022051840 00000100:00100000:2.0:1790740385.901546:0:10118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1790740385.901552:0:10118:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022051840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790740385.901564:0:10118:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1790740385.901597:0:10118:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022051840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740385.901603:0:10118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:1.0:1790740385.901658:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790740385.901682:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022051840:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790740386.284237:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790740386.604772:0:13823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1790740386.980323:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740386.980446:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001032320 00000100:00100000:0.0:1790740386.980457:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001032320 00000100:00100000:0.0:1790740386.980543:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 256 00000100:00100000:0.0:1790740386.980554:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188ca3f-be2e-4a39-97db-9401a3b70751+5:13172:x1877727001032320:12345-192.168.204.3@tcp:101:lsof.0 00010000:00010000:0.0:1790740386.980580:0:6535:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740386.980603:0:6535:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2e00/0xb25dda4f4e92ebd4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae2400b expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740386.980689:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2800/0xb25dda4f4e92ebdb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740386.980706:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2800/0xb25dda4f4e92ebdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740386.980722:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2800/0xb25dda4f4e92ebdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790740386.980796:0:6535:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790740386.980800:0:6535:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790740386.980848:0:6535:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2800/0xb25dda4f4e92ebdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740386.980872:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2e00/0xb25dda4f4e92ebd4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae2400b expref: 7 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740386.980893:0:6535:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2800/0xb25dda4f4e92ebdb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae2400b expref: 6 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740386.980901:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98dc985be400) 00010000:00010000:0.0:1790740386.980918:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790740386.980922:0:6535:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaeee2800, rc 0) 00000100:00100000:0.0:1790740386.980982:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188ca3f-be2e-4a39-97db-9401a3b70751+6:13172:x1877727001032320:12345-192.168.204.3@tcp:101:lsof.0 Request processed in 429us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740386.980989:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 256 00000100:00080000:2.0:1790740386.981190:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1790740386.986196:0:13821:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790740386.986217:0:13821:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790740386.986324:0:13821:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:0.0:1790740386.986331:0:13821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1790740386.987947:0:6514:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:2.0:1790740386.987962:0:6514:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1790740386.988064:0:6567:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1790740386.988079:0:6567:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:3.0:1790740387.226638:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740387.226681:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740387.226704:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740387.226726:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740387.226749:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740387.226767:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740387.226793:0:14497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001032960 00000100:00100000:3.0:1790740387.226802:0:14497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001032960 00000100:00100000:3.0:1790740387.226852:0:14497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001032832 00000100:00100000:3.0:1790740387.226855:0:14497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001032832 00000100:00100000:3.0:1790740387.226879:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 150 00000100:00100000:3.0:1790740387.226889:0:14497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7bed19f2-4c98-4684-89e7-a6871565665d+5:2405:x1877727001032960:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740387.226982:0:14497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7bed19f2-4c98-4684-89e7-a6871565665d+5:2405:x1877727001032960:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 92us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740387.226990:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 150 00000100:00100000:3.0:1790740387.227004:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 151 00000100:00100000:3.0:1790740387.227009:0:14497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7bed19f2-4c98-4684-89e7-a6871565665d+7:2404:x1877727001032832:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740387.227065:0:14497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7bed19f2-4c98-4684-89e7-a6871565665d+7:2404:x1877727001032832:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 55us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740387.227071:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 151 00000100:00080000:3.0:1790740387.227085:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790740387.227088:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790740387.227301:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001032576 00000100:00100000:1.0:1790740387.227306:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001032576 00000100:00100000:1.0:1790740387.227346:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001032704 00000100:00100000:1.0:1790740387.227349:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001032704 00000100:00100000:1.0:1790740387.227363:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001033088 00000100:00100000:1.0:1790740387.227365:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001033088 00000100:00100000:1.0:1790740387.227379:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 357 00000100:00100000:1.0:1790740387.227385:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb81b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+18:2404:x1877727001032576:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1790740387.227428:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb81b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+18:2404:x1877727001032576:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 43us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740387.227435:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 357 00000100:00100000:1.0:1790740387.227450:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 358 00000100:00100000:1.0:1790740387.227456:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb81b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+5:2405:x1877727001032704:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1790740387.227479:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb81b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7bed19f2-4c98-4684-89e7-a6871565665d+5:2405:x1877727001032704:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 24us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740387.227485:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 358 00000100:00100000:1.0:1790740387.227495:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 359 00000100:00100000:1.0:1790740387.227501:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2404:x1877727001033088:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1790740387.227524:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2404:x1877727001033088:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 23us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740387.227530:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 359 00000100:00080000:3.0:1790740387.227861:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790740387.227865:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790740387.227928:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001032448 00000100:00100000:2.0:1790740387.227933:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001032448 00000100:00100000:2.0:1790740387.227967:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 396 00000100:00100000:2.0:1790740387.227973:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99057050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:2405:x1877727001032448:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1790740387.227998:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99057050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:160ca934-a0b3-4cb3-b255-c8d008823f6f+13:2405:x1877727001032448:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 26us (1317us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740387.228004:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 396 00010000:00010000:2.0:1790740387.306459:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740387.434564:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db845bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022052096:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790740387.434758:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db8468df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022051968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790740387.434809:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740387.435278:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740387.435387:0:10118:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022051968 00000100:00100000:3.0:1790740387.435396:0:10118:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022051968 00000100:00100000:3.0:1790740387.435455:0:10118:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022052096 00000100:00100000:3.0:1790740387.435459:0:10118:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022052096 00000100:00100000:3.0:1790740387.435477:0:10118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1790740387.435486:0:10118:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022051968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790740387.435519:0:10118:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790740387.435572:0:10118:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022051968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740387.435580:0:10118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1790740387.435596:0:10118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1790740387.435602:0:10118:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022052096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790740387.435611:0:10118:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790740387.435660:0:10118:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022052096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740387.435676:0:10118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1790740387.436019:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db8468df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022051968:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1790740387.436138:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790740387.436302:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db845bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022052096:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790740387.437850:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84650380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022052480:0@lo:400:kworker.0 00000100:00100000:0.0:1790740387.437916:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740387.437956:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84651500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1877727022052992:0@lo:400:kworker.0 00000100:00100000:0.0:1790740387.437981:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740387.438007:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84524380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1877727022053504:0@lo:400:kworker.0 00000100:00100000:3.0:1790740387.438027:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84650e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877727022052352:0@lo:400:kworker.0 00000100:00100000:0.0:1790740387.438028:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740387.438075:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1790740387.438080:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84652680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877727022052608:0@lo:400:kworker.0 00000100:00100000:3.0:1790740387.438086:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740387.438102:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740387.438105:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84652300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1877727022052864:0@lo:400:kworker.0 00000100:00100000:0.0:1790740387.438116:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84651880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022053120:0@lo:400:kworker.0 00000100:00100000:3.0:1790740387.438136:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740387.438137:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740387.438224:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db8468df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727022052224:0@lo:400:kworker.0 00000100:00100000:2.0:1790740387.438260:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740387.438283:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84653800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022052736:0@lo:400:kworker.0 00000100:00100000:3.0:1790740387.438297:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1877727022053376:0@lo:400:kworker.0 00000100:00100000:2.0:1790740387.438303:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740387.438317:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740387.438319:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84652d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022053248:0@lo:400:kworker.0 00000100:00100000:1.0:1790740387.438368:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022052480 00000100:00100000:1.0:1790740387.438376:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022052480 00000100:00100000:1.0:1790740387.438428:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022052736 00000100:00100000:1.0:1790740387.438431:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022052736 00000100:00100000:1.0:1790740387.438448:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1790740387.438456:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ee9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022052480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740387.438511:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ee9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022052480:12345-0@lo:400:kworker.0 Request processed in 56us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740387.438518:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1790740387.438548:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1790740387.438555:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727022052736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740387.438582:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727022052736:12345-0@lo:400:kworker.0 Request processed in 28us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740387.438600:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1790740387.438653:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740387.438687:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84653800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022052736:0@lo:400:kworker.0 00000100:00100000:2.0:1790740387.438713:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022053120 00000100:00100000:2.0:1790740387.438716:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022053120 00000100:00100000:2.0:1790740387.438749:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022053248 00000100:00100000:2.0:1790740387.438752:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022053248 00000100:00100000:2.0:1790740387.438768:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1790740387.438774:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022053120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740387.438804:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022053120:12345-0@lo:400:kworker.0 Request processed in 30us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740387.438809:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1790740387.438821:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1790740387.438826:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727022053248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740387.438854:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727022053248:12345-0@lo:400:kworker.0 Request processed in 28us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740387.438860:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1790740387.438877:0:6528:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022052224 00000100:00100000:2.0:1790740387.438887:0:6528:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022052224 00000100:00100000:2.0:1790740387.438910:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1790740387.438916:0:6528:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99055050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3640:x1877727022052224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740387.438963:0:6528:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99055050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3640:x1877727022052224:12345-0@lo:400:kworker.0 Request processed in 48us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740387.438970:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00080000:2.0:1790740387.439008:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790740387.439049:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db8468df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727022052224:0@lo:400:kworker.0 00000100:00100000:2.0:1790740387.439062:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84652d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022053248:0@lo:400:kworker.0 00000100:00100000:0.0:1790740387.452258:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022052992 00000100:00100000:0.0:1790740387.454792:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022052992 00000100:00100000:0.0:1790740387.454886:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022053504 00000100:00100000:0.0:1790740387.454891:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022053504 00000100:00100000:0.0:1790740387.454907:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022052352 00000100:00100000:0.0:1790740387.454910:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022052352 00000100:00100000:0.0:1790740387.454921:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022052608 00000100:00100000:0.0:1790740387.454923:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022052608 00000100:00100000:0.0:1790740387.454934:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022052864 00000100:00100000:0.0:1790740387.454936:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022052864 00000100:00100000:0.0:1790740387.454947:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022053376 00000100:00100000:0.0:1790740387.454949:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022053376 00000100:00100000:0.0:1790740387.454966:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1790740387.454976:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877727022052992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740387.455087:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877727022052992:12345-0@lo:400:kworker.0 Request processed in 113us (17105us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740387.455094:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1790740387.455950:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1790740387.455962:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ee9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877727022053504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740387.456010:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ee9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877727022053504:12345-0@lo:400:kworker.0 Request processed in 53us (17981us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740387.456016:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1790740387.456053:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1790740387.456059:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877727022052352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740387.456102:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877727022052352:12345-0@lo:400:kworker.0 Request processed in 44us (18015us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740387.456122:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1790740387.456135:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1790740387.456555:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877727022052608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740387.456592:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877727022052608:12345-0@lo:400:kworker.0 Request processed in 452us (18490us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740387.456610:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1790740387.456626:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1790740387.456633:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1877727022052864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740387.456675:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1877727022052864:12345-0@lo:400:kworker.0 Request processed in 44us (18538us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740387.456681:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1790740387.456693:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1790740387.456700:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1877727022053376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740387.456728:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1877727022053376:12345-0@lo:400:kworker.0 Request processed in 29us (18411us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740387.456734:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00080000:0.0:1790740387.456762:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790740387.456767:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790740387.456806:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84650e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877727022052352:0@lo:400:kworker.0 00000100:00100000:0.0:1790740387.456820:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84652300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1877727022052864:0@lo:400:kworker.0 00000100:00100000:0.0:1790740387.456829:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1877727022053376:0@lo:400:kworker.0 00000100:00100000:0.0:1790740387.456975:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84652680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877727022052608:0@lo:400:kworker.0 00000100:00100000:0.0:1790740387.456987:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84651880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022053120:0@lo:400:kworker.0 00000100:00100000:0.0:1790740387.456999:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84650380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022052480:0@lo:400:kworker.0 00010000:00080000:0.0:1790740387.457013:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db84651500 x1877727022052992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740387.457024:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84651500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1877727022052992:0@lo:400:kworker.0 00010000:00080000:0.0:1790740387.457071:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db84524380 x1877727022053504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740387.457080:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84524380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1877727022053504:0@lo:400:kworker.0 00010000:00010000:1.0:1790740388.330326:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740388.458354:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790740388.458377:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db845be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022053632:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790740388.458457:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740388.458539:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022053632 00000100:00100000:1.0:1790740388.458546:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022053632 00000100:00100000:1.0:1790740388.458591:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1790740388.458600:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022053632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790740388.458640:0:7846:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790740388.458687:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022053632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740388.458706:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1790740388.458753:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db845be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022053632:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790740388.851522:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740388.851615:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001033344 00000100:00100000:3.0:1790740388.851625:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001033344 00000100:00100000:3.0:1790740388.851693:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 66 00000100:00100000:3.0:1790740388.851705:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+18:13173:x1877727001033344:12345-192.168.204.3@tcp:35:umount.0 00000100:00100000:3.0:1790740388.851986:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+19:13173:x1877727001033344:12345-192.168.204.3@tcp:35:umount.0 Request processed in 285us (473us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1790740388.851995:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 66 00000100:00100000:2.0:1790740388.858511:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740388.858628:0:6539:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001033600 00000100:00100000:0.0:1790740388.858639:0:6539:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001033600 00000100:00100000:0.0:1790740388.858696:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 67 00000100:00100000:0.0:1790740388.858718:0:6539:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+19:13173:x1877727001033600:12345-192.168.204.3@tcp:35:umount.0 00000100:00100000:0.0:1790740388.859097:0:6539:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7bed19f2-4c98-4684-89e7-a6871565665d+20:13173:x1877727001033600:12345-192.168.204.3@tcp:35:umount.0 Request processed in 380us (594us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1790740388.859106:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 67 00000100:00100000:2.0:1790740388.867007:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740388.867214:0:14942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001033856 00000100:00100000:0.0:1790740388.867225:0:14942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001033856 00000100:00100000:0.0:1790740388.867439:0:14942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 68 00000100:00100000:0.0:1790740388.867452:0:14942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc9925f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7bed19f2-4c98-4684-89e7-a6871565665d+20:13173:x1877727001033856:12345-192.168.204.3@tcp:35:umount.0 00000100:00100000:0.0:1790740388.867856:0:14942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc9925f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7bed19f2-4c98-4684-89e7-a6871565665d+21:13173:x1877727001033856:12345-192.168.204.3@tcp:35:umount.0 Request processed in 405us (858us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1790740388.867866:0:14942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 68 00000100:00100000:2.0:1790740388.883077:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740388.883431:0:6538:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001034112 00000100:00100000:3.0:1790740388.883441:0:6538:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001034112 00000100:00100000:3.0:1790740388.883490:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 69 00000100:00100000:3.0:1790740388.883498:0:6538:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+21:13173:x1877727001034112:12345-192.168.204.3@tcp:35:umount.0 00000100:00100000:3.0:1790740388.883785:0:6538:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7bed19f2-4c98-4684-89e7-a6871565665d+22:13173:x1877727001034112:12345-192.168.204.3@tcp:35:umount.0 Request processed in 285us (716us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1790740388.883793:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 69 00000100:00100000:3.0:1790740388.892947:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740388.892997:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740388.893094:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001034240 00000100:00100000:1.0:1790740388.893105:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001034240 00000100:00100000:0.0:1790740388.893117:0:10416:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001034496 00000100:00100000:0.0:1790740388.893123:0:10416:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001034496 00000100:00100000:1.0:1790740388.893176:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 20 00000100:00100000:1.0:1790740388.893189:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:160ca934-a0b3-4cb3-b255-c8d008823f6f+14:2405:x1877727001034240:12345-192.168.204.3@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1790740388.893191:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 21 00010000:00010000:1.0:1790740388.893210:0:6522:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790740388.893211:0:6521:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:160ca934-a0b3-4cb3-b255-c8d008823f6f+14:2405:x1877727001034496:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790740388.893223:0:6521:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740388.893234:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dc81489a00/0xb25dda4f4e92dbc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23b65 expref: 14 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740388.893238:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcaf061600/0xb25dda4f4e92de13 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c3e expref: 14 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740388.893264:0:6521:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790740388.893264:0:6522:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740388.893330:0:6521:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:160ca934-a0b3-4cb3-b255-c8d008823f6f+12:2405:x1877727001034496:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 128us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740388.895941:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:160ca934-a0b3-4cb3-b255-c8d008823f6f+12:2405:x1877727001034240:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 2742us (2991us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740388.895957:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 20 00000100:00100000:2.0:1790740388.900261:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 21 00000100:00100000:3.0:1790740388.914913:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740388.915005:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740388.915021:0:6520:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001034368 00000100:00100000:1.0:1790740388.915053:0:6520:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001034368 00000100:00100000:1.0:1790740388.915119:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 22 00000100:00100000:1.0:1790740388.915129:0:6520:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:160ca934-a0b3-4cb3-b255-c8d008823f6f+11:2404:x1877727001034368:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740388.915146:0:6520:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740388.915177:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcaeee3000/0xb25dda4f4e92db03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23b26 expref: 11 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740388.915194:0:6520:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740388.915243:0:6520:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:160ca934-a0b3-4cb3-b255-c8d008823f6f+10:2404:x1877727001034368:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 115us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740388.915251:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 22 00000100:00100000:2.0:1790740388.921051:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001034624 00000100:00100000:2.0:1790740388.921067:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001034624 00000100:00100000:2.0:1790740388.921139:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 80 00000100:00100000:2.0:1790740388.921176:0:8453:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bed19f2-4c98-4684-89e7-a6871565665d+5:2401:x1877727001034624:12345-192.168.204.3@tcp:9:umount.0 00000020:00000080:2.0:1790740388.921209:0:8453:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92dede 00000100:00080000:2.0:1790740388.921219:0:8453:0:(import.c:65:import_set_state_nolock()) ffff98db83e04000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790740388.921273:0:8453:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1790740388.921449:0:8453:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7bed19f2-4c98-4684-89e7-a6871565665d+2:2401:x1877727001034624:12345-192.168.204.3@tcp:9:umount.0 Request processed in 286us (6443us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740388.921457:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 80 00010000:00010000:1.0:1790740388.921604:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740388.941428:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740388.941541:0:8451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001035008 00000100:00100000:2.0:1790740388.941551:0:8451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001035008 00000100:00100000:2.0:1790740388.941625:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 81 00000100:00100000:2.0:1790740388.941635:0:8451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bed19f2-4c98-4684-89e7-a6871565665d+7:2401:x1877727001035008:12345-192.168.204.3@tcp:9:umount.0 00000020:00000080:2.0:1790740388.941667:0:8451:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92e154 00000020:00010000:2.0:1790740388.941673:0:8451:0:(genops.c:1920:obd_stale_export_put()) Put export ffff98db844e7000: total 0 00000100:00080000:2.0:1790740388.941678:0:8451:0:(import.c:65:import_set_state_nolock()) ffff98db844e3000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790740388.941730:0:8451:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1790740388.941999:0:8451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7bed19f2-4c98-4684-89e7-a6871565665d+5:2401:x1877727001035008:12345-192.168.204.3@tcp:9:umount.0 Request processed in 364us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740388.942007:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 81 00000020:00010000:3.0:1790740388.942131:0:10357:0:(genops.c:1906:obd_stale_export_get()) Get export ffff98db844e7000: total 0 00010000:00010000:3.0:1790740388.942194:0:10357:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98db844e7000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1790740388.942244:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be556e7d/0xb25dda4f4e92e50c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e28 expref: 4 pid: 8454 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740388.942274:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5fd727f/0xb25dda4f4e92ebcd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24004 expref: 3 pid: 8454 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740388.942287:0:10357:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98db844e7000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1790740388.942298:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740388.942300:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740388.942302:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740388.956214:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740388.956321:0:6537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001036032 00000100:00100000:0.0:1790740388.956331:0:6537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001036032 00000100:00100000:0.0:1790740388.956397:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 257 00000100:00100000:0.0:1790740388.956407:0:6537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+22:2401:x1877727001036032:12345-192.168.204.3@tcp:39:umount.0 00000020:00000080:0.0:1790740388.956440:0:6537:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92db11 00000020:00010000:0.0:1790740388.956455:0:6537:0:(genops.c:1920:obd_stale_export_put()) Put export ffff98db83e49800: total 0 00000100:00080000:0.0:1790740388.956473:0:6537:0:(import.c:65:import_set_state_nolock()) ffff98db83e4a800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790740388.956506:0:6537:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:0.0:1790740388.956670:0:6537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7bed19f2-4c98-4684-89e7-a6871565665d+21:2401:x1877727001036032:12345-192.168.204.3@tcp:39:umount.0 Request processed in 263us (466us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1790740388.956678:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 257 00000020:00010000:1.0:1790740388.956799:0:6524:0:(genops.c:1906:obd_stale_export_get()) Get export ffff98db83e49800: total 0 00010000:00010000:1.0:1790740388.956848:0:6524:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98db83e49800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1790740388.956896:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98dc985be500) 00010000:00010000:1.0:1790740388.956900:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790740388.956908:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44600/0xb25dda4f4e92de3d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c4c expref: 20 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740388.956933:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98dcaf04c000) 00010000:00010000:1.0:1790740388.956936:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790740388.956940:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44e00/0xb25dda4f4e92eaae lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fb7 expref: 19 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740388.956953:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98dcaec70600) 00010000:00010000:1.0:1790740388.956955:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790740388.956959:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92e3ed lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ddb expref: 18 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740388.956984:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98dcaec70300) 00010000:00010000:1.0:1790740388.956987:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1790740388.956990:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33800/0xb25dda4f4e92deb4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c68 expref: 17 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740388.957003:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98dc887e4800) 00010000:00010000:1.0:1790740388.957006:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1790740388.957010:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92e583 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e44 expref: 16 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740388.957022:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98dcaec70600) 00010000:00010000:1.0:1790740388.957024:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790740388.957027:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061200/0xb25dda4f4e92e4cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e13 expref: 15 pid: 13222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740388.957093:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98dcaec70600) 00010000:00010000:1.0:1790740388.957096:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1790740388.957100:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060200/0xb25dda4f4e92e4f7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e21 expref: 14 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740388.957116:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98dcaec70300) 00010000:00010000:1.0:1790740388.957118:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790740388.957122:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9000/0xb25dda4f4e92e1af lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23d41 expref: 13 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740388.957137:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98dcaf04c000) 00010000:00010000:1.0:1790740388.957140:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790740388.957150:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92eb8e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23fef expref: 12 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740388.957174:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98db82949800) 00010000:00010000:1.0:1790740388.957177:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740388.957180:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061400/0xb25dda4f4e92de59 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c53 expref: 11 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740388.957196:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98dc985be400) 00010000:00010000:1.0:1790740388.957198:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790740388.957202:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45e00/0xb25dda4f4e92e567 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23e3d expref: 10 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740388.957211:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98dcaf04c000) 00010000:00010000:1.0:1790740388.957213:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1790740388.957217:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92ebb8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23ffd expref: 9 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740388.957228:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98dc887e4800) 00010000:00010000:1.0:1790740388.957230:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790740388.957234:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33400/0xb25dda4f4e92e870 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23f1d expref: 8 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740388.957245:0:6524:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98db83e49800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1790740388.957262:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740388.957264:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740388.957265:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740388.977900:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740388.978018:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001036160 00000100:00100000:2.0:1790740388.978028:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001036160 00000100:00100000:2.0:1790740388.978140:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 258 00000100:00100000:2.0:1790740388.978150:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+5:2401:x1877727001036160:12345-192.168.204.3@tcp:39:umount.0 00000020:00000080:2.0:1790740388.978191:0:6536:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92db18 00000100:00080000:2.0:1790740388.978210:0:6536:0:(import.c:65:import_set_state_nolock()) ffff98dcae18f800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790740388.978265:0:6536:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1790740388.978430:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7bed19f2-4c98-4684-89e7-a6871565665d+3:2401:x1877727001036160:12345-192.168.204.3@tcp:39:umount.0 Request processed in 281us (541us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1790740388.978455:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 258 00010000:00010000:1.0:1790740388.978756:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740389.355394:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740390.382663:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740390.506466:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ee8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022053760:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790740390.506551:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740390.506679:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022053760 00000100:00100000:0.0:1790740390.506688:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022053760 00000100:00100000:0.0:1790740390.506738:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1790740390.506747:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022053760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790740390.506782:0:6540:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1790740390.506839:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022053760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740390.506846:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1790740390.507754:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ee8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022053760:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790740391.018370:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790740391.020453:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022053888:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790740391.021319:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740391.022545:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790740391.022566:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022054016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790740391.022620:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740391.023020:0:10118:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022053888 00000100:00100000:3.0:1790740391.023044:0:10118:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022053888 00000100:00100000:3.0:1790740391.023193:0:10118:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022054016 00000100:00100000:3.0:1790740391.023198:0:10118:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022054016 00000100:00100000:3.0:1790740391.023218:0:10118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1790740391.023227:0:10118:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ee8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022053888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790740391.023268:0:10118:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1790740391.023337:0:10118:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ee8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022053888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (2020us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740391.023345:0:10118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1790740391.023367:0:10118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1790740391.023393:0:10118:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022054016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790740391.023404:0:10118:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1790740391.023436:0:10118:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022054016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740391.023442:0:10118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1790740391.023486:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022054016:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790740391.023612:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790740391.023641:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022053888:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790740391.048790:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740391.048986:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740391.049231:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001036416 00000100:00100000:1.0:1790740391.049241:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001036416 00000100:00100000:1.0:1790740391.049303:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001036288 00000100:00100000:1.0:1790740391.049306:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001036288 00000100:00100000:1.0:1790740391.049335:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 23 00000100:00100000:1.0:1790740391.049344:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:160ca934-a0b3-4cb3-b255-c8d008823f6f+11:2403:x1877727001036416:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740391.049361:0:6522:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740391.049381:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dc81488000/0xb25dda4f4e92dc1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23bab expref: 11 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740391.049401:0:6522:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740391.049457:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:160ca934-a0b3-4cb3-b255-c8d008823f6f+10:2403:x1877727001036416:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 114us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740391.049465:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 23 00000100:00100000:1.0:1790740391.049483:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 24 00000100:00100000:1.0:1790740391.049489:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:160ca934-a0b3-4cb3-b255-c8d008823f6f+9:2403:x1877727001036288:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740391.049497:0:6522:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740391.049506:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcc2174a00/0xb25dda4f4e92dc14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23b7a expref: 9 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740391.049516:0:6522:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740391.049533:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:160ca934-a0b3-4cb3-b255-c8d008823f6f+8:2403:x1877727001036288:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 44us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740391.049984:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 24 00000100:00100000:3.0:1790740391.050514:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740391.050631:0:9550:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001036544 00000100:00100000:1.0:1790740391.050638:0:9550:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001036544 00000100:00100000:1.0:1790740391.050684:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 25 00000100:00100000:1.0:1790740391.050717:0:9550:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc88c6b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:160ca934-a0b3-4cb3-b255-c8d008823f6f+8:2404:x1877727001036544:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740391.050729:0:9550:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740391.050742:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcbfc44a00/0xb25dda4f4e92de0c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23c37 expref: 8 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740391.050754:0:9550:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740391.050787:0:9550:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc88c6b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:160ca934-a0b3-4cb3-b255-c8d008823f6f+7:2404:x1877727001036544:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 72us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740391.050794:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 25 00000100:00100000:2.0:1790740391.065326:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740391.065583:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001036800 00000100:00100000:3.0:1790740391.065593:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001036800 00000100:00100000:3.0:1790740391.065682:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 259 00000100:00100000:3.0:1790740391.065701:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4188ca3f-be2e-4a39-97db-9401a3b70751+6:2401:x1877727001036800:12345-192.168.204.3@tcp:39:umount.0 00000020:00000080:3.0:1790740391.065740:0:13222:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92dc29 00000020:00010000:3.0:1790740391.065748:0:13222:0:(genops.c:1920:obd_stale_export_put()) Put export ffff98dcb6c74800: total 0 00000100:00080000:3.0:1790740391.065754:0:13222:0:(import.c:65:import_set_state_nolock()) ffff98dcb6c72000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790740391.065818:0:13222:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:3.0:1790740391.065990:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2401:x1877727001036800:12345-192.168.204.3@tcp:39:umount.0 Request processed in 299us (673us total) trans 4294967528 rc 0/0 00000100:00100000:3.0:1790740391.065998:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 259 00000020:00010000:2.0:1790740391.066323:0:6523:0:(genops.c:1906:obd_stale_export_get()) Get export ffff98dcb6c74800: total 0 00010000:00010000:2.0:1790740391.066328:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740391.066379:0:6523:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98dcb6c74800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1790740391.066416:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98dc985be400) 00010000:00010000:2.0:1790740391.066420:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790740391.066429:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaeee2800/0xb25dda4f4e92ebdb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae2400b expref: 4 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740391.066451:0:6523:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98dcb6c74800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1790740391.066462:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740391.066464:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740391.066465:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790740391.066959:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790740391.088672:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740391.088821:0:6535:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001036928 00000100:00100000:2.0:1790740391.088831:0:6535:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001036928 00000100:00100000:2.0:1790740391.088909:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 260 00000100:00100000:2.0:1790740391.088920:0:6535:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188ca3f-be2e-4a39-97db-9401a3b70751+5:2401:x1877727001036928:12345-192.168.204.3@tcp:39:umount.0 00000020:00000080:2.0:1790740391.088963:0:6535:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92dc30 00000100:00080000:2.0:1790740391.088973:0:6535:0:(import.c:65:import_set_state_nolock()) ffff98db83e38800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790740391.089067:0:6535:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1790740391.089383:0:6535:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188ca3f-be2e-4a39-97db-9401a3b70751+3:2401:x1877727001036928:12345-192.168.204.3@tcp:39:umount.0 Request processed in 465us (720us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1790740391.089410:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 260 00000100:00080000:0.0:1790740391.089630:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1790740391.091240:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740391.143357:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740391.143450:0:6529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001037184 00000100:00100000:1.0:1790740391.143466:0:6529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001037184 00000100:00100000:1.0:1790740391.143544:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 398 00000100:00100000:1.0:1790740391.143557:0:6529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99056450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+7:2401:x1877727001037184:12345-192.168.204.3@tcp:251:umount.0 00000020:00000080:1.0:1790740391.143615:0:6529:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92daee 00000020:00010000:1.0:1790740391.143624:0:6529:0:(genops.c:1920:obd_stale_export_put()) Put export ffff98db83e4c800: total 0 00000100:00080000:1.0:1790740391.143630:0:6529:0:(import.c:65:import_set_state_nolock()) ffff98db83e4d800 : changing import state from FULL to CLOSED 00000020:00010000:0.0:1790740391.143840:0:6524:0:(genops.c:1906:obd_stale_export_get()) Get export ffff98db83e4c800: total 0 00010000:00010000:0.0:1790740391.143894:0:6524:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98db83e4c800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1790740391.143930:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcaf060c00/0xb25dda4f4e92dbc7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae23b6c expref: 3 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740391.143972:0:6524:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98db83e4c800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1790740391.143986:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740391.143988:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740391.143990:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740391.151193:0:6529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99056450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:160ca934-a0b3-4cb3-b255-c8d008823f6f+1:2401:x1877727001037184:12345-192.168.204.3@tcp:251:umount.0 Request processed in 7622us (7829us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740391.151211:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 398 00000020:00000080:1.0:1790740391.151235:0:6529:0:(genops.c:885:class_export_put()) final put ffff98db83e4c800/160ca934-a0b3-4cb3-b255-c8d008823f6f 00000020:00000080:2.0:1790740391.155470:0:11805:0:(genops.c:844:class_export_destroy()) destroying export ffff98db83e4c800/160ca934-a0b3-4cb3-b255-c8d008823f6f for MGS 00000020:00000080:2.0:1790740391.155544:0:11805:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98db83e4d800 for MGS 00010000:00010000:3.0:1790740391.404502:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740392.426606:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740392.554511:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84527480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3639:1877727022054144:0@lo:400:kworker.0 00000100:00100000:1.0:1790740392.554612:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740392.554674:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84527100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022054656:0@lo:400:kworker.0 00000100:00100000:1.0:1790740392.554704:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740392.554725:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022055168:0@lo:400:kworker.0 00000100:00100000:1.0:1790740392.554752:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740392.554786:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84524380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022055680:0@lo:400:kworker.0 00000100:00100000:1.0:1790740392.554808:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740392.554839:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1790740392.554845:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84526680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877727022054528:0@lo:400:kworker.0 00000100:00100000:1.0:1790740392.554871:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740392.554888:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022055040:0@lo:400:kworker.0 00000100:00100000:1.0:1790740392.554908:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740392.554927:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022055552:0@lo:400:kworker.0 00000100:00100000:1.0:1790740392.554948:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740392.554981:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84525c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877727022054272:0@lo:400:kworker.0 00000100:00100000:1.0:1790740392.555004:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740392.555024:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84527800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1877727022054784:0@lo:400:kworker.0 00000100:00100000:1.0:1790740392.555066:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740392.555085:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1877727022055296:0@lo:400:kworker.0 00000100:00100000:1.0:1790740392.555119:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740392.555139:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1790740392.555145:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84526a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022054400:0@lo:400:kworker.0 00000100:00100000:1.0:1790740392.555166:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740392.555184:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1877727022054912:0@lo:400:kworker.0 00000100:00100000:1.0:1790740392.555204:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740392.555220:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1877727022055424:0@lo:400:kworker.0 00000100:00100000:1.0:1790740392.555241:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740392.555274:0:6530:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022054144 00000100:00100000:1.0:1790740392.555284:0:6530:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022054144 00000100:00100000:1.0:1790740392.555348:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1790740392.555365:0:6530:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc99056050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3639:x1877727022054144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740392.555427:0:6530:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc99056050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3639:x1877727022054144:12345-0@lo:400:kworker.0 Request processed in 63us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740392.555435:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1790740392.555473:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022054656 00000100:00100000:1.0:1790740392.555477:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022054656 00000100:00100000:1.0:1790740392.555502:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022054400 00000100:00100000:1.0:1790740392.555505:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022054400 00000100:00100000:1.0:1790740392.555518:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1790740392.555524:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022054656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740392.555561:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022054656:12345-0@lo:400:kworker.0 Request processed in 36us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740392.555568:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1790740392.555581:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1790740392.555588:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022054400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740392.555620:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022054400:12345-0@lo:400:kworker.0 Request processed in 33us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740392.555626:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1790740392.555647:0:14497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022055168 00000100:00100000:1.0:1790740392.555651:0:14497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022055168 00000100:00100000:1.0:1790740392.555678:0:14497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022055680 00000100:00100000:1.0:1790740392.555681:0:14497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022055680 00000100:00100000:1.0:1790740392.555703:0:14497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022055040 00000100:00100000:1.0:1790740392.555705:0:14497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022055040 00000100:00100000:1.0:1790740392.555718:0:14497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022055552 00000100:00100000:1.0:1790740392.555720:0:14497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022055552 00000100:00100000:1.0:1790740392.555736:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1790740392.555742:0:14497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82332d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022055168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740392.555785:0:14497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82332d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022055168:12345-0@lo:400:kworker.0 Request processed in 43us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740392.555793:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1790740392.555806:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1790740392.555813:0:14497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022055680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740392.555844:0:14497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022055680:12345-0@lo:400:kworker.0 Request processed in 32us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740392.555850:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1790740392.555861:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1790740392.555867:0:14497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82333480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022055040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740392.555894:0:14497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82333480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022055040:12345-0@lo:400:kworker.0 Request processed in 27us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740392.555900:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1790740392.555911:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1790740392.555917:0:14497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82331c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022055552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740392.555943:0:14497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82331c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022055552:12345-0@lo:400:kworker.0 Request processed in 27us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740392.555949:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1790740392.555974:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022054528 00000100:00100000:1.0:1790740392.555977:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022054528 00000100:00100000:1.0:1790740392.555998:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022054272 00000100:00100000:1.0:1790740392.556000:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022054272 00000100:00100000:1.0:1790740392.556012:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022054784 00000100:00100000:1.0:1790740392.556015:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022054784 00000100:00100000:1.0:1790740392.556027:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022055296 00000100:00100000:1.0:1790740392.556045:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022055296 00000100:00100000:1.0:1790740392.556058:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022054912 00000100:00100000:1.0:1790740392.556067:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022054912 00000100:00100000:1.0:1790740392.556082:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022055424 00000100:00100000:1.0:1790740392.556084:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022055424 00000100:00100000:1.0:1790740392.556111:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1790740392.556118:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877727022054528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740392.556149:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877727022054528:12345-0@lo:400:kworker.0 Request processed in 33us (1277us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740392.556156:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1790740392.556167:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1790740392.556172:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82332300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877727022054272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740392.556198:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82332300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877727022054272:12345-0@lo:400:kworker.0 Request processed in 26us (1193us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740392.556203:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1790740392.556212:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1790740392.556219:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82333100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877727022054784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740392.556245:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82333100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877727022054784:12345-0@lo:400:kworker.0 Request processed in 27us (1179us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740392.556250:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1790740392.556260:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1790740392.556265:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82331880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877727022055296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740392.556288:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82331880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877727022055296:12345-0@lo:400:kworker.0 Request processed in 24us (1169us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740392.556293:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1790740392.556302:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1790740392.556307:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82330700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877727022054912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740392.556329:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82330700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877727022054912:12345-0@lo:400:kworker.0 Request processed in 23us (1125us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740392.556339:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1790740392.556350:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1790740392.556355:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877727022055424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740392.556382:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877727022055424:12345-0@lo:400:kworker.0 Request processed in 27us (1141us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740392.556388:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1790740392.556392:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790740392.556405:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db845bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022055808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790740392.556445:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740392.556469:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84526a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022054400:0@lo:400:kworker.0 00000100:00100000:3.0:1790740392.556479:0:10118:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022055808 00000100:00100000:3.0:1790740392.556483:0:10118:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022055808 00010000:00080000:1.0:1790740392.556484:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db84524000 x1877727022054912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740392.556495:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1877727022054912:0@lo:400:kworker.0 00010000:00080000:1.0:1790740392.556505:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db84526300 x1877727022055424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740392.556510:0:10118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1790740392.556513:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1877727022055424:0@lo:400:kworker.0 00000100:00100000:3.0:1790740392.556516:0:10118:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022055808:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790740392.556523:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84525c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877727022054272:0@lo:400:kworker.0 00000100:00100000:1.0:1790740392.556533:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84527800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1877727022054784:0@lo:400:kworker.0 00000100:00100000:1.0:1790740392.556543:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1877727022055296:0@lo:400:kworker.0 00002000:00000024:3.0:1790740392.556556:0:10118:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790740392.556590:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84526680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877727022054528:0@lo:400:kworker.0 00000100:00100000:3.0:1790740392.556592:0:10118:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022055808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740392.556598:0:10118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1790740392.556601:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022055040:0@lo:400:kworker.0 00000100:00100000:1.0:1790740392.556610:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022055552:0@lo:400:kworker.0 00000100:00100000:1.0:1790740392.556619:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84527480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3639:1877727022054144:0@lo:400:kworker.0 00000100:00100000:3.0:1790740392.556628:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db845bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022055808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790740392.556638:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84527100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022054656:0@lo:400:kworker.0 00000100:00100000:1.0:1790740392.556651:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022055168:0@lo:400:kworker.0 00000100:00100000:1.0:1790740392.556660:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84524380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022055680:0@lo:400:kworker.0 00000100:00080000:0.0:1790740392.559179:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790740392.559192:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790740392.559196:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790740392.570473:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022055936:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790740392.570579:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740392.570656:0:8455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022055936 00000100:00100000:0.0:1790740392.570666:0:8455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022055936 00000100:00100000:0.0:1790740392.570724:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1790740392.570732:0:8455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb81b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022055936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790740392.570760:0:8455:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790740392.570810:0:8455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb81b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022055936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740392.570817:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1790740392.570872:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022055936:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1790740393.451194:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740393.579540:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db845bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022056064:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790740393.579644:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740393.580092:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022056064 00000100:00100000:1.0:1790740393.580103:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022056064 00000100:00100000:1.0:1790740393.580476:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1790740393.580489:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022056064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790740393.580539:0:6541:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790740393.580617:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022056064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 130us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740393.580625:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1790740393.585199:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db845bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022056064:0@lo:41:osp-pre-1-0.0 00000020:01000004:2.0:1790740393.609935:0:15176:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1790740393.646294:0:15176:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1790740393.646384:0:15176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8e00/0xb25dda4f4e92db96 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92db9d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740393.646404:0:15176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8e00/0xb25dda4f4e92db96 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92db9d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740393.646413:0:15176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8e00/0xb25dda4f4e92db96 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xb25dda4f4e92db9d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740393.646429:0:15176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8e00/0xb25dda4f4e92db96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xb25dda4f4e92db9d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740393.646457:0:15176:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1790740393.646465:0:15176:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1790740393.646498:0:15176:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790740393.646504:0:15176:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1790740393.646510:0:15176:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1790740393.646542:0:15176:0:(import.c:65:import_set_state_nolock()) ffff98dca0cb6800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1790740393.646697:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790740393.646706:0:6523:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8e00/0xb25dda4f4e92db96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xb25dda4f4e92db9d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740393.646715:0:6523:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc8e00 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:1.0:1790740393.646719:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8e00/0xb25dda4f4e92db96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xb25dda4f4e92db9d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740393.646729:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8e00/0xb25dda4f4e92db96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xb25dda4f4e92db9d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790740393.646737:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8e00/0xb25dda4f4e92db96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xb25dda4f4e92db9d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740393.646755:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1790740393.646758:0:6523:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1790740393.646761:0:6523:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1790740393.646794:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8e00/0xb25dda4f4e92db96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xb25dda4f4e92db9d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740393.646801:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790740393.646831:0:6523:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8e00/0xb25dda4f4e92db96 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xb25dda4f4e92db9d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740393.646839:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8e00/0xb25dda4f4e92db96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xb25dda4f4e92db9d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740393.646852:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740393.646854:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740393.646855:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740393.646932:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb81b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877727022056192:0@lo:39:umount.0 00000100:00100000:3.0:1790740393.647025:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740393.647209:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790740393.647218:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82330e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727022056320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790740393.647251:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740393.647293:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022056320 00000100:00100000:3.0:1790740393.647301:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022056320 00000100:00100000:1.0:1790740393.647424:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022056192 00000100:00100000:1.0:1790740393.647429:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022056192 00000100:00100000:1.0:1790740393.647484:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1790740393.647495:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1877727022056192:12345-0@lo:39:umount.0 00000020:00000080:1.0:1790740393.647531:0:7760:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92d705 00000100:00080000:1.0:1790740393.647542:0:7760:0:(import.c:65:import_set_state_nolock()) ffff98dcb8119000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1790740393.647624:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3637:x1877727022056192:12345-0@lo:39:umount.0 Request processed in 130us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740393.647632:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000020:00000080:1.0:1790740393.647643:0:7760:0:(genops.c:885:class_export_put()) final put ffff98dcb811b000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1790740393.647678:0:11805:0:(genops.c:844:class_export_destroy()) destroying export ffff98dcb811b000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1790740393.647738:0:11805:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98dcb8119000 for lustre-MDT0000 00000100:00100000:3.0:1790740393.647831:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790740393.647839:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3638:x1877727022056320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790740393.647854:0:6522:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740393.647874:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dc80030800/0xb25dda4f4e92db9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb25dda4f4e92db96 expref: 24 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740393.647890:0:6522:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740393.647921:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:3638:x1877727022056320:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740393.647935:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1790740393.647955:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790740393.647989:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98dca0cb6800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1790740393.648000:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb81b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877727022056192:0@lo:39:umount.0 00000100:00100000:3.0:1790740393.648058:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82330e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727022056320:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1790740393.652279:0:15176:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790740393.652294:0:15176:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1790740393.652306:0:15176:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1790740393.653491:0:15176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaf061000/0xb25dda4f4e92dba4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92dbab expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740393.653512:0:15176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaf061000/0xb25dda4f4e92dba4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92dbab expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740393.653521:0:15176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaf061000/0xb25dda4f4e92dba4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xb25dda4f4e92dbab expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740393.653528:0:15176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: ffff98dcaf061000/0xb25dda4f4e92dba4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xb25dda4f4e92dbab expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740393.653559:0:15176:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790740393.653581:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790740393.653588:0:6524:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dcaf061000/0xb25dda4f4e92dba4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xb25dda4f4e92dbab expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740393.653611:0:6524:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf061000 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:0.0:1790740393.653615:0:6524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dcaf061000/0xb25dda4f4e92dba4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xb25dda4f4e92dbab expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740393.653627:0:6524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dcaf061000/0xb25dda4f4e92dba4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xb25dda4f4e92dbab expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790740393.653635:0:6524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dcaf061000/0xb25dda4f4e92dba4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xb25dda4f4e92dbab expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740393.653642:0:6524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790740393.653644:0:6524:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1790740393.653691:0:6524:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dcaf061000/0xb25dda4f4e92dba4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xb25dda4f4e92dbab expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740393.653698:0:6524:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790740393.653736:0:6524:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dcaf061000/0xb25dda4f4e92dba4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xb25dda4f4e92dbab expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740393.653744:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dcaf061000/0xb25dda4f4e92dba4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xb25dda4f4e92dbab expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740393.653761:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740393.653763:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740393.653766:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740393.653776:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790740393.653800:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb81b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3641:1877727022056448:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790740393.653896:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790740393.653973:0:15176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8600/0xb25dda4f4e92daa8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92daaf expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740393.653988:0:15176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8600/0xb25dda4f4e92daa8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92daaf expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740393.653994:0:15176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8600/0xb25dda4f4e92daa8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb25dda4f4e92daaf expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740393.654000:0:15176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8600/0xb25dda4f4e92daa8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb25dda4f4e92daaf expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740393.654011:0:15176:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790740393.654017:0:15176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaf060800/0xb25dda4f4e92ddfe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92de05 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740393.654024:0:15176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaf060800/0xb25dda4f4e92ddfe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92de05 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740393.654054:0:15176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaf060800/0xb25dda4f4e92ddfe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xb25dda4f4e92de05 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740393.654061:0:15176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: ffff98dcaf060800/0xb25dda4f4e92ddfe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xb25dda4f4e92de05 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740393.654085:0:15176:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1790740393.654092:0:15176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcc2175600/0xb25dda4f4e92d664 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d66b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740393.654099:0:15176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcc2175600/0xb25dda4f4e92d664 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92d66b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740393.654116:0:15176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcc2175600/0xb25dda4f4e92d664 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb25dda4f4e92d66b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740393.654123:0:15176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: ffff98dcc2175600/0xb25dda4f4e92d664 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb25dda4f4e92d66b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740393.654134:0:15176:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:0.0:1790740393.654138:0:15176:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1790740393.654145:0:15176:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:0.0:1790740393.654183:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790740393.654188:0:6524:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8600/0xb25dda4f4e92daa8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb25dda4f4e92daaf expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740393.654195:0:6524:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc8600 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:0.0:1790740393.654198:0:6524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8600/0xb25dda4f4e92daa8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb25dda4f4e92daaf expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740393.654205:0:6524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8600/0xb25dda4f4e92daa8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xb25dda4f4e92daaf expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790740393.654212:0:6524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8600/0xb25dda4f4e92daa8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xb25dda4f4e92daaf expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740393.654218:0:6524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1790740393.654220:0:6524:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1790740393.654222:0:6524:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1790740393.654237:0:6524:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8600/0xb25dda4f4e92daa8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb25dda4f4e92daaf expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740393.654244:0:6524:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790740393.654261:0:6524:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8600/0xb25dda4f4e92daa8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb25dda4f4e92daaf expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740393.654269:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8600/0xb25dda4f4e92daa8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb25dda4f4e92daaf expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740393.654281:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790740393.654284:0:6524:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dcaf060800/0xb25dda4f4e92ddfe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb25dda4f4e92de05 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740393.654290:0:6524:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf060800 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:0.0:1790740393.654293:0:6524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dcaf060800/0xb25dda4f4e92ddfe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb25dda4f4e92de05 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740393.654300:0:6524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dcaf060800/0xb25dda4f4e92ddfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xb25dda4f4e92de05 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790740393.654307:0:6524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dcaf060800/0xb25dda4f4e92ddfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xb25dda4f4e92de05 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740393.654312:0:6524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1790740393.654315:0:6524:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1790740393.654316:0:6524:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1790740393.654328:0:6524:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dcaf060800/0xb25dda4f4e92ddfe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xb25dda4f4e92de05 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740393.654334:0:6524:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790740393.654350:0:6524:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dcaf060800/0xb25dda4f4e92ddfe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xb25dda4f4e92de05 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740393.654357:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dcaf060800/0xb25dda4f4e92ddfe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xb25dda4f4e92de05 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740393.654376:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790740393.654379:0:6524:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dcc2175600/0xb25dda4f4e92d664 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb25dda4f4e92d66b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740393.654386:0:6524:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcc2175600 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:0.0:1790740393.654389:0:6524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dcc2175600/0xb25dda4f4e92d664 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb25dda4f4e92d66b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740393.654396:0:6524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dcc2175600/0xb25dda4f4e92d664 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xb25dda4f4e92d66b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790740393.654403:0:6524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dcc2175600/0xb25dda4f4e92d664 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xb25dda4f4e92d66b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740393.654408:0:6524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1790740393.654410:0:6524:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1790740393.654412:0:6524:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1790740393.654426:0:6524:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dcc2175600/0xb25dda4f4e92d664 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb25dda4f4e92d66b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740393.654432:0:6524:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790740393.654438:0:6524:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dcc2175600/0xb25dda4f4e92d664 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb25dda4f4e92d66b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740393.654446:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dcc2175600/0xb25dda4f4e92d664 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb25dda4f4e92d66b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740393.654456:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740393.654457:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740393.654464:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740393.654477:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3639:1877727022056832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790740393.654515:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740393.654539:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790740393.654544:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3639:1877727022056704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790740393.654565:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740393.654597:0:10416:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022056448 00000100:00100000:0.0:1790740393.654606:0:10416:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022056448 00000100:00100000:0.0:1790740393.654662:0:10416:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022056832 00000100:00100000:0.0:1790740393.654665:0:10416:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022056832 00000100:00100000:0.0:1790740393.654683:0:10416:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022056704 00000100:00100000:0.0:1790740393.654685:0:10416:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022056704 00000100:00100000:0.0:1790740393.654703:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790740393.654713:0:10416:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+25:3641:x1877727022056448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790740393.654730:0:10416:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740393.654749:0:10416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dc81488200/0xb25dda4f4e92dbab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb25dda4f4e92dba4 expref: 25 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740393.654765:0:10416:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740393.654805:0:10416:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+24:3641:x1877727022056448:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740393.654815:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790740393.654836:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790740393.654842:0:10416:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+23:3639:x1877727022056832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790740393.654851:0:10416:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740393.654861:0:10416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dca1968000/0xb25dda4f4e92d66b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb25dda4f4e92d664 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740393.654872:0:10416:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740393.654906:0:10416:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+22:3639:x1877727022056832:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740393.654913:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790740393.654925:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790740393.654931:0:10416:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+21:3639:x1877727022056704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790740393.654939:0:10416:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740393.654947:0:10416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98db83f33c00/0xb25dda4f4e92de05 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb25dda4f4e92ddfe expref: 21 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740393.654956:0:10416:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740393.654977:0:10416:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+20:3639:x1877727022056704:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740393.654984:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790740393.655006:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3641:1877727022056576:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790740393.656291:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740393.656897:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790740393.659202:0:15176:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1790740393.659211:0:15176:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1790740393.659218:0:15176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790740393.659227:0:15176:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:2.0:1790740393.659239:0:15176:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff98db82ff7800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790740393.659247:0:15176:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff98dcb5f9a800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790740393.659252:0:15176:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff98dcb81fd000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790740393.659256:0:15176:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff98dcb81fc000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:2.0:1790740393.659266:0:15176:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff98dcb6c74800 4188ca3f-be2e-4a39-97db-9401a3b70751 192.168.204.3@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790740393.659272:0:15176:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff98db83e49800 7bed19f2-4c98-4684-89e7-a6871565665d 192.168.204.3@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:2.0:1790740393.659277:0:15176:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff98dcb81dcd40) has exports, disconnecting them 00000020:00080000:2.0:1790740393.659282:0:15176:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98db82ff7800), last request at 1790740392 00000020:00000080:2.0:1790740393.659292:0:15176:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92da1c 00000100:00080000:2.0:1790740393.659318:0:15176:0:(import.c:65:import_set_state_nolock()) ffff98db82ff0000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1790740393.659392:0:15176:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff98db82ff7800): rc 0 00000020:00000080:2.0:1790740393.659395:0:15176:0:(genops.c:885:class_export_put()) final put ffff98db82ff7800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1790740393.659406:0:15176:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98dcb5f9a800), last request at 1790740392 00000020:00000080:2.0:1790740393.659410:0:15176:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92d8ef 00000100:00080000:2.0:1790740393.659416:0:15176:0:(import.c:65:import_set_state_nolock()) ffff98dcb5f99800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1790740393.659437:0:15176:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff98dcb5f9a800): rc 0 00000020:00000080:2.0:1790740393.659439:0:15176:0:(genops.c:885:class_export_put()) final put ffff98dcb5f9a800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1790740393.659463:0:15176:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98dcb81fd000), last request at 1790740155 00000020:00000080:2.0:1790740393.659467:0:15176:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92d7ec 00000100:00080000:2.0:1790740393.659471:0:15176:0:(import.c:65:import_set_state_nolock()) ffff98dcb81fc800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1790740393.659482:0:15176:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff98dcb81fd000): rc 0 00000020:00000080:2.0:1790740393.659485:0:15176:0:(genops.c:885:class_export_put()) final put ffff98dcb81fd000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1790740393.659489:0:15176:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98dcb81fc000), last request at 1790740155 00000020:00000080:2.0:1790740393.659492:0:15176:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92d7b4 00000100:00080000:2.0:1790740393.659496:0:15176:0:(import.c:65:import_set_state_nolock()) ffff98dcb81fd800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790740393.659503:0:15176:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:2.0:1790740393.659600:0:15176:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff98dcb81fc000): rc 0 00000004:00000080:2.0:1790740393.659608:0:15176:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb5b10155fae0 00000100:00080000:2.0:1790740393.659634:0:15176:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1790740393.659639:0:15176:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000020:00000080:1.0:1790740393.660067:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98db82ff7800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1790740393.660140:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98dcb5f9a800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1790740393.660169:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98dcb81fd000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1790740393.660199:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98db82ff0000 for lustre-MDT0000 00000020:00000080:1.0:1790740393.660204:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98dcb5f99800 for lustre-MDT0000 00000020:00000080:1.0:1790740393.660207:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98dcb81fc800 for lustre-MDT0000 00010000:00010000:1.0:1790740393.660242:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740393.660249:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740393.660743:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740393.662209:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3639:1877727022056704:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790740393.662229:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3639:1877727022056832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790740393.672403:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740393.672560:0:10416:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022056576 00000100:00100000:1.0:1790740393.672577:0:10416:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022056576 00000100:00100000:1.0:1790740393.672698:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790740393.672712:0:10416:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+20:3641:x1877727022056576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790740393.672737:0:10416:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740393.672766:0:10416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dca1969000/0xb25dda4f4e92daaf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb25dda4f4e92daa8 expref: 20 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740393.672788:0:10416:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740393.672873:0:10416:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad8ddc53-446f-4b77-85d5-90ebc88dfa76+19:3641:x1877727022056576:12345-0@lo:103:ldlm_bl.0 Request processed in 164us (17841us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740393.672883:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1790740393.672926:0:15176:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1790740393.672958:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3641:1877727022056576:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1790740393.672965:0:15176:0:(import.c:65:import_set_state_nolock()) ffff98dcb5f1e000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1790740393.672974:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb81b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3641:1877727022056448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790740393.673068:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877727022056960:0@lo:39:umount.0 00000100:00100000:2.0:1790740393.673824:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790740393.673981:0:15176:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1790740393.673986:0:15176:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:2.0:1790740393.674003:0:15176:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1790740393.674128:0:15176:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1790740393.674163:0:15176:0:(import.c:65:import_set_state_nolock()) ffff98dcaec8d800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1790740393.674177:0:15176:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1790740393.674180:0:15176:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:2.0:1790740393.674190:0:15176:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790740393.674270:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877727022057088:0@lo:9:umount.0 00000100:00100000:2.0:1790740393.674326:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790740393.674407:0:15176:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1790740393.674436:0:15176:0:(import.c:65:import_set_state_nolock()) ffff98dcb5cc0000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1790740393.674454:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877727022057216:0@lo:9:umount.0 00000100:00100000:2.0:1790740393.674483:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740393.674566:0:6540:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022056960 00000100:00100000:1.0:1790740393.674581:0:6540:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022056960 00000100:00100000:1.0:1790740393.674647:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1790740393.674657:0:6540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1877727022056960:12345-0@lo:39:umount.0 00000020:00000080:1.0:1790740393.674693:0:6540:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92d847 00000100:00080000:1.0:1790740393.674704:0:6540:0:(import.c:65:import_set_state_nolock()) ffff98dc86a14000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790740393.674733:0:6540:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1790740393.674918:0:6540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3637:x1877727022056960:12345-0@lo:39:umount.0 Request processed in 261us (1786us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1790740393.674926:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00010000:00010000:1.0:1790740393.674952:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790740393.676386:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98dcb5f1e000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1790740393.676401:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877727022056960:0@lo:39:umount.0 00000100:00100000:0.0:1790740393.676743:0:14497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022057088 00000100:00100000:0.0:1790740393.676755:0:14497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022057088 00000020:00080000:2.0:1790740393.677001:0:15176:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff98dcb81dcd40) has no exports 00000100:00100000:1.0:1790740393.677265:0:8453:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022057216 00000100:00100000:1.0:1790740393.677271:0:8453:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022057216 00000100:00100000:2.0:1790740393.677358:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790740393.677374:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1877727022057216:12345-0@lo:9:umount.0 00000020:00000080:2.0:1790740393.677420:0:9806:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92dad9 00000100:00080000:2.0:1790740393.677433:0:9806:0:(import.c:65:import_set_state_nolock()) ffff98db83e4b800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1790740393.677445:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1790740393.677453:0:14497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3637:x1877727022057088:12345-0@lo:9:umount.0 00000020:00000080:1.0:1790740393.677469:0:14497:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92d997 00000100:00080000:1.0:1790740393.677476:0:14497:0:(import.c:65:import_set_state_nolock()) ffff98db829b5000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790740393.677500:0:9806:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000001:00000004:1.0:1790740393.677521:0:14497:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00080000:0.0:1790740393.677994:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790740393.678006:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740393.680534:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3637:x1877727022057216:12345-0@lo:9:umount.0 Request processed in 3151us (6035us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740393.680553:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:2.0:1790740393.681633:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98dcb5cc0000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1790740393.681826:0:3637:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1790740393.681829:0:3637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790740393.681835:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877727022057216:0@lo:9:umount.0 00000100:00100000:1.0:1790740393.682892:0:14497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3637:x1877727022057088:12345-0@lo:9:umount.0 Request processed in 5430us (8555us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740393.682909:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1790740393.683021:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98dcaec8d800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1790740393.683497:0:3637:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1790740393.683502:0:3637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790740393.683508:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877727022057088:0@lo:9:umount.0 00010000:00010000:1.0:1790740393.683548:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1790740393.688935:0:15176:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff98dcb81dcd40) has no exports 00000020:00000080:1.0:1790740393.801724:0:15176:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92d6bf 00000020:00000080:1.0:1790740393.801742:0:15176:0:(genops.c:885:class_export_put()) final put ffff98dcb5cc5800/lustre-QMT0000_UUID 00000020:01000000:1.0:1790740393.801778:0:15176:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1790740393.801951:0:11805:0:(genops.c:844:class_export_destroy()) destroying export ffff98dcb5cc5800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1790740393.803674:0:15176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790740393.803689:0:15176:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1790740393.803694:0:15176:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff98dc89743380) has no exports 00000020:00000080:3.0:1790740393.804210:0:15176:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92d6b8 00000020:00000080:3.0:1790740393.804221:0:15176:0:(genops.c:885:class_export_put()) final put ffff98dcb5cb3000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1790740393.804292:0:15176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790740393.804299:0:15176:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1790740393.804302:0:15176:0:(genops.c:885:class_export_put()) final put ffff98dca0cb2800/lustre-QMT0000_UUID 00000020:00000080:3.0:1790740393.804305:0:15176:0:(genops.c:844:class_export_destroy()) destroying export ffff98dca0cb2800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1790740393.804313:0:15176:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1790740393.804554:0:11805:0:(genops.c:844:class_export_destroy()) destroying export ffff98dcb5cb3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1790740394.475254:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790740394.605875:0:9531:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1790740394.605884:0:9531:0:(genops.c:885:class_export_put()) final put ffff98db83e49000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1790740394.605906:0:9531:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7bed19f2-4c98-4684-89e7-a6871565665d 00000020:00000080:3.0:1790740394.605908:0:9531:0:(genops.c:885:class_export_put()) final put ffff98db83e05800/7bed19f2-4c98-4684-89e7-a6871565665d 00000001:00100000:0.0:1790740394.606021:0:8446:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790740394.606025:0:8446:0:(genops.c:885:class_export_put()) final put ffff98db829b0800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1790740394.606084:0:8446:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7bed19f2-4c98-4684-89e7-a6871565665d 00000020:00000080:0.0:1790740394.606087:0:8446:0:(genops.c:885:class_export_put()) final put ffff98db844e7000/7bed19f2-4c98-4684-89e7-a6871565665d 00000001:00100000:1.0:1790740394.606165:0:7466:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1790740394.606174:0:7466:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:1.0:1790740394.606178:0:7466:0:(genops.c:885:class_export_put()) final put ffff98dcaed07000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1790740394.606183:0:7466:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 4188ca3f-be2e-4a39-97db-9401a3b70751 00000001:00080000:1.0:1790740394.606187:0:7466:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:1.0:1790740394.606188:0:7466:0:(genops.c:885:class_export_put()) final put ffff98db83e3d800/4188ca3f-be2e-4a39-97db-9401a3b70751 00000001:00100000:1.0:1790740394.606192:0:7466:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 7bed19f2-4c98-4684-89e7-a6871565665d 00000001:00080000:1.0:1790740394.606195:0:7466:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:1.0:1790740394.606197:0:7466:0:(genops.c:885:class_export_put()) final put ffff98db83e4f800/7bed19f2-4c98-4684-89e7-a6871565665d 00000020:00000080:2.0:1790740394.606802:0:11805:0:(genops.c:844:class_export_destroy()) destroying export ffff98db83e49000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1790740394.606902:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98db83e05800/7bed19f2-4c98-4684-89e7-a6871565665d for lustre-OST0001 00000020:00000080:1.0:1790740394.606951:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98db829b0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000001:00100000:2.0:1790740394.607791:0:6514:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1790740394.607798:0:6514:0:(genops.c:885:class_export_put()) final put ffff98dcb81fc000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1790740394.611702:0:6514:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4188ca3f-be2e-4a39-97db-9401a3b70751 00000001:00080000:2.0:1790740394.611720:0:6514:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:2.0:1790740394.611727:0:6514:0:(genops.c:885:class_export_put()) final put ffff98dcb6c74800/4188ca3f-be2e-4a39-97db-9401a3b70751 00000001:00100000:2.0:1790740394.611755:0:6514:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7bed19f2-4c98-4684-89e7-a6871565665d 00000001:00080000:2.0:1790740394.611762:0:6514:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:2.0:1790740394.611771:0:6514:0:(genops.c:885:class_export_put()) final put ffff98db83e49800/7bed19f2-4c98-4684-89e7-a6871565665d 00000020:00000080:1.0:1790740394.614776:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98db844e7000/7bed19f2-4c98-4684-89e7-a6871565665d for lustre-OST0000 00000020:00000080:1.0:1790740394.614851:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98dcaed07000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1790740394.614885:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98db83e3d800/4188ca3f-be2e-4a39-97db-9401a3b70751 for lustre-MDT0001 00000020:00000080:1.0:1790740394.614911:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98db83e4f800/7bed19f2-4c98-4684-89e7-a6871565665d for lustre-MDT0001 00000020:00000080:1.0:1790740394.614932:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98db83e4b800 for lustre-OST0001 00000020:00000080:1.0:1790740394.614940:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98db83e04000 for lustre-OST0001 00000020:00000080:1.0:1790740394.614944:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98db829b5000 for lustre-OST0000 00000020:00000080:1.0:1790740394.614951:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98dcb81fc000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1790740394.614971:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98dcb6c74800/4188ca3f-be2e-4a39-97db-9401a3b70751 for lustre-MDT0000 00000020:00000080:1.0:1790740394.614990:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98db83e49800/7bed19f2-4c98-4684-89e7-a6871565665d for lustre-MDT0000 00000020:00000080:1.0:1790740394.615012:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98db844e3000 for lustre-OST0000 00000020:00000080:1.0:1790740394.615016:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98dc86a14000 for lustre-MDT0001 00000020:00000080:1.0:1790740394.615020:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98db83e38800 for lustre-MDT0001 00000020:00000080:1.0:1790740394.615023:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98dcae18f800 for lustre-MDT0001 00000020:00000080:1.0:1790740394.615026:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98dcb81fd800 for lustre-MDT0000 00000020:00000080:1.0:1790740394.615074:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98dcb6c72000 for lustre-MDT0000 00000020:00000080:1.0:1790740394.615077:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98db83e4a800 for lustre-MDT0000 00010000:00010000:3.0:1790740395.499956:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740395.626497:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022057344:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790740395.626585:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740395.626698:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022057344 00000100:00100000:1.0:1790740395.626707:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022057344 00000100:00100000:1.0:1790740395.626764:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1790740395.626772:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1877727022057344:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1790740395.626781:0:6541:0:(tgt_handler.c:821:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1790740395.629825:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1877727022057344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3043us (3231us total) trans 0 rc -107/-107 00000100:00100000:1.0:1790740395.629840:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:02020000:3.0:1790740395.629943:0:3640:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:3.0:1790740395.636789:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1790740395.636899:0:3640:0:(import.c:65:import_set_state_nolock()) ffff98dcbc254800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1790740395.636905:0:3640:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1790740395.650801:0:3640:0:(import.c:65:import_set_state_nolock()) ffff98dcbc254800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790740395.650827:0:3640:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 226 00000100:00080000:3.0:1790740395.650843:0:3640:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98dcbc254800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:3.0:1790740395.650919:0:3640:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98db845bc000 x1877727022057472/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790740395.651160:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db845bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877727022057472:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1790740395.651246:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740395.651429:0:7846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022057472 00000100:00100000:0.0:1790740395.651437:0:7846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022057472 00000100:00100000:0.0:1790740395.651617:0:7846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1790740395.651625:0:7846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3637:x1877727022057472:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:0.0:1790740395.651643:0:7846:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1790740395.659737:0:7846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3637:x1877727022057472:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 8102us (8481us total) trans 0 rc -19/-19 00000100:00100000:0.0:1790740395.659765:0:7846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00080000:1.0:1790740395.660328:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98dcbc254800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790740395.660335:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790740395.660339:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db845bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877727022057472:0@lo:38:ptlrpcd_00_02.0 00000020:01000000:3.0:1790740395.818365:0:15176:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff98db83baa180 - data ffff98db824461b0/ffff98dcb6d1f000 00000020:01000000:3.0:1790740395.818593:0:15176:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff98dcb5e63de0 - data ffff98dcaa088bd0/ffff98dcb5e8f000 00000001:00000004:3.0:1790740395.826548:0:15176:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:0.0:1790740395.890624:0:15176:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1790740395.890632:0:15176:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1790740395.890647:0:15176:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff98dcbd5f8a80 x1877727022056960/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1790740403 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740395.890673:0:15176:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1790740395.893435:0:15176:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1790740395.893443:0:15176:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:0.0:1790740395.893455:0:15176:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790740395.893469:0:15176:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1790740395.893810:0:8610:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1790740395.893816:0:8610:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:2.0:1790740395.893828:0:8610:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1790740395.894623:0:15176:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1790740395.894628:0:15176:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:0.0:1790740395.894649:0:15176:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790740395.894651:0:15176:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1790740395.894984:0:9804:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1790740395.894989:0:9804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1790740395.894998:0:9804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1790740395.899938:0:15176:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92d687 00000020:00000080:0.0:1790740395.899960:0:15176:0:(genops.c:885:class_export_put()) final put ffff98dcb811a800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1790740395.900259:0:11805:0:(genops.c:844:class_export_destroy()) destroying export ffff98dcb811a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1790740395.908024:0:15176:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92d69c 00000020:00000080:0.0:1790740395.908073:0:15176:0:(genops.c:885:class_export_put()) final put ffff98dcb81ff800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1790740395.908087:0:15176:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1790740395.908094:0:15176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790740395.908102:0:15176:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790740395.908106:0:15176:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff98dcb81d99c0) has no exports 00000020:00000080:2.0:1790740395.908411:0:11805:0:(genops.c:844:class_export_destroy()) destroying export ffff98dcb81ff800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:0.0:1790740395.908585:0:15176:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1790740395.908596:0:15176:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92dad2 00000020:00000080:0.0:1790740395.908601:0:15176:0:(genops.c:885:class_export_put()) final put ffff98db83e4d000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1790740395.908616:0:15176:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1790740395.908621:0:15176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790740395.908631:0:15176:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1790740395.908634:0:15176:0:(genops.c:1557:class_disconnect_exports()) OBD device 28 (ffff98dcaefcb380) has no exports 00000020:00000080:0.0:1790740395.908641:0:15176:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92dacb 00000020:00000080:0.0:1790740395.908655:0:15176:0:(genops.c:885:class_export_put()) final put ffff98dcae18e800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1790740395.909015:0:11805:0:(genops.c:844:class_export_destroy()) destroying export ffff98db83e4d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1790740395.909022:0:11805:0:(genops.c:844:class_export_destroy()) destroying export ffff98dcae18e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1790740395.909513:0:15176:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1790740395.909517:0:15176:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1790740395.909522:0:15176:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:0.0:1790740395.909648:0:15176:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790740395.909652:0:15176:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790740395.909703:0:15176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790740395.909714:0:15176:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790740395.909721:0:15176:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92d990 00000020:00000080:0.0:1790740395.909727:0:15176:0:(genops.c:885:class_export_put()) final put ffff98dcb5f1b800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1790740395.909732:0:15176:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1790740395.909735:0:15176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790740395.909740:0:15176:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1790740395.909743:0:15176:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff98dcbd5a0000) has no exports 00000020:00000080:0.0:1790740395.909748:0:15176:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92d989 00000020:00000080:0.0:1790740395.909752:0:15176:0:(genops.c:885:class_export_put()) final put ffff98dcbd512800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1790740395.910064:0:11805:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98dcb5cc0000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1790740395.910072:0:11805:0:(genops.c:885:class_export_put()) final put ffff98db82355000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790740395.910074:0:11805:0:(genops.c:844:class_export_destroy()) destroying export ffff98db82355000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1790740395.910079:0:11805:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790740395.910161:0:11805:0:(genops.c:844:class_export_destroy()) destroying export ffff98dcb5f1b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1790740395.910178:0:11805:0:(genops.c:844:class_export_destroy()) destroying export ffff98dcbd512800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1790740395.910419:0:15176:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1790740395.910422:0:15176:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1790740395.910425:0:15176:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:0.0:1790740395.910429:0:15176:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790740395.910431:0:15176:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790740395.910472:0:15176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790740395.910479:0:15176:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1790740395.910492:0:15176:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1790740395.910499:0:15176:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92d840 00000020:00000080:0.0:1790740395.910504:0:15176:0:(genops.c:885:class_export_put()) final put ffff98dcbc1fc000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1790740395.910508:0:15176:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1790740395.910511:0:15176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790740395.910516:0:15176:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1790740395.910519:0:15176:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff98dcae1799c0) has no exports 00000020:00000080:0.0:1790740395.910523:0:15176:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92d839 00000020:00000080:0.0:1790740395.910526:0:15176:0:(genops.c:885:class_export_put()) final put ffff98dcb5f1c000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1790740395.910688:0:11805:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98dcaec8d800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1790740395.910695:0:11805:0:(genops.c:885:class_export_put()) final put ffff98dcb5f1f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790740395.910697:0:11805:0:(genops.c:844:class_export_destroy()) destroying export ffff98dcb5f1f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1790740395.910702:0:11805:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790740395.910739:0:11805:0:(genops.c:844:class_export_destroy()) destroying export ffff98dcbc1fc000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00010000:01000000:1.0:1790740395.914111:0:15176:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1790740395.914120:0:15176:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1790740395.914125:0:15176:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:1.0:1790740395.914133:0:15176:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790740395.915224:0:11805:0:(genops.c:844:class_export_destroy()) destroying export ffff98dcb5f1c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1790740395.919375:0:15176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790740395.919395:0:15176:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790740395.919425:0:15176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790740395.919429:0:15176:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790740395.919434:0:15176:0:(genops.c:885:class_export_put()) final put ffff98dcb811d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790740395.919439:0:15176:0:(genops.c:844:class_export_destroy()) destroying export ffff98dcb811d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1790740395.919463:0:15176:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790740395.920138:0:11805:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98dcb5f1e000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1790740395.920150:0:11805:0:(genops.c:885:class_export_put()) final put ffff98dcb5f1f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790740395.920152:0:11805:0:(genops.c:844:class_export_destroy()) destroying export ffff98dcb5f1f800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1790740395.920161:0:11805:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790740395.920341:0:15176:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92d6a3 00000020:00000080:1.0:1790740395.920349:0:15176:0:(genops.c:885:class_export_put()) final put ffff98dcb81fa800/lustre-MDD0000_UUID 00000020:01000000:1.0:1790740395.920368:0:15176:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1790740395.920373:0:15176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790740395.920379:0:15176:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1790740395.920383:0:15176:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff98dcb81d8000) has no exports 00000020:00000080:1.0:1790740395.920407:0:15176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790740395.920411:0:15176:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1790740395.920416:0:15176:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92d6aa 00000020:00000080:1.0:1790740395.920419:0:15176:0:(genops.c:885:class_export_put()) final put ffff98dcb81f8000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1790740395.920429:0:15176:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98dc82d23800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1790740395.920432:0:15176:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98dc82d23800 3 00000020:01000004:1.0:1790740395.920435:0:15176:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98dc82d23800 from lustre-MDT0000 00000020:00000080:1.0:1790740395.920452:0:15176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790740395.920547:0:11805:0:(genops.c:844:class_export_destroy()) destroying export ffff98dcb81fa800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1790740395.920560:0:11805:0:(genops.c:885:class_export_put()) final put ffff98dcb811e800/lustre-MDD0000_UUID 00000020:00000080:2.0:1790740395.920563:0:11805:0:(genops.c:844:class_export_destroy()) destroying export ffff98dcb811e800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1790740395.920566:0:11805:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1790740395.920600:0:11805:0:(genops.c:844:class_export_destroy()) destroying export ffff98dcb81f8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1790740395.920682:0:15176:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1790740395.920686:0:15176:0:(genops.c:885:class_export_put()) final put ffff98dcb8118000/lustre-MDT0000_UUID 00000020:00000080:1.0:1790740395.920689:0:15176:0:(genops.c:844:class_export_destroy()) destroying export ffff98dcb8118000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1790740395.920696:0:15176:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1790740395.920736:0:15176:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1790740395.920740:0:15176:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1790740395.920743:0:15176:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1790740395.920746:0:15176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790740395.920749:0:15176:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1790740395.920755:0:15176:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff98dcb14e5000 ad8ddc53-446f-4b77-85d5-90ebc88dfa76 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790740395.920761:0:15176:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff98dc89740000) has exports, disconnecting them 00000020:00080000:1.0:1790740395.920765:0:15176:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff98dcb14e5000), last request at 1790740132 00000020:00000080:1.0:1790740395.920779:0:15176:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92d648 00000020:00010000:1.0:1790740395.920784:0:15176:0:(genops.c:1920:obd_stale_export_put()) Put export ffff98dcb14e5000: total 0 00000100:00080000:1.0:1790740395.920789:0:15176:0:(import.c:65:import_set_state_nolock()) ffff98dcb14e1000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1790740395.920829:0:15176:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff98dcb14e5000): rc 0 00000020:00080000:1.0:1790740395.920839:0:15176:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff98dc89740000) has no exports 00000100:00100000:1.0:1790740395.920896:0:6530:0:(service.c:3206:ptlrpc_main()) ll_mgs_0002: service thread [ffff98dc873f8400:6530] 2 exiting: rc = 0 00000100:00100000:1.0:1790740395.921394:0:6528:0:(service.c:3206:ptlrpc_main()) ll_mgs_0000: service thread [ffff98dcad2e3a00:6528] 0 exiting: rc = 1 00000020:00010000:2.0:1790740395.921507:0:6524:0:(genops.c:1906:obd_stale_export_get()) Get export ffff98dcb14e5000: total 0 00010000:00010000:2.0:1790740395.921554:0:6524:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98dcb14e5000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1790740395.921587:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dc80031400/0xb25dda4f4e92db8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb25dda4f4e92db88 expref: 14 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740395.921604:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcb5dc9600/0xb25dda4f4e92d744 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb25dda4f4e92d73d expref: 13 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740395.921619:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dc80030e00/0xb25dda4f4e92db81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb25dda4f4e92db7a expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740395.921631:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcb5dc8400/0xb25dda4f4e92dde9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb25dda4f4e92dde2 expref: 11 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740395.921642:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dca1969e00/0xb25dda4f4e92d752 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb25dda4f4e92d74b expref: 10 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740395.921655:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcb5dc8000/0xb25dda4f4e92dddb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb25dda4f4e92ddd4 expref: 9 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740395.921664:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dc81489000/0xb25dda4f4e92dbb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb25dda4f4e92dbb2 expref: 8 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740395.921673:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dc81489e00/0xb25dda4f4e92db49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb25dda4f4e92db42 expref: 7 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740395.921682:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98db83f32800/0xb25dda4f4e92ddf7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb25dda4f4e92ddf0 expref: 6 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740395.921704:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcaf060400/0xb25dda4f4e92db57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb25dda4f4e92db50 expref: 5 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740395.921714:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcaeee3400/0xb25dda4f4e92da69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb25dda4f4e92da62 expref: 4 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740395.921723:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dc81488400/0xb25dda4f4e92db65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb25dda4f4e92db5e expref: 3 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740395.921732:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dc81488800/0xb25dda4f4e92db73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb25dda4f4e92db6c expref: 2 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740395.921743:0:6524:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98dcb14e5000, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1790740395.921756:0:6524:0:(genops.c:885:class_export_put()) final put ffff98dcb14e5000/ad8ddc53-446f-4b77-85d5-90ebc88dfa76 00010000:00010000:2.0:1790740395.921780:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740395.921783:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740395.921785:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790740395.923339:0:11805:0:(genops.c:844:class_export_destroy()) destroying export ffff98dcb14e5000/ad8ddc53-446f-4b77-85d5-90ebc88dfa76 for MGS 00000020:00000080:1.0:1790740395.923384:0:11805:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98dcb14e1000 for MGS 00000100:00100000:1.0:1790740395.927132:0:6529:0:(service.c:3206:ptlrpc_main()) ll_mgs_0001: service thread [ffff98dca0440600:6529] 1 exiting: rc = 0 00000100:00100000:2.0:1790740395.927691:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.927700:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.927706:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.927711:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.927717:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.927722:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.927727:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.927734:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.927740:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.927747:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.927753:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.927758:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.927763:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.927770:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.927792:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.927798:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.927803:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.927808:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.927815:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.927820:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.927826:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.927830:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.927835:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.927841:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.927846:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.927852:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.927857:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.927862:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.927868:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.927873:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.927890:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.927896:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.927901:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.927906:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.927912:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.927916:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.927922:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.927927:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.927932:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.927938:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.927944:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.927950:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.927955:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.927960:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.927965:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.927969:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.927975:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.927979:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.927984:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.928010:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.928016:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.928021:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.928026:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.928070:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.928076:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.928082:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.928088:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.928094:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.928099:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.928105:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.928110:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.928116:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.928122:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740395.928129:0:15176:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1790740395.942599:0:15176:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff98db83baa780 - data ffff98db82446e58/ffff98dcb6c1c400 00000020:01000000:1.0:1790740395.942723:0:15176:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff98dc83097660 - data ffff98dcaa082bd0/ffff98dca0c18800 00000020:00000080:1.0:1790740395.943760:0:15176:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92d62c 00000020:00000080:1.0:1790740395.943772:0:15176:0:(genops.c:885:class_export_put()) final put ffff98dc84da4000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1790740395.943793:0:15176:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98dc82d23800 from MGS, refs=2 00000020:01000004:1.0:1790740395.943797:0:15176:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98dc82d23800 2 00000020:01000004:1.0:1790740395.943800:0:15176:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98dc82d23800 from MGS 00000020:00000080:1.0:1790740395.943824:0:15176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790740395.943832:0:15176:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1790740395.943835:0:15176:0:(genops.c:885:class_export_put()) final put ffff98dc856a9800/MGS 00000020:00000080:1.0:1790740395.943838:0:15176:0:(genops.c:844:class_export_destroy()) destroying export ffff98dc856a9800/MGS for MGS 00000020:01000000:1.0:1790740395.943846:0:15176:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1790740395.943912:0:15176:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1790740395.943916:0:15176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790740395.943922:0:15176:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1790740395.943929:0:15176:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff98dcb812a800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790740395.943935:0:15176:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff98dc99248000) has exports, disconnecting them 00000020:00080000:1.0:1790740395.943939:0:15176:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff98dcb812a800), last request at 1790740132 00000020:00000080:1.0:1790740395.943944:0:15176:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92d6f7 00000020:00080000:1.0:1790740395.943956:0:15176:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff98dcb812a800): rc 0 00000020:00000080:1.0:1790740395.943961:0:15176:0:(genops.c:885:class_export_put()) final put ffff98dcb812a800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1790740395.945520:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98dc84da4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1790740395.945542:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98dcb812a800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1790740395.961144:0:15176:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1790740395.961155:0:15176:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790740395.961160:0:15176:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1790740395.961167:0:15176:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790740395.961202:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98dca0cb6800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1790740395.961381:0:15176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790740395.961391:0:15176:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1790740395.961397:0:15176:0:(genops.c:885:class_export_put()) final put ffff98dcb812f800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1790740395.961402:0:15176:0:(genops.c:844:class_export_destroy()) destroying export ffff98dcb812f800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1790740395.961413:0:15176:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1790740395.961499:0:15176:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98dc82d23800 1 00000020:00000080:2.0:1790740395.961506:0:15176:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92d61e 00000020:00000080:2.0:1790740395.961530:0:15176:0:(genops.c:885:class_export_put()) final put ffff98dc856a8800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1790740395.961540:0:15176:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1790740395.961548:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98dc856a8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1790740395.961568:0:15176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790740395.961573:0:15176:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1790740395.961578:0:15176:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff98dc89744d40) has no exports 00000020:00000080:3.0:1790740396.077400:0:15176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790740396.077415:0:15176:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1790740396.077421:0:15176:0:(genops.c:885:class_export_put()) final put ffff98dc82d22800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1790740396.077426:0:15176:0:(genops.c:844:class_export_destroy()) destroying export ffff98dc82d22800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1790740396.077432:0:15176:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1790740396.077568:0:15176:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98dc82d25000 00000020:02000400:3.0:1790740396.077633:0:15176:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:0.0:1790740396.138288:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790740396.138311:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022057600:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790740396.138383:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740396.138452:0:8456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022057600 00000100:00100000:0.0:1790740396.138460:0:8456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022057600 00000100:00100000:0.0:1790740396.138537:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1790740396.138548:0:8456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022057600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790740396.138581:0:8456:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1790740396.138628:0:8456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022057600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740396.138803:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:0.0:1790740396.138829:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790740396.138876:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022057600:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1790740396.522807:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790740396.843226:0:13823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790740397.547997:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790740397.674223:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790740397.674231:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1790740397.674242:0:37:0:(import.c:65:import_set_state_nolock()) ffff98dcbc254800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790740397.674253:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 466 00000100:00080000:1.0:1790740397.674261:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1790740397.674276:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98dcbc254800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:1.0:1790740397.674309:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98dcb81b4380 x1877727022057856/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790740397.674417:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb81b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877727022057856:0@lo:38:kworker.0 00000100:00100000:1.0:1790740397.674509:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740397.674604:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1877727022058112:0@lo:400:kworker.0 00000100:00100000:1.0:1790740397.674638:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740397.674665:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1877727022058624:0@lo:400:kworker.0 00000100:00100000:1.0:1790740397.674689:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740397.674713:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790740397.674718:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84527100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1877727022058240:0@lo:400:kworker.0 00000100:00100000:1.0:1790740397.674742:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740397.674761:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84526680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022058752:0@lo:400:kworker.0 00000100:00100000:1.0:1790740397.674814:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740397.674854:0:6541:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022057856 00000100:00100000:1.0:1790740397.674863:0:6541:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022057856 00000100:00100000:1.0:1790740397.674904:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1790740397.675396:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84524380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877727022057984:0@lo:400:kworker.0 00000100:00100000:0.0:1790740397.675442:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740397.675470:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1877727022058496:0@lo:400:kworker.0 00000100:00100000:0.0:1790740397.675496:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740397.675526:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1790740397.675533:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3639:1877727022057728:0@lo:400:kworker.0 00000400:00000100:0.0:1790740397.675553:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877727022057728 offset 0 length 224: 4 00000100:00100000:0.0:1790740397.675572:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84527480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022058368:0@lo:400:kworker.0 00000100:00100000:0.0:1790740397.675598:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740397.675662:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022058752 00000100:00100000:0.0:1790740397.675668:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022058752 00000100:00100000:0.0:1790740397.675721:0:8454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022058368 00000100:00100000:0.0:1790740397.675724:0:8454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022058368 00000100:00100000:0.0:1790740397.675764:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1790740397.675891:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84524000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022058752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740397.676066:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84524000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022058752:12345-0@lo:400:kworker.0 Request processed in 294us (1250us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740397.676074:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1790740397.676094:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1790740397.676405:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022058112 00000100:00100000:2.0:1790740397.676412:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022058112 00000100:00100000:2.0:1790740397.676436:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022058624 00000100:00100000:2.0:1790740397.676440:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022058624 00000100:00100000:2.0:1790740397.676458:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022058240 00000100:00100000:2.0:1790740397.676461:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022058240 00000100:00100000:2.0:1790740397.676476:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022057984 00000100:00100000:2.0:1790740397.676480:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022057984 00000100:00100000:2.0:1790740397.676489:0:13222:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022058496 00000100:00100000:2.0:1790740397.676492:0:13222:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022058496 00000100:00100000:2.0:1790740397.676504:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1790740397.676513:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877727022058624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740397.676560:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877727022058624:12345-0@lo:400:kworker.0 Request processed in 49us (1870us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740397.676567:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1790740397.676583:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1790740397.676589:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877727022058240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740397.676621:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877727022058240:12345-0@lo:400:kworker.0 Request processed in 32us (1877us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740397.676627:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1790740397.676639:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1790740397.676643:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1877727022058112:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1790740397.676649:0:13222:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1790740397.676676:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1877727022058112:12345-0@lo:400:kworker.0 Request processed in 31us (2037us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790740397.676698:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1790740397.676712:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1790740397.676716:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1877727022057984:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1790740397.676720:0:13222:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1790740397.676751:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1877727022057984:12345-0@lo:400:kworker.0 Request processed in 34us (1309us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790740397.676757:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1790740397.676766:0:13222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1790740397.677018:0:6541:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1877727022057856:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1790740397.677068:0:6541:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1790740397.677218:0:8454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022058368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740397.677259:0:8454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022058368:12345-0@lo:400:kworker.0 Request processed in 1158us (1660us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740397.677266:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:0.0:1790740397.677306:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790740397.677312:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1790740397.677362:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff98db84527100 x1877727022058240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740397.677378:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84527100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1877727022058240:0@lo:400:kworker.0 00000100:00100000:0.0:1790740397.677395:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84526680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022058752:0@lo:400:kworker.0 00000100:00080000:0.0:1790740397.677411:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1790740397.677416:0:3640:0:(import.c:65:import_set_state_nolock()) ffff98db829b5800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1790740397.677421:0:3640:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1790740397.678028:0:6541:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1877727022057856:12345-0@lo:38:kworker.0 Request processed in 3111us (3515us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790740397.678072:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1790740397.678207:0:13222:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1877727022058496:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1790740397.678217:0:13222:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1790740397.678270:0:13222:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1877727022058496:12345-0@lo:400:kworker.0 Request processed in 1498us (2773us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790740397.678278:0:13222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1790740397.678383:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022058880:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790740397.678431:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740397.678482:0:10118:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022058880 00000100:00100000:2.0:1790740397.678491:0:10118:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022058880 00000100:00100000:2.0:1790740397.678537:0:10118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1790740397.678545:0:10118:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022058880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790740397.678577:0:10118:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790740397.678619:0:10118:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022058880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740397.678625:0:10118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1790740397.678664:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022058880:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790740397.678706:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84527480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022058368:0@lo:400:kworker.0 00000100:00080000:2.0:1790740397.678736:0:3639:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1790740397.678740:0:3639:0:(import.c:65:import_set_state_nolock()) ffff98dcaec8c800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1790740397.678744:0:3639:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1790740397.678751:0:3639:0:(import.c:65:import_set_state_nolock()) ffff98dcaec8c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790740397.678755:0:3639:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 226 00000100:00080000:2.0:1790740397.678767:0:3639:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98dcaec8c800 using connection 192.168.204.103@tcp/0@lo 00000100:00080000:1.0:1790740397.679080:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98dcbc254800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790740397.679092:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790740397.679096:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb81b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877727022057856:0@lo:38:kworker.0 00000100:00100000:2.0:1790740397.683028:0:3639:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98dcbd5f9500 x1877727022059008/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790740397.683251:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84524380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877727022057984:0@lo:400:kworker.0 00000100:00080000:2.0:1790740397.683306:0:3639:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1790740397.683313:0:3639:0:(import.c:65:import_set_state_nolock()) ffff98db82ff7000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1790740397.683319:0:3639:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1790740397.683325:0:3639:0:(import.c:65:import_set_state_nolock()) ffff98db82ff7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790740397.683330:0:3639:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 272 00000100:00080000:2.0:1790740397.683347:0:3639:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98db82ff7000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:2.0:1790740397.683366:0:3639:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98dcbd5fa300 x1877727022059136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790740397.683378:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1877727022058496:0@lo:400:kworker.0 00000100:00100000:1.0:1790740397.687307:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877727022059008:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1790740397.687429:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740397.687492:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1877727022059136:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1790740397.687521:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740397.687583:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022059008 00000100:00100000:1.0:1790740397.687595:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022059008 00000100:00100000:1.0:1790740397.687637:0:6536:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022059136 00000100:00100000:1.0:1790740397.687640:0:6536:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022059136 00000100:00100000:1.0:1790740397.687662:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1790740397.687670:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1877727022059008:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:1.0:1790740397.687699:0:6536:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1790740397.687753:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1877727022059008:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 82us (324us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790740397.687760:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1790740397.687793:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1790740397.687797:0:6536:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1877727022059136:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:1.0:1790740397.687807:0:6536:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1790740397.687831:0:6536:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1877727022059136:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 32us (309us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790740397.687837:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:1.0:1790740397.687883:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98dcaec8c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790740397.687889:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790740397.687977:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877727022059008:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:1.0:1790740397.687994:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98db82ff7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790740397.688007:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790740397.688010:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1877727022059136:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:0.0:1790740397.726111:0:3640:0:(import.c:65:import_set_state_nolock()) ffff98db829b5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790740397.726131:0:3640:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 249 00000100:00080000:0.0:1790740397.726153:0:3640:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98db829b5800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:0.0:1790740397.726261:0:3640:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98db83dc7b80 x1877727022059264/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790740397.726313:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1877727022058112:0@lo:400:kworker.0 00010000:00080000:0.0:1790740397.726357:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff98db84524a80 x1877727022058624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740397.726371:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1877727022058624:0@lo:400:kworker.0 00000100:00100000:1.0:1790740397.726412:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1877727022059264:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1790740397.726502:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740397.727142:0:7760:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022059264 00000100:00100000:0.0:1790740397.727153:0:7760:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022059264 00000100:00100000:0.0:1790740397.727208:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1790740397.727218:0:7760:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3637:x1877727022059264:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:0.0:1790740397.727245:0:7760:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1790740397.727313:0:7760:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3637:x1877727022059264:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 95us (811us total) trans 0 rc -19/-19 00000100:00100000:0.0:1790740397.727322:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:1.0:1790740397.729521:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98db829b5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790740397.729537:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790740397.729543:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1877727022059264:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:0.0:1790740398.574174:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740399.594332:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790740400.612518:0:15378:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00010000:00010000:2.0:1790740400.619754:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790740400.633541:0:15378:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1790740400.633625:0:15378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dc81488e00/0xb25dda4f4e92db7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92db81 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740400.633667:0:15378:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dc81488e00/0xb25dda4f4e92db7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92db81 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740400.633676:0:15378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dc81488e00/0xb25dda4f4e92db7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xb25dda4f4e92db81 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740400.633685:0:15378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: ffff98dc81488e00/0xb25dda4f4e92db7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xb25dda4f4e92db81 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740400.633784:0:15378:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1790740400.633792:0:15378:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1790740400.633827:0:15378:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790740400.633832:0:15378:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1790740400.633840:0:15378:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1790740400.633848:0:15378:0:(import.c:65:import_set_state_nolock()) ffff98dcaec8c800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1790740400.633855:0:15378:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790740400.633857:0:15378:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1790740400.633861:0:15378:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1790740400.635898:0:15378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dc81489200/0xb25dda4f4e92db88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92db8f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740400.635922:0:15378:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dc81489200/0xb25dda4f4e92db88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92db8f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740400.635928:0:15378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dc81489200/0xb25dda4f4e92db88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xb25dda4f4e92db8f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740400.635935:0:15378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: ffff98dc81489200/0xb25dda4f4e92db88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xb25dda4f4e92db8f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740400.637456:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790740400.637474:0:6524:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dc81488e00/0xb25dda4f4e92db7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xb25dda4f4e92db81 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740400.637488:0:6524:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dc81488e00 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:0.0:1790740400.637493:0:6524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dc81488e00/0xb25dda4f4e92db7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xb25dda4f4e92db81 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740400.637504:0:6524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dc81488e00/0xb25dda4f4e92db7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xb25dda4f4e92db81 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790740400.637512:0:6524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dc81488e00/0xb25dda4f4e92db7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xb25dda4f4e92db81 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740400.637541:0:6524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790740400.637544:0:6524:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1790740400.637548:0:6524:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1790740400.637649:0:15378:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790740400.637662:0:15378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dca1968c00/0xb25dda4f4e92da62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92da69 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740400.637670:0:15378:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dca1968c00/0xb25dda4f4e92da62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92da69 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740400.637676:0:15378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dca1968c00/0xb25dda4f4e92da62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb25dda4f4e92da69 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740400.637684:0:15378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: ffff98dca1968c00/0xb25dda4f4e92da62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb25dda4f4e92da69 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740400.637704:0:15378:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1790740400.637718:0:10357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790740400.637724:0:10357:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dc81489200/0xb25dda4f4e92db88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xb25dda4f4e92db8f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740400.637730:0:10357:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dc81489200 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:2.0:1790740400.637733:0:10357:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dc81489200/0xb25dda4f4e92db88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xb25dda4f4e92db8f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740400.637740:0:10357:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dc81489200/0xb25dda4f4e92db88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xb25dda4f4e92db8f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790740400.637747:0:10357:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dc81489200/0xb25dda4f4e92db88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xb25dda4f4e92db8f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740400.637753:0:10357:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790740400.637763:0:10357:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:2.0:1790740400.637804:0:10357:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dc81489200/0xb25dda4f4e92db88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xb25dda4f4e92db8f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740400.637811:0:10357:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790740400.637838:0:10357:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dc81489200/0xb25dda4f4e92db88 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xb25dda4f4e92db8f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740400.637845:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dc81489200/0xb25dda4f4e92db88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xb25dda4f4e92db8f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740400.637859:0:10357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790740400.637863:0:10357:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dca1968c00/0xb25dda4f4e92da62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb25dda4f4e92da69 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740400.637869:0:10357:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dca1968c00 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:2.0:1790740400.637872:0:10357:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dca1968c00/0xb25dda4f4e92da62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb25dda4f4e92da69 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740400.637879:0:10357:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dca1968c00/0xb25dda4f4e92da62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xb25dda4f4e92da69 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790740400.637894:0:10357:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dca1968c00/0xb25dda4f4e92da62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xb25dda4f4e92da69 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740400.637900:0:10357:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1790740400.637902:0:10357:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1790740400.637904:0:10357:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1790740400.637917:0:10357:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dca1968c00/0xb25dda4f4e92da62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb25dda4f4e92da69 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740400.637922:0:10357:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790740400.637959:0:10357:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dca1968c00/0xb25dda4f4e92da62 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb25dda4f4e92da69 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740400.637967:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dca1968c00/0xb25dda4f4e92da62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb25dda4f4e92da69 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740400.637983:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740400.637985:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740400.637987:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740400.638015:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3639:1877727022059392:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790740400.638142:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790740400.638409:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740400.638453:0:15378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaf060e00/0xb25dda4f4e92ddf0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ddf7 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740400.638464:0:15378:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaf060e00/0xb25dda4f4e92ddf0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92ddf7 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740400.638470:0:15378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaf060e00/0xb25dda4f4e92ddf0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb25dda4f4e92ddf7 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740400.638490:0:15378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: ffff98dcaf060e00/0xb25dda4f4e92ddf0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb25dda4f4e92ddf7 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740400.638505:0:15378:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790740400.638513:0:15378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dc80031600/0xb25dda4f4e92d74b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92d752 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740400.638520:0:15378:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dc80031600/0xb25dda4f4e92d74b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92d752 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740400.638527:0:15378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dc80031600/0xb25dda4f4e92d74b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb25dda4f4e92d752 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740400.638534:0:15378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: ffff98dc80031600/0xb25dda4f4e92d74b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb25dda4f4e92d752 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740400.638545:0:15378:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1790740400.638551:0:15378:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:3.0:1790740400.638555:0:15378:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:3.0:1790740400.638600:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790740400.638605:0:6523:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dcaf060e00/0xb25dda4f4e92ddf0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb25dda4f4e92ddf7 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740400.638612:0:6523:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf060e00 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:3.0:1790740400.638616:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dcaf060e00/0xb25dda4f4e92ddf0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb25dda4f4e92ddf7 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740400.638624:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dcaf060e00/0xb25dda4f4e92ddf0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb25dda4f4e92ddf7 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790740400.638643:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dcaf060e00/0xb25dda4f4e92ddf0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb25dda4f4e92ddf7 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740400.638648:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1790740400.638651:0:6523:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1790740400.638652:0:6523:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1790740400.638673:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dcaf060e00/0xb25dda4f4e92ddf0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xb25dda4f4e92ddf7 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740400.638679:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790740400.638689:0:6523:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dcaf060e00/0xb25dda4f4e92ddf0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xb25dda4f4e92ddf7 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740400.638695:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dcaf060e00/0xb25dda4f4e92ddf0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xb25dda4f4e92ddf7 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740400.638707:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740400.638710:0:6523:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dc80031600/0xb25dda4f4e92d74b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb25dda4f4e92d752 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740400.638717:0:6523:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dc80031600 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:3.0:1790740400.638720:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dc80031600/0xb25dda4f4e92d74b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb25dda4f4e92d752 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740400.638727:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dc80031600/0xb25dda4f4e92d74b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xb25dda4f4e92d752 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790740400.638733:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dc80031600/0xb25dda4f4e92d74b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xb25dda4f4e92d752 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740400.638749:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1790740400.638751:0:6523:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1790740400.638753:0:6523:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1790740400.638767:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dc80031600/0xb25dda4f4e92d74b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb25dda4f4e92d752 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740400.638772:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790740400.638783:0:6523:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dc80031600/0xb25dda4f4e92d74b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb25dda4f4e92d752 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740400.638796:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dc80031600/0xb25dda4f4e92d74b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb25dda4f4e92d752 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740400.638811:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740400.638813:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740400.638814:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740400.638827:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db845bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727022059776:0@lo:103:ldlm_bl.0 00000020:01000004:3.0:1790740400.638894:0:15378:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1790740400.638901:0:15378:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1790740400.638909:0:15378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790740400.638917:0:15378:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1790740400.638924:0:15378:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff98db82ff5800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790740400.638930:0:15378:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff98db829b2000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790740400.638937:0:15378:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff98dcae178000) has exports, disconnecting them 00000020:00080000:3.0:1790740400.638950:0:15378:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff98db82ff5800), last request at 1790740397 00000020:00000080:3.0:1790740400.638960:0:15378:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92da2a 00000100:00080000:3.0:1790740400.638980:0:15378:0:(import.c:65:import_set_state_nolock()) ffff98db82ff4800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1790740400.639021:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1790740400.639251:0:15378:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff98db82ff5800): rc 0 00000020:00000080:3.0:1790740400.639254:0:15378:0:(genops.c:885:class_export_put()) final put ffff98db82ff5800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1790740400.639267:0:15378:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff98db829b2000), last request at 1790740397 00000020:00000080:3.0:1790740400.639271:0:15378:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92d904 00000100:00080000:3.0:1790740400.639280:0:15378:0:(import.c:65:import_set_state_nolock()) ffff98db829b4000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1790740400.639296:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98db82ff5800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1790740400.639355:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98db82ff4800 for lustre-MDT0001 00010000:00010000:3.0:1790740400.639365:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1790740400.639373:0:15378:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff98db829b2000): rc 0 00000020:00000080:3.0:1790740400.639376:0:15378:0:(genops.c:885:class_export_put()) final put ffff98db829b2000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1790740400.639388:0:15378:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb5b101c0bae0 00000020:00000080:3.0:1790740400.639402:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98db829b2000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1790740400.639426:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98db829b4000 for lustre-MDT0001 00000100:00080000:3.0:1790740400.639454:0:15378:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790740400.639464:0:15378:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff98db83dc6300 x1877727022057344/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1790740411 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740400.639477:0:15378:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:3.0:1790740400.640597:0:15378:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1790740400.640607:0:15378:0:(import.c:65:import_set_state_nolock()) ffff98dcbc254800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00100000:3.0:1790740400.640688:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db845be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3641:1877727022059648:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790740400.640781:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740400.641715:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727022059520:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790740400.641842:0:6524:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dc81488e00/0xb25dda4f4e92db7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xb25dda4f4e92db81 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740400.641856:0:6524:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790740400.641939:0:6524:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dc81488e00/0xb25dda4f4e92db7a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xb25dda4f4e92db81 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740400.642214:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dc81488e00/0xb25dda4f4e92db7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xb25dda4f4e92db81 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740400.642326:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740400.642329:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740400.642332:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740400.642479:0:9550:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022059392 00000100:00100000:1.0:1790740400.642491:0:9550:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022059392 00000100:00100000:1.0:1790740400.642547:0:9550:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022059648 00000100:00100000:1.0:1790740400.642551:0:9550:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022059648 00000100:00100000:1.0:1790740400.642571:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790740400.642600:0:9550:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3639:x1877727022059392:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1790740400.642608:0:9550:0:(ldlm_lockd.c:2567:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790740400 with bad export cookie 12852668945740781128 00000100:00080000:3.0:1790740400.642664:0:15378:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1790740400.642670:0:15378:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967299 gen 3 00000100:00100000:2.0:1790740400.642807:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84527480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3639:1877727022059904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790740400.642853:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740400.643194:0:6520:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022059904 00000100:00100000:0.0:1790740400.643200:0:6520:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022059904 00000100:00100000:0.0:1790740400.643227:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790740400.643234:0:6520:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db845bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3641:x1877727022059648:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1790740400.643239:0:6520:0:(ldlm_lockd.c:2567:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790740400 with bad export cookie 12852668945740781128 00000100:00100000:0.0:1790740400.643307:0:6520:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db845bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3641:x1877727022059648:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (2526us total) trans 0 rc -107/-107 00000100:00100000:0.0:1790740400.643315:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790740400.643334:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790740400.643338:0:6520:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3639:x1877727022059904:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1790740400.643342:0:6520:0:(ldlm_lockd.c:2567:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790740400 with bad export cookie 12852668945740781128 00000004:00080000:3.0:1790740400.645818:0:15378:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:2.0:1790740400.646128:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790740400.646266:0:15378:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1790740400.646317:0:15378:0:(import.c:65:import_set_state_nolock()) ffff98dcbd56f000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1790740400.646358:0:15378:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1790740400.646363:0:15378:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000100:00100000:2.0:1790740400.646427:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877727022060032:0@lo:9:umount.0 00000100:00100000:2.0:1790740400.646516:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1790740400.646625:0:15378:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1790740400.646758:0:15378:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1790740400.646770:0:15378:0:(import.c:65:import_set_state_nolock()) ffff98db83c5c000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1790740400.646806:0:15378:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff98dcae178000) has no exports 00000100:00100000:3.0:1790740400.646892:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740400.646924:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022057344:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790740400.647253:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877727022060160:0@lo:9:umount.0 00000100:00100000:2.0:1790740400.647296:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740400.647443:0:6522:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022059520 00000100:00100000:2.0:1790740400.647453:0:6522:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022059520 00000100:00100000:2.0:1790740400.647500:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790740400.647509:0:6522:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3640:x1877727022059520:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1790740400.647516:0:6522:0:(ldlm_lockd.c:2567:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790740400 with bad export cookie 12852668945740781128 00000100:00100000:2.0:1790740400.647575:0:6522:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3640:x1877727022059520:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (694us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790740400.647582:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790740400.647609:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022060032 00000100:00100000:2.0:1790740400.647612:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022060032 00000100:00100000:2.0:1790740400.647668:0:9806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022060160 00000100:00100000:2.0:1790740400.647671:0:9806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022060160 00000100:00080000:3.0:1790740400.647825:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.103@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1790740400.647830:0:3640:0:(import.c:65:import_set_state_nolock()) ffff98dc85fb1800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1790740400.647834:0:3640:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.103@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:2.0:1790740400.647984:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790740400.647991:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84651500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1877727022060032:12345-0@lo:9:umount.0 00000020:00000080:2.0:1790740400.648022:0:9806:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92d951 00000100:00080000:2.0:1790740400.648050:0:9806:0:(import.c:65:import_set_state_nolock()) ffff98db829b3800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790740400.648112:0:9806:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1790740400.648293:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84651500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3637:x1877727022060032:12345-0@lo:9:umount.0 Request processed in 303us (1776us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740400.648299:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790740400.648312:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790740400.648318:0:9806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84650380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1877727022060160:12345-0@lo:9:umount.0 00000020:00000080:2.0:1790740400.648329:0:9806:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92da93 00000100:00080000:2.0:1790740400.648335:0:9806:0:(import.c:65:import_set_state_nolock()) ffff98dcb81fe800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790740400.648360:0:9806:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1790740400.648441:0:9806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84650380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3637:x1877727022060160:12345-0@lo:9:umount.0 Request processed in 124us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740400.648448:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00010000:2.0:1790740400.648478:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790740400.648506:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98db83c5c000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1790740400.648519:0:3637:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1790740400.648521:0:3637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790740400.648525:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877727022060160:0@lo:9:umount.0 00000100:00080000:2.0:1790740400.648537:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98dcbd56f000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1790740400.648547:0:3637:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1790740400.648549:0:3637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790740400.648552:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877727022060032:0@lo:9:umount.0 00000100:00080000:2.0:1790740400.649308:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.103@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:0.0:1790740400.651616:0:6520:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3639:x1877727022059904:12345-0@lo:103:ldlm_bl.0 Request processed in 8258us (8745us total) trans 0 rc -107/-107 00000100:00100000:0.0:1790740400.651637:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1790740400.651703:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790740400.651712:0:6531:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790740400.651756:0:3639:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.103@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:1.0:1790740400.660787:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740400.661304:0:10416:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022059776 00000100:00100000:1.0:1790740400.661313:0:10416:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022059776 00000100:00100000:1.0:1790740400.661362:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790740400.661411:0:10416:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc83cf0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3638:x1877727022059776:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1790740400.661419:0:10416:0:(ldlm_lockd.c:2567:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790740400 with bad export cookie 12852668945740781128 00000100:00100000:1.0:1790740400.661491:0:10416:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc83cf0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3638:x1877727022059776:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (707us total) trans 0 rc -107/-107 00000100:00100000:1.0:1790740400.661499:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1790740400.661905:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.103@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1790740400.677343:0:3640:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.103@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1790740400.677349:0:3640:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1790740400.677359:0:3640:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98db82333800 x1877727022057728/t0(0) o400->MGC192.168.204.103@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790740413 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740400.677431:0:3640:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98dcbd5fa300 x1877727022059392/t0(0) o103->MGC192.168.204.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790740416 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740400.677442:0:3640:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98db845bdf80 x1877727022059776/t0(0) o103->MGC192.168.204.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790740416 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740400.677452:0:3640:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98db845be680 x1877727022059648/t0(0) o103->MGC192.168.204.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790740416 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740400.677461:0:3640:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98dcbd5f9500 x1877727022059520/t0(0) o103->MGC192.168.204.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790740416 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740400.677469:0:3640:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98db84527480 x1877727022059904/t0(0) o103->MGC192.168.204.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790740416 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790740400.677534:0:3641:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff98dc85fb1800 already not connected (conn 1, was 1): DISCONN 10000000:01000000:3.0:1790740400.677547:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1790740400.677553:0:3640:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1790740400.677554:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1790740400.677559:0:3640:0:(import.c:65:import_set_state_nolock()) ffff98dc85fb1800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790740400.677565:0:3640:0:(import.c:545:import_select_connection()) MGC192.168.204.103@tcp: connect to NID 0@lo last attempt 203 00000100:00100000:2.0:1790740400.677576:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db845be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3641:1877727022059648:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1790740400.677601:0:3640:0:(import.c:666:import_select_connection()) MGC192.168.204.103@tcp: import ffff98dc85fb1800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:3.0:1790740400.677795:0:3640:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98dcbfe2d180 x1877727022060288/t0(0) o250->MGC192.168.204.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790740400.677834:0:3639:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff98dc85fb1800 already not connected (conn 2, was 1): CONNECTING 00000100:00100000:0.0:1790740400.678260:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3639:1877727022059392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790740400.678281:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3639:1877727022057728:0@lo:400:kworker.0 00000100:00100000:0.0:1790740400.678325:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84527480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3639:1877727022059904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790740400.678347:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3640:1877727022059520:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790740400.678418:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3637:1877727022060288:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:3.0:1790740400.678480:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877727022060288 offset 0 length 520: 4 00000100:00080000:1.0:1790740400.678742:0:3638:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff98dc85fb1800 already not connected (conn 2, was 1): CONNECTING 00000100:00100000:1.0:1790740400.678755:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db845bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3638:1877727022059776:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790740400.678795:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:1.0:1790740400.678936:0:9550:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1877727022059392 offset 224 length 224: 4 00000100:00100000:1.0:1790740400.678966:0:9550:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3639:x1877727022059392:12345-0@lo:103:ldlm_bl.0 Request processed in 36366us (40824us total) trans 0 rc -107/-107 00000100:00100000:1.0:1790740400.678977:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000020:00080000:0.0:1790740400.684937:0:15378:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff98dcae178000) has no exports 00000020:01000000:1.0:1790740400.779565:0:15378:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff98db83baad80 - data ffff98dcaa1be0d8/ffff98dcb6d1c400 00000020:01000000:1.0:1790740400.779728:0:15378:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff98dcaec4cb40 - data ffff98dcaa1b85e8/ffff98dcbc37a400 00000001:00000004:1.0:1790740400.792374:0:15378:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:0.0:1790740400.853799:0:15378:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790740400.853812:0:15378:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1790740400.853824:0:15378:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1790740400.860403:0:15378:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1790740400.860416:0:15378:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967299 gen 4 00000004:00080000:0.0:1790740400.860454:0:15378:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790740400.860459:0:15378:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1790740400.861710:0:8604:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1790740400.861718:0:8604:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:2.0:1790740400.861732:0:8604:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1790740400.862846:0:15378:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1790740400.862855:0:15378:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:0.0:1790740400.862917:0:15378:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790740400.862921:0:15378:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1790740400.863574:0:9800:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1790740400.863582:0:9800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:2.0:1790740400.863600:0:9800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1790740400.865622:0:15378:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92d76e 00000020:00000080:0.0:1790740400.865635:0:15378:0:(genops.c:885:class_export_put()) final put ffff98dcae188000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1790740400.866346:0:15342:0:(genops.c:844:class_export_destroy()) destroying export ffff98dcae188000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1790740400.867485:0:15378:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92d783 00000020:00000080:0.0:1790740400.867495:0:15378:0:(genops.c:885:class_export_put()) final put ffff98dcae18b800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1790740400.867539:0:15378:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:0.0:1790740400.867544:0:15378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790740400.867552:0:15378:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790740400.867555:0:15378:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff98dcae17cd40) has no exports 00000004:01000000:0.0:1790740400.867710:0:15378:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1790740400.867719:0:15378:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92da8c 00000020:00000080:0.0:1790740400.867723:0:15378:0:(genops.c:885:class_export_put()) final put ffff98dcb6c75000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1790740400.867743:0:15342:0:(genops.c:844:class_export_destroy()) destroying export ffff98dcae18b800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1790740400.867824:0:15378:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1790740400.867864:0:15342:0:(genops.c:844:class_export_destroy()) destroying export ffff98dcb6c75000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1790740400.867876:0:15378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790740400.867884:0:15378:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1790740400.867886:0:15378:0:(genops.c:1557:class_disconnect_exports()) OBD device 27 (ffff98dcbc2399c0) has no exports 00000020:00000080:3.0:1790740400.867892:0:15378:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92da85 00000020:00000080:3.0:1790740400.867896:0:15378:0:(genops.c:885:class_export_put()) final put ffff98db83c5e000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1790740400.870611:0:15342:0:(genops.c:844:class_export_destroy()) destroying export ffff98db83c5e000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1790740400.870677:0:15378:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1790740400.870681:0:15378:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1790740400.870686:0:15378:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:3.0:1790740400.870692:0:15378:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790740400.870694:0:15378:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790740400.870740:0:15378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790740400.870752:0:15378:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1790740400.870759:0:15378:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92d94a 00000020:00000080:3.0:1790740400.870767:0:15378:0:(genops.c:885:class_export_put()) final put ffff98dcb5f1b000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1790740400.870771:0:15378:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1790740400.870777:0:15378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790740400.870781:0:15378:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1790740400.870784:0:15378:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff98dcb6c6b380) has no exports 00000020:00000080:3.0:1790740400.870789:0:15378:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92d943 00000020:00000080:3.0:1790740400.870801:0:15378:0:(genops.c:885:class_export_put()) final put ffff98dcbd56b000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1790740400.871551:0:15342:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98db83c5c000 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1790740400.871561:0:15342:0:(genops.c:885:class_export_put()) final put ffff98db83c5b000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1790740400.871564:0:15342:0:(genops.c:844:class_export_destroy()) destroying export ffff98db83c5b000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1790740400.871570:0:15342:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790740400.872113:0:15342:0:(genops.c:844:class_export_destroy()) destroying export ffff98dcb5f1b000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1790740400.872437:0:15342:0:(genops.c:844:class_export_destroy()) destroying export ffff98dcbd56b000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1790740400.873353:0:15378:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1790740400.873358:0:15378:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1790740400.873909:0:15378:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967299 gen 5 00000004:00080000:3.0:1790740400.873918:0:15378:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790740400.873921:0:15378:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790740400.873986:0:15378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790740400.873998:0:15378:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1790740400.874023:0:15378:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1790740400.874049:0:15378:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92d7a6 00000020:00000080:3.0:1790740400.874058:0:15378:0:(genops.c:885:class_export_put()) final put ffff98dcbc257800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1790740400.874064:0:15378:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1790740400.874069:0:15378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790740400.874074:0:15378:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1790740400.874078:0:15378:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff98dcbc23cd40) has no exports 00000020:00000080:3.0:1790740400.874085:0:15378:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92d79f 00000020:00000080:3.0:1790740400.874089:0:15378:0:(genops.c:885:class_export_put()) final put ffff98dcbc255800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1790740400.875641:0:15342:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98dcbd56f000 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1790740400.875652:0:15342:0:(genops.c:885:class_export_put()) final put ffff98dcaec8b800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1790740400.875662:0:15342:0:(genops.c:844:class_export_destroy()) destroying export ffff98dcaec8b800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1790740400.875671:0:15342:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790740400.875745:0:15342:0:(genops.c:844:class_export_destroy()) destroying export ffff98dcbc257800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1790740400.875751:0:15342:0:(genops.c:844:class_export_destroy()) destroying export ffff98dcbc255800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1790740400.878091:0:15378:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1790740400.878099:0:15378:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790740400.878104:0:15378:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1790740400.878112:0:15378:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790740400.878155:0:15378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790740400.878166:0:15378:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1790740400.878195:0:15378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790740400.878198:0:15378:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1790740400.878215:0:15378:0:(genops.c:885:class_export_put()) final put ffff98dcb5f9b800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1790740400.878220:0:15378:0:(genops.c:844:class_export_destroy()) destroying export ffff98dcb5f9b800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1790740400.878228:0:15378:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1790740400.878398:0:15378:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92d78a 00000020:00000080:2.0:1790740400.878405:0:15378:0:(genops.c:885:class_export_put()) final put ffff98dcae189000/lustre-MDD0001_UUID 00000020:01000000:2.0:1790740400.878409:0:15378:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1790740400.878413:0:15378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790740400.878418:0:15378:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1790740400.878422:0:15378:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff98dcae17b380) has no exports 00000020:00000080:2.0:1790740400.878441:0:15378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790740400.878444:0:15378:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1790740400.878448:0:15378:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92d791 00000020:00000080:2.0:1790740400.878451:0:15378:0:(genops.c:885:class_export_put()) final put ffff98dcae18d000/lustre-MDT0001-osd_UUID 00000020:01000004:2.0:1790740400.878460:0:15378:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98dca0cb4800 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1790740400.878475:0:15378:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98dca0cb4800 2 00000020:01000004:2.0:1790740400.878479:0:15378:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98dca0cb4800 from lustre-MDT0001 00000020:00000080:2.0:1790740400.878495:0:15378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790740400.878499:0:15378:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1790740400.878502:0:15378:0:(genops.c:885:class_export_put()) final put ffff98dcae18a800/lustre-MDT0001_UUID 00000020:00000080:2.0:1790740400.878504:0:15378:0:(genops.c:844:class_export_destroy()) destroying export ffff98dcae18a800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1790740400.878510:0:15378:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:2.0:1790740400.878539:0:15378:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1790740400.878543:0:15378:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1790740400.878552:0:15378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790740400.878556:0:15378:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1790740400.878563:0:15378:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff98dcaec8a000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790740400.878569:0:15378:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff98dc9924b380) has exports, disconnecting them 00000020:00080000:2.0:1790740400.878573:0:15378:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff98dcaec8a000), last request at 1790740155 00000020:00000080:2.0:1790740400.878577:0:15378:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92d7e5 00000020:00080000:2.0:1790740400.878589:0:15378:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff98dcaec8a000): rc 0 00000020:00000080:2.0:1790740400.878593:0:15378:0:(genops.c:885:class_export_put()) final put ffff98dcaec8a000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1790740400.878921:0:15342:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98dcbc254800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1790740400.878932:0:15342:0:(genops.c:885:class_export_put()) final put ffff98dc9854e000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1790740400.878934:0:15342:0:(genops.c:844:class_export_destroy()) destroying export ffff98dc9854e000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:0.0:1790740400.878948:0:15342:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790740400.879073:0:15342:0:(genops.c:844:class_export_destroy()) destroying export ffff98dcae189000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:0.0:1790740400.879076:0:15342:0:(genops.c:885:class_export_put()) final put ffff98dcae18c800/lustre-MDD0001_UUID 00000020:00000080:0.0:1790740400.879078:0:15342:0:(genops.c:844:class_export_destroy()) destroying export ffff98dcae18c800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:0.0:1790740400.879081:0:15342:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:0.0:1790740400.879267:0:15342:0:(genops.c:844:class_export_destroy()) destroying export ffff98dcae18d000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1790740400.879272:0:15342:0:(genops.c:844:class_export_destroy()) destroying export ffff98dcaec8a000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1790740400.921129:0:15378:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1790740400.921204:0:15378:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790740400.921208:0:15378:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1790740400.921217:0:15378:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790740400.921252:0:15342:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98dcaec8c800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1790740400.921572:0:15378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790740400.921582:0:15378:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:0.0:1790740400.921588:0:15378:0:(genops.c:885:class_export_put()) final put ffff98dcaec8a800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:0.0:1790740400.921592:0:15378:0:(genops.c:844:class_export_destroy()) destroying export ffff98dcaec8a800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:0.0:1790740400.921601:0:15378:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1790740400.921699:0:15378:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98dca0cb4800 1 00000020:00000080:0.0:1790740400.921705:0:15378:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92d721 00000020:00000080:0.0:1790740400.921711:0:15378:0:(genops.c:885:class_export_put()) final put ffff98dcb5ddf000/lustre-MDT0001-osd_UUID 00000020:01000000:0.0:1790740400.921722:0:15378:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1790740400.921730:0:15342:0:(genops.c:844:class_export_destroy()) destroying export ffff98dcb5ddf000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1790740400.921739:0:15378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790740400.921744:0:15378:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1790740400.921748:0:15378:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff98dc897419c0) has no exports 00000020:00000080:0.0:1790740401.044803:0:15378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790740401.044818:0:15378:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1790740401.044824:0:15378:0:(genops.c:885:class_export_put()) final put ffff98dcb5cb0800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1790740401.044829:0:15378:0:(genops.c:844:class_export_destroy()) destroying export ffff98dcb5cb0800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1790740401.044842:0:15378:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1790740401.045305:0:15378:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98dcb5cb5000 00000020:01000000:0.0:1790740401.045329:0:15378:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1790740401.045334:0:15378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790740401.045339:0:15378:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1790740401.045343:0:15378:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff98dc9924cd40) has no exports 00000100:00100000:1.0:1790740401.045520:0:6537:0:(service.c:3206:ptlrpc_main()) mdt00_002: service thread [ffff98dcb16a2000:6537] 2 exiting: rc = 0 00000100:00100000:3.0:1790740401.045667:0:6535:0:(service.c:3206:ptlrpc_main()) mdt00_000: service thread [ffff98dc82e56200:6535] 0 exiting: rc = 1 00000100:00100000:3.0:1790740401.045730:0:6536:0:(service.c:3206:ptlrpc_main()) mdt00_001: service thread [ffff98dc82e56000:6536] 1 exiting: rc = 0 00000100:00100000:0.0:1790740401.045819:0:7760:0:(service.c:3206:ptlrpc_main()) mdt00_003: service thread [ffff98dcaed29c00:7760] 3 exiting: rc = 0 00000100:00100000:2.0:1790740401.045919:0:13222:0:(service.c:3206:ptlrpc_main()) mdt00_004: service thread [ffff98db8440cc00:13222] 4 exiting: rc = 0 00000100:00100000:0.0:1790740401.046784:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.046794:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.046800:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.046805:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.046810:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.046816:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.046821:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.046827:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.046832:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.046838:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.046844:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.046849:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.046856:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.046861:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.046876:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.046881:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.046886:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.046892:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.046898:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.046903:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.046908:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.046914:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.046919:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.046924:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.046931:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.046948:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.046955:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.046961:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.046966:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.046971:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.046977:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.046983:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.046988:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.046995:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.047001:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.047017:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.047024:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.047050:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.047057:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.047063:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.047071:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.047077:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.047083:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.047089:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.047096:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.047102:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.047108:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.047113:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.047119:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.047132:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.047138:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.047144:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.047149:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.047154:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.047159:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.047164:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.047170:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.047174:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.047180:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.047185:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.047190:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.047194:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.047199:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.047213:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740401.049340:0:14942:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff98dc880bbe00:14942] 2 exiting: rc = 0 00000100:00100000:1.0:1790740401.049565:0:6538:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff98dcb16a3400:6538] 0 exiting: rc = 1 00000100:00100000:2.0:1790740401.049783:0:6539:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff98dcb16a2600:6539] 1 exiting: rc = 0 00000100:00100000:1.0:1790740401.050233:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050243:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050249:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050269:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050275:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050282:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050289:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050294:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050299:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050305:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050311:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050318:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050326:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050331:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050336:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050342:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050347:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050352:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050358:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050363:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050368:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050373:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050378:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050384:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050389:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050394:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050400:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050405:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050410:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050416:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050421:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050425:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050430:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050435:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050440:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050445:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050451:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050455:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050466:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050471:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050476:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050482:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050487:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050492:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050497:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050504:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050509:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050515:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050520:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050525:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050530:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050535:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050541:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050546:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050552:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050558:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050563:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050569:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050574:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050579:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050585:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050590:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050595:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.050600:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051052:0:6541:0:(service.c:3206:ptlrpc_main()) mdt_out00_001: service thread [ffff98dc86a80400:6541] 1 exiting: rc = 0 00000100:00100000:0.0:1790740401.051266:0:7846:0:(service.c:3206:ptlrpc_main()) mdt_out00_002: service thread [ffff98dcaed1ce00:7846] 2 exiting: rc = 0 00000100:00100000:0.0:1790740401.051355:0:6540:0:(service.c:3206:ptlrpc_main()) mdt_out00_000: service thread [ffff98dcb16a3000:6540] 0 exiting: rc = 1 00000100:00100000:1.0:1790740401.051430:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051440:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051448:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051462:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051470:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051476:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051483:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051490:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051517:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051524:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051541:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051549:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051555:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051563:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051570:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051593:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051602:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051608:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051614:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051620:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051627:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051633:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051641:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051648:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051654:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051661:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051667:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051688:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051697:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051704:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051711:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051718:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051724:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051731:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051740:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051747:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051753:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051760:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051767:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051787:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051795:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051802:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051808:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051820:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051826:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051833:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051840:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051847:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051853:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051859:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051866:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051886:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051894:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051899:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051905:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051910:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051916:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051921:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051926:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051944:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051951:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051957:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051963:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.051970:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.065177:0:6542:0:(service.c:3206:ptlrpc_main()) mdt_seqs_0000: service thread [ffff98dca0455e00:6542] 0 exiting: rc = 1 00000100:00100000:2.0:1790740401.067365:0:6543:0:(service.c:3206:ptlrpc_main()) mdt_seqs_0001: service thread [ffff98dc85478a00:6543] 1 exiting: rc = 0 00000100:00100000:1.0:1790740401.067450:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067458:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067464:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067469:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067473:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067478:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067482:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067487:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067492:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067497:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067503:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067508:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067513:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067534:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067540:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067546:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067551:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067556:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067562:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067567:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067572:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067577:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067582:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067587:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067592:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067596:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067601:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067606:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067610:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067615:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067620:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067625:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067630:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067635:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067640:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067645:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067649:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067655:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067660:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067665:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067670:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067675:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067680:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067686:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067691:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067696:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067701:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067706:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067717:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067722:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067727:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067732:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067741:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067752:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067759:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067764:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067769:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067774:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067780:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067785:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067790:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067795:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067799:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.067804:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740401.075724:0:6545:0:(service.c:3206:ptlrpc_main()) mdt_seqm_0001: service thread [ffff98dc8568be00:6545] 1 exiting: rc = 0 00000100:00100000:2.0:1790740401.075893:0:6544:0:(service.c:3206:ptlrpc_main()) mdt_seqm_0000: service thread [ffff98dcaa96b000:6544] 0 exiting: rc = 1 00000100:00100000:3.0:1790740401.076087:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076095:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076100:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076105:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076110:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076115:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076120:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076125:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076129:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076135:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076141:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076146:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076152:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076157:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076182:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076188:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076194:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076199:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076205:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076211:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076216:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076222:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076228:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076233:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076239:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076245:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076251:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076256:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076261:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076266:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076272:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076277:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076282:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076286:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076292:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076296:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076301:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076307:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076312:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076318:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076324:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076328:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076334:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076340:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076346:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076352:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076357:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076363:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076368:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076382:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076387:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076393:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076398:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076403:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076408:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076413:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076418:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076424:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076429:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076434:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076439:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076444:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076449:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.076455:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.077482:0:6547:0:(service.c:3206:ptlrpc_main()) mdt_fld_0001: service thread [ffff98dcad1b8600:6547] 1 exiting: rc = 0 00000100:00100000:2.0:1790740401.078466:0:6546:0:(service.c:3206:ptlrpc_main()) mdt_fld_0000: service thread [ffff98dc8568a400:6546] 0 exiting: rc = 1 00000100:00100000:3.0:1790740401.082194:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082205:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082210:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082215:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082221:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082228:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082233:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082238:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082243:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082248:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082254:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082259:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082263:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082268:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082274:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082279:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082283:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082289:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082295:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082300:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082319:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082325:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082330:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082334:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082339:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082344:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082349:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082354:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082359:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082365:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082370:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082375:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082379:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082384:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082389:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082394:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082400:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082405:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082410:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082415:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082420:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082425:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082430:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082436:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082440:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082445:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082450:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082454:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082459:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082464:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082469:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082474:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082480:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082485:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082489:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082502:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082507:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082512:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082517:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082522:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082526:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082530:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082535:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.082540:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740401.085268:0:6548:0:(service.c:3206:ptlrpc_main()) mdt_io00_000: service thread [ffff98dcad1b8800:6548] 0 exiting: rc = 1 00000100:00100000:2.0:1790740401.086674:0:6550:0:(service.c:3206:ptlrpc_main()) mdt_io00_002: service thread [ffff98dcad1b8a00:6550] 2 exiting: rc = 0 00000100:00100000:0.0:1790740401.087270:0:6549:0:(service.c:3206:ptlrpc_main()) mdt_io00_001: service thread [ffff98dcad1b9200:6549] 1 exiting: rc = 0 00000100:00100000:3.0:1790740401.088004:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088026:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088070:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088097:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088104:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088110:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088116:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088122:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088127:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088133:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088139:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088145:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088151:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088157:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088163:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088168:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088174:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088180:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088186:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088193:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088199:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088204:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088209:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088215:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088220:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088226:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088244:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088263:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088270:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088275:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088281:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088287:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088293:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088299:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088305:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088312:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088318:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088324:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088331:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088337:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088342:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088347:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088353:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088360:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088365:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088371:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088377:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088383:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088388:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088394:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088400:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088421:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088429:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088436:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088442:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088447:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088453:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088459:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088465:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088472:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088478:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088491:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088496:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740401.088502:0:15378:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1790740401.093391:0:15378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790740401.093407:0:15378:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1790740401.093413:0:15378:0:(genops.c:885:class_export_put()) final put ffff98dc85fb5000/MDS_uuid 00000020:00000080:3.0:1790740401.093418:0:15378:0:(genops.c:844:class_export_destroy()) destroying export ffff98dc85fb5000/MDS_uuid for MDS 00000020:01000000:3.0:1790740401.093428:0:15378:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1790740401.093586:0:15378:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1790740401.643640:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740402.666928:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790740402.795232:0:15342:0:(pinger.c:229:ptlrpc_pinger_process_import()) ad8ddc53-446f-4b77-85d5-90ebc88dfa76->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790740402.795246:0:15342:0:(pinger.c:247:ptlrpc_pinger_process_import()) ad8ddc53-446f-4b77-85d5-90ebc88dfa76->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790740402.795250:0:15342:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790740402.795255:0:15342:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1790740402.795260:0:15342:0:(import.c:65:import_set_state_nolock()) ffff98db829b5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790740402.795270:0:15342:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 469 00000100:00080000:0.0:1790740402.795278:0:15342:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790740402.795295:0:15342:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98db829b5800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:0.0:1790740402.795366:0:15342:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98db83dc5500 x1877727022060416/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790740402.795419:0:15342:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790740402.795443:0:15342:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1790740402.795446:0:15342:0:(import.c:65:import_set_state_nolock()) ffff98db82ff7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790740402.795450:0:15342:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 468 00000100:00080000:0.0:1790740402.795453:0:15342:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790740402.795459:0:15342:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98db82ff7000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:0.0:1790740402.795471:0:15342:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98db83dc5f80 x1877727022060672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790740402.795680:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1877727022060416:0@lo:38:kworker.0 00000400:00000100:0.0:1790740402.795749:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877727022060416 offset 0 length 520: 4 00000100:00100000:0.0:1790740402.795810:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1877727022060672:0@lo:38:kworker.0 00000400:00000100:0.0:1790740402.795846:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877727022060672 offset 0 length 520: 4 00000100:00100000:0.0:1790740402.795887:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1877727022060544:0@lo:400:kworker.0 00000400:00000100:0.0:1790740402.795925:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877727022060544 offset 0 length 224: 4 00000100:00100000:0.0:1790740402.795942:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790740402.795948:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1877727022060800:0@lo:400:kworker.0 00000400:00000100:0.0:1790740402.795965:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877727022060800 offset 0 length 224: 4 00010000:00010000:2.0:1790740403.691271:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740404.714400:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790740404.842121:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) ad8ddc53-446f-4b77-85d5-90ebc88dfa76->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790740404.842131:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) ad8ddc53-446f-4b77-85d5-90ebc88dfa76->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790740404.842134:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790740404.842137:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790740404.842181:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790740404.842185:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790740404.842199:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790740404.842218:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1877727022060928:0@lo:400:kworker.0 00000400:00000100:0.0:1790740404.842271:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877727022060928 offset 0 length 224: 4 00000100:00100000:0.0:1790740404.842355:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1877727022061056:0@lo:400:kworker.0 00000400:00000100:0.0:1790740404.842372:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877727022061056 offset 0 length 224: 4 00000020:01000004:2.0:1790740405.299187:0:15578:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1790740405.319372:0:15578:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1790740405.319429:0:15578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaf060000/0xb25dda4f4e92db5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92db65 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740405.319456:0:15578:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaf060000/0xb25dda4f4e92db5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92db65 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740405.319465:0:15578:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaf060000/0xb25dda4f4e92db5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xb25dda4f4e92db65 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740405.319472:0:15578:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: ffff98dcaf060000/0xb25dda4f4e92db5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xb25dda4f4e92db65 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740405.319527:0:15578:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1790740405.319532:0:15578:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1790740405.319562:0:15578:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790740405.319574:0:15578:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98db83dc5500 x1877727022060416/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790740417 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740405.319593:0:15578:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1790740405.319598:0:15578:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1790740405.319603:0:15578:0:(import.c:65:import_set_state_nolock()) ffff98db829b5800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1790740405.319608:0:15578:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790740405.319612:0:15578:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98db83dc5500 x1877727022060416/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790740417 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740405.319619:0:15578:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1790740405.319622:0:15578:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:0.0:1790740405.319683:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1877727022060416:0@lo:38:kworker.0 00000100:00080000:2.0:1790740405.321513:0:15578:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1790740405.321528:0:15578:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98db83dc6d80 x1877727022060544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740418 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740405.321609:0:15578:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98db83dc6680 x1877727022060928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740420 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740405.321650:0:15578:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1790740405.321657:0:15578:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1790740405.321681:0:15578:0:(import.c:65:import_set_state_nolock()) ffff98dcaed01800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1790740405.322113:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1877727022060928:0@lo:400:kworker.0 00010000:00010000:3.0:1790740405.322242:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740405.322254:0:6523:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dcaf060000/0xb25dda4f4e92db5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xb25dda4f4e92db65 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740405.322263:0:6523:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf060000 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:3.0:1790740405.322267:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dcaf060000/0xb25dda4f4e92db5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xb25dda4f4e92db65 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740405.322367:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dcaf060000/0xb25dda4f4e92db5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xb25dda4f4e92db65 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790740405.322378:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dcaf060000/0xb25dda4f4e92db5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xb25dda4f4e92db65 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740405.322384:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790740405.322386:0:6523:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1790740405.322389:0:6523:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1790740405.322405:0:6523:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98dc85fb1800 00010000:00010000:3.0:1790740405.322408:0:6523:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dcaf060000/0xb25dda4f4e92db5e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xb25dda4f4e92db65 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740405.322415:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dcaf060000/0xb25dda4f4e92db5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xb25dda4f4e92db65 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740405.322436:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740405.322437:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740405.322439:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740405.322757:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1877727022060544:0@lo:400:kworker.0 00000100:00100000:1.0:1790740405.323333:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84651880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1877727022061184:0@lo:39:umount.0 00000400:00000100:1.0:1790740405.323388:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877727022061184 offset 0 length 224: 4 00010000:00010000:2.0:1790740405.738593:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740406.765752:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790740406.894354:0:9531:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1790740406.894364:0:9531:0:(genops.c:885:class_export_put()) final put ffff98db82fd9000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1790740406.894462:0:8446:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1790740406.894468:0:8446:0:(genops.c:885:class_export_put()) final put ffff98db829b1000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1790740406.902216:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98db82fd9000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1790740406.902300:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98dcb81fe800 for lustre-OST0001 00000020:00000080:0.0:1790740406.903215:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98db829b1000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1790740406.903279:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98db829b3800 for lustre-OST0000 00010000:00010000:3.0:1790740407.786370:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790740407.851684:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) ad8ddc53-446f-4b77-85d5-90ebc88dfa76->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790740407.851694:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) ad8ddc53-446f-4b77-85d5-90ebc88dfa76->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790740407.851697:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790740407.851700:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790740407.851868:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1877727022061312:0@lo:400:kworker.0 00000400:00000100:0.0:1790740407.851932:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877727022061312 offset 0 length 224: 4 00010000:00010000:2.0:1790740408.810261:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740409.837840:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740410.474195:0:3637:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790740400/real 1790740400] req@ffff98dcbfe2d180 x1877727022060288/t0(0) o250->MGC192.168.204.103@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790740410 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740410.474233:0:3637:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98dcbfe2d180 x1877727022060288/t0(0) o250->MGC192.168.204.103@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790740410 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790740410.474256:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98dc85fb1800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790740410.474288:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1790740410.474311:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3637:1877727022060288:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:3.0:1790740410.474711:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) ad8ddc53-446f-4b77-85d5-90ebc88dfa76->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790740410.474716:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1790740410.474719:0:37:0:(import.c:65:import_set_state_nolock()) ffff98dc85fb1800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790740410.474724:0:37:0:(import.c:545:import_select_connection()) MGC192.168.204.103@tcp: connect to NID 0@lo last attempt 471 00000100:00080000:3.0:1790740410.474730:0:37:0:(import.c:630:import_select_connection()) MGC192.168.204.103@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1790740410.474742:0:37:0:(import.c:666:import_select_connection()) MGC192.168.204.103@tcp: import ffff98dc85fb1800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:3.0:1790740410.474785:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98dcbfe2ce00 x1877727022061440/t0(0) o250->MGC192.168.204.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790740410.474810:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790740410.474815:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790740410.474892:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1877727022061568:0@lo:400:kworker.0 00000400:00000100:2.0:1790740410.474945:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877727022061568 offset 0 length 224: 4 00000100:00100000:1.0:1790740410.475654:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3637:1877727022061440:0@lo:250:kworker.0 00000400:00000100:1.0:1790740410.475688:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877727022061440 offset 0 length 520: 4 00010000:00010000:3.0:1790740410.862081:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740411.885997:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740412.906325:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740413.930348:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740414.954697:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740415.595087:0:3637:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790740405/real 1790740405] req@ffff98db84651880 x1877727022061184/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790740415 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740415.595122:0:3637:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98db84651880 x1877727022061184/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790740415 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790740415.595145:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98dcaed01800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1790740415.595171:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84651880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1877727022061184:0@lo:39:umount.0 00000100:00080000:2.0:1790740415.595275:0:15578:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1790740415.595280:0:15578:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1790740415.595286:0:15578:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1790740415.595326:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) ad8ddc53-446f-4b77-85d5-90ebc88dfa76->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790740415.595332:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) ad8ddc53-446f-4b77-85d5-90ebc88dfa76->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790740415.595335:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790740415.595339:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790740415.595466:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790740415.595481:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84525180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1877727022061696:0@lo:400:kworker.0 00000400:00000100:0.0:1790740415.595535:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877727022061696 offset 0 length 224: 4 00010000:00010000:2.0:1790740415.596192:0:15578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaf060600/0xb25dda4f4e92db6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92db73 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740415.596206:0:15578:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaf060600/0xb25dda4f4e92db6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92db73 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740415.596214:0:15578:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaf060600/0xb25dda4f4e92db6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xb25dda4f4e92db73 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740415.596221:0:15578:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: ffff98dcaf060600/0xb25dda4f4e92db6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xb25dda4f4e92db73 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740415.596252:0:15578:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790740415.596279:0:15578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92dde2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92dde9 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740415.596286:0:15578:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92dde2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92dde9 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740415.596292:0:15578:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92dde2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb25dda4f4e92dde9 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740415.596297:0:15578:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92dde2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb25dda4f4e92dde9 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740415.596315:0:15578:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1790740415.596320:0:15578:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1790740415.596350:0:15578:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1790740415.596354:0:15578:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1790740415.596359:0:15578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790740415.596365:0:15578:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1790740415.596370:0:15578:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff98dcaefc8000) has no exports 00010000:00010000:3.0:1790740415.596387:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:00080000:2.0:1790740415.596397:0:15578:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff98dcaefc8000) has no exports 00010000:00010000:3.0:1790740415.596398:0:6523:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dcaf060600/0xb25dda4f4e92db6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb25dda4f4e92db73 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740415.596415:0:6523:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf060600 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:3.0:1790740415.596420:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dcaf060600/0xb25dda4f4e92db6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb25dda4f4e92db73 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740415.596429:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dcaf060600/0xb25dda4f4e92db6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xb25dda4f4e92db73 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790740415.596437:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dcaf060600/0xb25dda4f4e92db6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xb25dda4f4e92db73 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740415.596442:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790740415.596445:0:6523:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1790740415.596447:0:6523:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1790740415.596459:0:6523:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98dc85fb1800 00010000:00010000:3.0:1790740415.596463:0:6523:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dcaf060600/0xb25dda4f4e92db6c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xb25dda4f4e92db73 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740415.596470:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dcaf060600/0xb25dda4f4e92db6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xb25dda4f4e92db73 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740415.596483:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740415.596487:0:6523:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92dde2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb25dda4f4e92dde9 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740415.596492:0:6523:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f33a00 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:3.0:1790740415.596495:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92dde2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb25dda4f4e92dde9 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740415.596501:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92dde2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xb25dda4f4e92dde9 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790740415.596513:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92dde2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xb25dda4f4e92dde9 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740415.596518:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1790740415.596521:0:6523:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1790740415.596522:0:6523:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1790740415.596527:0:6523:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98dc85fb1800 00010000:00010000:3.0:1790740415.596530:0:6523:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92dde2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xb25dda4f4e92dde9 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740415.596536:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92dde2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xb25dda4f4e92dde9 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740415.596545:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740415.596546:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740415.596548:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740415.597092:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1790740415.604492:0:15578:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff98db82a373c0 - data ffff98db8248b6c0/ffff98dcaeffe000 00000020:01000000:2.0:1790740415.604651:0:15578:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff98db82a370c0 - data ffff98dcaa289e58/ffff98db829bb800 00100000:10000000:3.0:1790740415.615548:0:15578:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1790740415.633843:0:15578:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92d8be 00000020:00000080:0.0:1790740415.633854:0:15578:0:(genops.c:885:class_export_put()) final put ffff98db82354000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1790740415.633865:0:15578:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98dcaedda800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1790740415.633869:0:15578:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98dcaedda800 2 00000020:01000004:0.0:1790740415.633873:0:15578:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98dcaedda800 from lustre-OST0000 00000020:00000080:0.0:1790740415.633896:0:15578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790740415.633906:0:15578:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1790740415.633909:0:15578:0:(genops.c:885:class_export_put()) final put ffff98dcbd513000/lustre-OST0000_UUID 00000020:00000080:0.0:1790740415.633922:0:15578:0:(genops.c:844:class_export_destroy()) destroying export ffff98dcbd513000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1790740415.633929:0:15578:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1790740415.633987:0:15578:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1790740415.633991:0:15578:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1790740415.633994:0:15578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790740415.633999:0:15578:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1790740415.634005:0:15578:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff98db829b4800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790740415.634011:0:15578:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff98dcbc23b380) has exports, disconnecting them 00000020:00080000:0.0:1790740415.634015:0:15578:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff98db829b4800), last request at 1790740178 00000020:00000080:0.0:1790740415.634019:0:15578:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92d8e8 00000020:00080000:0.0:1790740415.634028:0:15578:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff98db829b4800): rc 0 00000020:00000080:0.0:1790740415.634046:0:15578:0:(genops.c:885:class_export_put()) final put ffff98db829b4800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1790740415.634214:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98db82354000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1790740415.634226:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98db829b4800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1790740415.635733:0:15578:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1790740415.635741:0:15578:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790740415.635745:0:15578:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1790740415.635752:0:15578:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790740415.635931:0:15578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790740415.635939:0:15578:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1790740415.635945:0:15578:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1790740415.635949:0:15578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790740415.635960:0:15578:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1790740415.635966:0:15578:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff98dc86a15000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790740415.635972:0:15578:0:(genops.c:1552:class_disconnect_exports()) OBD device 20 (ffff98dcb81db380) has exports, disconnecting them 00000020:00080000:1.0:1790740415.635976:0:15578:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff98dc86a15000), last request at 1790740178 00000020:00000080:1.0:1790740415.635980:0:15578:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92d8fd 00000020:00080000:1.0:1790740415.635993:0:15578:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff98dc86a15000): rc 0 00000020:00000080:1.0:1790740415.635998:0:15578:0:(genops.c:885:class_export_put()) final put ffff98dc86a15000/lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1790740415.636785:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98db829b5800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1790740415.636792:0:36:0:(genops.c:885:class_export_put()) final put ffff98db829b0000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1790740415.636795:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98db829b0000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1790740415.636801:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1790740415.636859:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98dc86a15000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1790740415.649350:0:15578:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:2.0:1790740415.649358:0:15578:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1790740415.649363:0:15578:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1790740415.649385:0:15578:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790740415.649417:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98dcaed01800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1790740415.649586:0:15578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790740415.649595:0:15578:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1790740415.649600:0:15578:0:(genops.c:885:class_export_put()) final put ffff98dcbd515800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1790740415.649604:0:15578:0:(genops.c:844:class_export_destroy()) destroying export ffff98dcbd515800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1790740415.649613:0:15578:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1790740415.649825:0:15578:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98dcaedda800 1 00000020:00000080:2.0:1790740415.649831:0:15578:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92d886 00000020:00000080:2.0:1790740415.649837:0:15578:0:(genops.c:885:class_export_put()) final put ffff98dcb5f0d000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1790740415.649846:0:15578:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1790740415.649854:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98dcb5f0d000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1790740415.649863:0:15578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790740415.649868:0:15578:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1790740415.649872:0:15578:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff98dcaefccd40) has no exports 00000020:00000080:2.0:1790740415.757537:0:15578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790740415.757553:0:15578:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1790740415.757558:0:15578:0:(genops.c:885:class_export_put()) final put ffff98dcaeddd800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1790740415.757563:0:15578:0:(genops.c:844:class_export_destroy()) destroying export ffff98dcaeddd800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1790740415.757573:0:15578:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1790740415.757712:0:15578:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98dcaeddf000 00000020:02000400:2.0:1790740415.757762:0:15578:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1790740415.986236:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740417.006431:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740417.642831:0:3637:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790740402/real 1790740402] req@ffff98db83dc5f80 x1877727022060672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1790740417 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740417.642881:0:3637:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98db83dc5f80 x1877727022060672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1790740417 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790740417.642901:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98db82ff7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790740417.642927:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790740417.642932:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1877727022060672:0@lo:38:kworker.0 00000100:00080000:0.0:1790740417.643091:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) ad8ddc53-446f-4b77-85d5-90ebc88dfa76->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790740417.643097:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) ad8ddc53-446f-4b77-85d5-90ebc88dfa76->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790740417.643100:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790740417.643103:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1790740417.643107:0:36:0:(import.c:65:import_set_state_nolock()) ffff98db82ff7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790740417.643112:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 474 00000100:00080000:0.0:1790740417.643118:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1790740417.643132:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98db82ff7000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:0.0:1790740417.643176:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98db83dc6d80 x1877727022061824/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790740417.643235:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790740417.643251:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1877727022061952:0@lo:400:kworker.0 00000400:00000100:0.0:1790740417.643317:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877727022061952 offset 0 length 224: 4 00000100:00100000:3.0:1790740417.645399:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1877727022061824:0@lo:38:kworker.0 00000400:00000100:3.0:1790740417.645478:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877727022061824 offset 0 length 520: 4 00010000:00010000:3.0:1790740418.030479:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:2.0:1790740418.987168:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790740402/real 1790740402] req@ffff98db83dc6a00 x1877727022060800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790740418 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740419.014143:0:3640:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff98db83dc6a00 x1877727022060800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790740418 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790740419.014165:0:3640:0:(import.c:65:import_set_state_nolock()) ffff98db82fd8800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1790740419.014170:0:3640:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1790740419.035147:0:3640:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:2.0:1790740419.035204:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) ad8ddc53-446f-4b77-85d5-90ebc88dfa76->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790740419.035211:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) ad8ddc53-446f-4b77-85d5-90ebc88dfa76->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790740419.035215:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790740419.035219:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790740419.035222:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790740419.035226:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1790740419.035231:0:36:0:(import.c:65:import_set_state_nolock()) ffff98db82fd8800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790740419.035242:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 272 00000100:00080000:2.0:1790740419.035263:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff98db82fd8800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:2.0:1790740419.035316:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98db84652680 x1877727022062080/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790740419.035376:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84652680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1877727022062080:0@lo:38:kworker.0 00000400:00000100:2.0:1790740419.035447:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877727022062080 offset 0 length 520: 4 00000100:00100000:2.0:1790740419.035553:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1877727022060800:0@lo:400:kworker.0 00010000:00010000:2.0:1790740419.051191:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740420.074302:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1790740420.283795:0:15781:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1790740420.294232:0:15781:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1790740420.294342:0:15781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaf061e00/0xb25dda4f4e92db42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92db49 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740420.294361:0:15781:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaf061e00/0xb25dda4f4e92db42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92db49 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740420.294369:0:15781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaf061e00/0xb25dda4f4e92db42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb25dda4f4e92db49 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740420.294377:0:15781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: ffff98dcaf061e00/0xb25dda4f4e92db42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb25dda4f4e92db49 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740420.294546:0:15781:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1790740420.294552:0:15781:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1790740420.294595:0:15781:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790740420.294611:0:15781:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98db83dc6d80 x1877727022061824/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790740437 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740420.294634:0:15781:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1790740420.294641:0:15781:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1790740420.294650:0:15781:0:(import.c:65:import_set_state_nolock()) ffff98db82ff7000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1790740420.294656:0:15781:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790740420.294670:0:15781:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98db83dc6d80 x1877727022061824/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790740437 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740420.294677:0:15781:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1790740420.294681:0:15781:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00000100:00100000:0.0:1790740420.294797:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1877727022061824:0@lo:38:kworker.0 00000100:00080000:1.0:1790740420.295993:0:15781:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1790740420.296009:0:15781:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98db83dc7800 x1877727022061056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740420 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740420.296048:0:15781:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98dcbfe2df80 x1877727022061312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740423 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740420.296063:0:15781:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98dcbfe2d880 x1877727022061568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740426 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740420.296075:0:15781:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98db84525180 x1877727022061696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740431 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740420.296084:0:15781:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98db83dc5500 x1877727022061952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740433 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740420.296096:0:15781:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98db84652680 x1877727022062080/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790740429 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740420.296107:0:15781:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1790740420.296113:0:15781:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1790740420.296118:0:15781:0:(import.c:65:import_set_state_nolock()) ffff98db82fd8800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1790740420.296123:0:15781:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1790740420.296126:0:15781:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98db83dc7800 x1877727022061056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740420 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740420.296134:0:15781:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98dcbfe2df80 x1877727022061312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740423 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740420.296140:0:15781:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98dcbfe2d880 x1877727022061568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740426 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740420.296169:0:15781:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98db84525180 x1877727022061696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740431 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740420.296177:0:15781:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98db83dc5500 x1877727022061952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740433 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740420.296184:0:15781:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98db84652680 x1877727022062080/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790740429 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740420.296190:0:15781:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1790740420.296195:0:15781:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:0.0:1790740420.296252:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84525180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1877727022061696:0@lo:400:kworker.0 00000100:00100000:0.0:1790740420.296274:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1877727022061056:0@lo:400:kworker.0 00000100:00100000:0.0:1790740420.296314:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1877727022061952:0@lo:400:kworker.0 00000100:00100000:0.0:1790740420.296344:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84652680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1877727022062080:0@lo:38:kworker.0 00000100:00100000:2.0:1790740420.297474:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1877727022061312:0@lo:400:kworker.0 00010000:00010000:3.0:1790740420.297905:0:10357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740420.297918:0:10357:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dcaf061e00/0xb25dda4f4e92db42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb25dda4f4e92db49 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740420.297931:0:10357:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf061e00 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:3.0:1790740420.297937:0:10357:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dcaf061e00/0xb25dda4f4e92db42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb25dda4f4e92db49 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740420.297949:0:10357:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dcaf061e00/0xb25dda4f4e92db42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb25dda4f4e92db49 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790740420.297958:0:10357:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dcaf061e00/0xb25dda4f4e92db42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb25dda4f4e92db49 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740420.297964:0:10357:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790740420.297967:0:10357:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1790740420.297970:0:10357:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1790740420.297988:0:10357:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98dc85fb1800 00010000:00010000:3.0:1790740420.297992:0:10357:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dcaf061e00/0xb25dda4f4e92db42 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb25dda4f4e92db49 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740420.298903:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dcaf061e00/0xb25dda4f4e92db42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb25dda4f4e92db49 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740420.298932:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740420.298934:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740420.298937:0:10357:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740420.299350:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1877727022061568:0@lo:400:kworker.0 00010000:00010000:1.0:1790740420.302333:0:15781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9200/0xb25dda4f4e92db50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92db57 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740420.302359:0:15781:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9200/0xb25dda4f4e92db50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92db57 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740420.302367:0:15781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9200/0xb25dda4f4e92db50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb25dda4f4e92db57 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740420.302374:0:15781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9200/0xb25dda4f4e92db50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb25dda4f4e92db57 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740420.302458:0:15781:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790740420.302467:0:15781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98db83f32600/0xb25dda4f4e92ddd4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92dddb expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740420.302475:0:15781:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98db83f32600/0xb25dda4f4e92ddd4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92dddb expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740420.302482:0:15781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98db83f32600/0xb25dda4f4e92ddd4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb25dda4f4e92dddb expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740420.302505:0:15781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: ffff98db83f32600/0xb25dda4f4e92ddd4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb25dda4f4e92dddb expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740420.302560:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790740420.302582:0:6524:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9200/0xb25dda4f4e92db50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb25dda4f4e92db57 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740420.302590:0:6524:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc9200 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:2.0:1790740420.302601:0:6524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9200/0xb25dda4f4e92db50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb25dda4f4e92db57 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740420.302612:0:6524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9200/0xb25dda4f4e92db50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xb25dda4f4e92db57 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790740420.302620:0:6524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9200/0xb25dda4f4e92db50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xb25dda4f4e92db57 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740420.302626:0:6524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790740420.302629:0:6524:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:2.0:1790740420.302644:0:6524:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98dc85fb1800 00010000:00010000:2.0:1790740420.302648:0:6524:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9200/0xb25dda4f4e92db50 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xb25dda4f4e92db57 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740420.302654:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9200/0xb25dda4f4e92db50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xb25dda4f4e92db57 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740420.302668:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790740420.302672:0:6524:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98db83f32600/0xb25dda4f4e92ddd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb25dda4f4e92dddb expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740420.302677:0:6524:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f32600 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:2.0:1790740420.302680:0:6524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98db83f32600/0xb25dda4f4e92ddd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb25dda4f4e92dddb expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740420.302686:0:6524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98db83f32600/0xb25dda4f4e92ddd4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xb25dda4f4e92dddb expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790740420.303364:0:6524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98db83f32600/0xb25dda4f4e92ddd4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xb25dda4f4e92dddb expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740420.303388:0:6524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1790740420.303391:0:6524:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1790740420.303399:0:6524:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98dc85fb1800 00010000:00010000:2.0:1790740420.303403:0:6524:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98db83f32600/0xb25dda4f4e92ddd4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xb25dda4f4e92dddb expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740420.303413:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740420.303415:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740420.303418:0:6524:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740420.303531:0:15781:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1790740420.303537:0:15781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98db83f32600/0xb25dda4f4e92ddd4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xb25dda4f4e92dddb expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740420.303575:0:15781:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1790740420.303582:0:15781:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:1.0:1790740420.303584:0:15781:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1790740420.303626:0:15781:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1790740420.303632:0:15781:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1790740420.303640:0:15781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790740420.303647:0:15781:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790740420.303841:0:15781:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff98dcbd5a3380) has no exports 00000020:00080000:1.0:1790740420.303880:0:15781:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff98dcbd5a3380) has no exports 00010000:00010000:0.0:1790740420.304620:0:6523:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1790740420.306202:0:15781:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff98db82a37c00 - data ffff98db8247fd80/ffff98dcaefffc00 00000020:01000000:1.0:1790740420.306435:0:15781:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff98db83baa240 - data ffff98db82418288/ffff98db83b94c00 00100000:10000000:1.0:1790740420.320859:0:15781:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1790740420.330725:0:15781:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92d9e4 00000020:00000080:3.0:1790740420.330741:0:15781:0:(genops.c:885:class_export_put()) final put ffff98db82ff3000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1790740420.330770:0:15781:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98dcb5f0a000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1790740420.330785:0:15781:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98dcb5f0a000 2 00000020:01000004:3.0:1790740420.330789:0:15781:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98dcb5f0a000 from lustre-OST0001 00000020:00000080:3.0:1790740420.330823:0:15781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790740420.330835:0:15781:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1790740420.330848:0:15781:0:(genops.c:885:class_export_put()) final put ffff98db82ff2800/lustre-OST0001_UUID 00000020:00000080:3.0:1790740420.330851:0:15781:0:(genops.c:844:class_export_destroy()) destroying export ffff98db82ff2800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1790740420.330860:0:15781:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1790740420.331024:0:15781:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import ad8ddc53-446f-4b77-85d5-90ebc88dfa76->MGS 00010000:00010000:3.0:1790740420.331078:0:15781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dc80031a00/0xb25dda4f4e92d73d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb25dda4f4e92d744 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790740420.331093:0:15781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dc80031a00/0xb25dda4f4e92d73d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb25dda4f4e92d744 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740420.331100:0:15781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1790740420.331103:0:15781:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1790740420.331107:0:15781:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1790740420.331124:0:15781:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98dc85fb1800 00010000:00010000:3.0:1790740420.331129:0:15781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dc80031a00/0xb25dda4f4e92d73d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb25dda4f4e92d744 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740420.331147:0:15781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dc80031e00/0xb25dda4f4e92dbb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb25dda4f4e92dbb9 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790740420.331155:0:15781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dc80031e00/0xb25dda4f4e92dbb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb25dda4f4e92dbb9 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740420.331160:0:15781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790740420.331162:0:15781:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1790740420.331164:0:15781:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1790740420.331183:0:15781:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98dc85fb1800 00010000:00010000:3.0:1790740420.331186:0:15781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dc80031e00/0xb25dda4f4e92dbb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb25dda4f4e92dbb9 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1790740420.331213:0:15781:0:(import.c:65:import_set_state_nolock()) ffff98dc85fb1800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1790740420.331217:0:15781:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1790740420.331220:0:15781:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1790740420.331222:0:15781:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1790740420.331227:0:15781:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1790740420.331242:0:15781:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98dcbfe2ce00 x1877727022061440/t0(0) o250->MGC192.168.204.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1790740425 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1790740420.331262:0:15781:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1790740420.331265:0:15781:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000100:00100000:1.0:1790740420.331432:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ad8ddc53-446f-4b77-85d5-90ebc88dfa76:3637:1877727022061440:0@lo:250:kworker.0 10000000:01000000:3.0:1790740420.331512:0:15781:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1790740420.331521:0:15781:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92d63a 00000020:00000080:3.0:1790740420.331526:0:15781:0:(genops.c:885:class_export_put()) final put ffff98dc85fb1000/ad8ddc53-446f-4b77-85d5-90ebc88dfa76 00000020:01000000:3.0:1790740420.331533:0:15781:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.103@tcp (flags='') 00000020:00000080:3.0:1790740420.331538:0:15781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790740420.331544:0:15781:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.103@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1790740420.331549:0:15781:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff98dc992499c0) has no exports 00000020:00000080:2.0:1790740420.331640:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98db82ff3000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1790740420.331649:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98dc85fb1000/ad8ddc53-446f-4b77-85d5-90ebc88dfa76 for MGC192.168.204.103@tcp 10000000:01000000:1.0:1790740420.332279:0:6532:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1790740420.332383:0:15781:0:(obd_class.h:668:obd_cleanup_client_import()) MGC192.168.204.103@tcp: client import never connected 00000100:00080000:3.0:1790740420.332388:0:15781:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1790740420.332391:0:15781:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1790740420.332394:0:15781:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1790740420.332397:0:15781:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1790740420.332455:0:15781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790740420.332461:0:15781:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.103@tcp (uuid ad8ddc53-446f-4b77-85d5-90ebc88dfa76) 00000020:01000000:3.0:1790740420.332469:0:15781:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1790740420.332474:0:15781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790740420.332480:0:15781:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1790740420.332486:0:15781:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff98db82356000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790740420.332491:0:15781:0:(genops.c:1552:class_disconnect_exports()) OBD device 25 (ffff98dcbd5a19c0) has exports, disconnecting them 00000020:00080000:3.0:1790740420.332496:0:15781:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff98db82356000), last request at 1790740201 00000020:00000080:3.0:1790740420.332500:0:15781:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92da0e 00000020:00080000:3.0:1790740420.332522:0:15781:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff98db82356000): rc 0 00000020:00000080:3.0:1790740420.332528:0:15781:0:(genops.c:885:class_export_put()) final put ffff98db82356000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1790740420.333389:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98dc85fb1800 for MGC192.168.204.103@tcp 00000020:00000080:1.0:1790740420.333402:0:37:0:(genops.c:885:class_export_put()) final put ffff98dc88127000/ad8ddc53-446f-4b77-85d5-90ebc88dfa76 00000020:00000080:1.0:1790740420.333406:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98dc88127000/ad8ddc53-446f-4b77-85d5-90ebc88dfa76 for MGC192.168.204.103@tcp 00000020:01000000:1.0:1790740420.333423:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.103@tcp (ad8ddc53-446f-4b77-85d5-90ebc88dfa76) 00000020:00000080:1.0:1790740420.333741:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98db82356000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1790740420.336109:0:15781:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1790740420.336121:0:15781:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790740420.336127:0:15781:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1790740420.336138:0:15781:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790740420.336387:0:15781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790740420.336399:0:15781:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1790740420.336411:0:15781:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1790740420.336416:0:15781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790740420.336421:0:15781:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1790740420.336431:0:15781:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff98db82fdb800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790740420.336440:0:15781:0:(genops.c:1552:class_disconnect_exports()) OBD device 26 (ffff98dcb6c6cd40) has exports, disconnecting them 00000020:00080000:2.0:1790740420.336445:0:15781:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff98db82fdb800), last request at 1790740201 00000020:00000080:2.0:1790740420.336450:0:15781:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92da23 00000020:00080000:2.0:1790740420.336470:0:15781:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff98db82fdb800): rc 0 00000020:00000080:2.0:1790740420.336477:0:15781:0:(genops.c:885:class_export_put()) final put ffff98db82fdb800/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1790740420.337383:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98db82ff7000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1790740420.337410:0:37:0:(genops.c:885:class_export_put()) final put ffff98db82ff5000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1790740420.337414:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98db82ff5000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1790740420.337423:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1790740420.337510:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98db82fdb800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1790740420.376532:0:15781:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1790740420.382603:0:15781:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1790740420.382610:0:15781:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1790740420.382620:0:15781:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1790740420.388832:0:10357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1790740420.389059:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1790740420.391242:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1790740420.391591:0:6519:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_001: service thread [ffff98dca136d600:6519] 1 exiting: rc = 0 00000020:00000080:1.0:1790740420.392478:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98db82fd8800 for lustre-MDT0001-lwp-OST0001 00000100:00100000:1.0:1790740420.392579:0:6518:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_000: service thread [ffff98dcaa977c00:6518] 0 exiting: rc = 1 00000100:00100000:3.0:1790740420.392818:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.393287:0:6522:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_002: service thread [ffff98dcaa969800:6522] 2 exiting: rc = 0 00000100:00100000:1.0:1790740420.393534:0:10416:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_004: service thread [ffff98db83ca5800:10416] 4 exiting: rc = 0 00000100:00100000:0.0:1790740420.393578:0:6520:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_000: service thread [ffff98dca136de00:6520] 0 exiting: rc = 1 00000100:00100000:1.0:1790740420.393657:0:6521:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_001: service thread [ffff98dca136c400:6521] 1 exiting: rc = 0 00000100:00100000:1.0:1790740420.393723:0:9550:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_003: service thread [ffff98db82fc3600:9550] 3 exiting: rc = 0 00000100:00100000:3.0:1790740420.393885:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.393895:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.393904:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.393982:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394007:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394021:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394027:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394060:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394067:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394073:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394079:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394087:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394093:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394107:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394117:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394124:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394432:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394443:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394450:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394457:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394463:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394469:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394474:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394479:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394485:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394490:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394496:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394502:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394507:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394513:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394519:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394524:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394546:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394551:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394632:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394639:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394644:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394650:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394656:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394662:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394668:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394675:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394681:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394688:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394693:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394700:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394706:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394714:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394721:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394727:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394733:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394740:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394746:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394751:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394756:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394762:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394768:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394773:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394779:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394785:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394790:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394796:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394802:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.394807:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1790740420.405535:0:15781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790740420.405552:0:15781:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1790740420.405559:0:15781:0:(genops.c:885:class_export_put()) final put ffff98db82fda800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1790740420.405577:0:15781:0:(genops.c:844:class_export_destroy()) destroying export ffff98db82fda800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1790740420.405584:0:15781:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1790740420.405667:0:15781:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98dcb5f0a000 1 00000020:00000080:1.0:1790740420.405675:0:15781:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb25dda4f4e92d9b3 00000020:00000080:1.0:1790740420.405682:0:15781:0:(genops.c:885:class_export_put()) final put ffff98dcb81ff000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1790740420.405703:0:15781:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1790740420.405708:0:15781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790740420.405713:0:15781:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1790740420.405718:0:15781:0:(genops.c:1557:class_disconnect_exports()) OBD device 23 (ffff98dcb6c699c0) has no exports 00000020:00000080:2.0:1790740420.405940:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98dcb81ff000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1790740420.466835:0:15781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790740420.466861:0:15781:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1790740420.466869:0:15781:0:(genops.c:885:class_export_put()) final put ffff98dcb5f99000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1790740420.466875:0:15781:0:(genops.c:844:class_export_destroy()) destroying export ffff98dcb5f99000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1790740420.466884:0:15781:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1790740420.468319:0:15781:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98dcb5f9f800 00000020:01000000:2.0:1790740420.468364:0:15781:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1790740420.468373:0:15781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790740420.468379:0:15781:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1790740420.468385:0:15781:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff98dcbc238000) has no exports 00000020:00000080:2.0:1790740420.468414:0:15781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790740420.468420:0:15781:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1790740420.468424:0:15781:0:(genops.c:885:class_export_put()) final put ffff98dcb5f0b800/OSS_uuid 00000020:00000080:2.0:1790740420.468428:0:15781:0:(genops.c:844:class_export_destroy()) destroying export ffff98dcb5f0b800/OSS_uuid for OSS 00000020:01000000:2.0:1790740420.468434:0:15781:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1790740420.468775:0:8453:0:(service.c:3206:ptlrpc_main()) ll_ost00_001: service thread [ffff98dcaed0f600:8453] 1 exiting: rc = 0 00000100:00100000:2.0:1790740420.468901:0:8454:0:(service.c:3206:ptlrpc_main()) ll_ost00_002: service thread [ffff98dcaed0e400:8454] 2 exiting: rc = 0 00000100:00080000:0.0:1790740420.469216:0:6531:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1790740420.469617:0:9806:0:(service.c:3206:ptlrpc_main()) ll_ost00_003: service thread [ffff98db82fc5800:9806] 3 exiting: rc = 0 00000100:00100000:1.0:1790740420.469812:0:14497:0:(service.c:3206:ptlrpc_main()) ll_ost00_004: service thread [ffff98db844c4200:14497] 4 exiting: rc = 0 00000100:00100000:1.0:1790740420.469886:0:8451:0:(service.c:3206:ptlrpc_main()) ll_ost00_000: service thread [ffff98dcaed1b600:8451] 0 exiting: rc = 1 00000100:00100000:2.0:1790740420.470457:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470470:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470477:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470486:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470493:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470500:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470527:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470533:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470538:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470544:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470549:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470555:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470560:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470577:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470583:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470588:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470594:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470600:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470607:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470613:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470618:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470624:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470630:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470636:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470641:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470648:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470654:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470659:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470664:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470670:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470676:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470682:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470786:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470794:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470801:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470808:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470815:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470820:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470827:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470833:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470840:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470855:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470860:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470865:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470871:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470876:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470882:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470888:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470894:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470901:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470907:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470913:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470919:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470933:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470940:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470947:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470953:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470959:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470964:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470970:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470976:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470982:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470988:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.470998:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.473475:0:10118:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_002: service thread [ffff98db83dce800:10118] 2 exiting: rc = 0 00000100:00100000:1.0:1790740420.473993:0:8455:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_000: service thread [ffff98dcaed0f400:8455] 0 exiting: rc = 1 00000100:00100000:3.0:1790740420.474538:0:8456:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_001: service thread [ffff98dcaed0da00:8456] 1 exiting: rc = 0 00000100:00100000:2.0:1790740420.474671:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.474681:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.474699:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.474706:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.474713:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.474719:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.474725:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.474731:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.474737:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.474743:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.474749:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.474755:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.474781:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.474788:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.474794:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.474800:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.474806:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.474813:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.474819:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.474825:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.474831:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.474836:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.474842:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.474848:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.474853:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.474858:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.474863:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.474869:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.474874:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.474880:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.474886:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.474891:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.474897:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.474903:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.474909:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.474915:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.474921:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.474927:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.474933:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.474939:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.474945:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.474950:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.474955:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.474960:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.474966:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.474972:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.474977:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.474991:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.474997:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.475002:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.475008:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.475013:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.475061:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.475069:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.475074:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.475080:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.475085:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.475091:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.475104:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.475110:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.475116:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.475122:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.475128:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740420.475134:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.477209:0:8459:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_002: service thread [ffff98dcaed1d200:8459] 2 exiting: rc = 0 00000100:00100000:2.0:1790740420.477864:0:8457:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_000: service thread [ffff98dcaed1ca00:8457] 0 exiting: rc = 1 00000100:00100000:1.0:1790740420.477864:0:8458:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_001: service thread [ffff98dcaed1c200:8458] 1 exiting: rc = 0 00000100:00100000:3.0:1790740420.477960:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.477969:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.477988:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.477996:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.478002:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.478007:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.478013:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.478051:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.478060:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.478066:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.478073:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.478107:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.478116:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.478123:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.478129:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.478136:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.478143:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.478149:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.478166:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.478173:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.478180:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.478187:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.478194:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.478201:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.478207:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.479481:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.479503:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.479510:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.479516:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.479522:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.479529:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.479535:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.479541:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.479547:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.479553:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.479619:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.479626:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.479633:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.479638:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.479645:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.479651:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.479657:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.479664:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.479671:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.479678:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.479790:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.479800:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.479817:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.479825:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.479831:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.479838:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.479846:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.479851:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.479857:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.479863:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.479871:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.479878:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.479883:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.479890:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.479896:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.479902:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.479908:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.479925:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.479932:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.499908:0:8614:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_002: service thread [ffff98db82953c00:8614] 2 exiting: rc = 0 00000100:00100000:2.0:1790740420.501130:0:8460:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff98dcaed0de00:8460] 0 exiting: rc = 1 00000100:00100000:1.0:1790740420.503347:0:8461:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff98dcb5ec9200:8461] 1 exiting: rc = 0 00000100:00100000:3.0:1790740420.503718:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.503728:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.503735:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.503741:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.503748:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.503753:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.503780:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.503786:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.503791:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.503797:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.503802:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.503808:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.503814:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.503821:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.503826:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.503832:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.504011:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.504317:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.504354:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.504362:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.504367:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.504373:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.504378:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.504384:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.504389:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.504395:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.504401:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.504407:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.504413:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.504421:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.504428:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.504435:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.504440:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.504527:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.504536:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.504541:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.504546:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.504552:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.504557:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.504574:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.504581:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.504599:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.504604:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.504609:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.504614:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.504619:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.504624:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.504630:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.504636:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.504652:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.504658:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.504663:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.504668:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.504673:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.504678:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.504683:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.504688:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.504693:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.504795:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.504802:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.504807:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.504812:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.504817:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740420.504829:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.513736:0:8462:0:(service.c:3206:ptlrpc_main()) ll_ost_out00_000: service thread [ffff98dcb5ec6800:8462] 0 exiting: rc = 1 00000100:00100000:2.0:1790740420.515332:0:8463:0:(service.c:3206:ptlrpc_main()) ll_ost_out00_001: service thread [ffff98dcb5ec7600:8463] 1 exiting: rc = 0 00000100:00100000:0.0:1790740420.515856:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.515884:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.515893:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.515899:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.515906:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.515912:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.515919:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.515925:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.515931:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.515940:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.515977:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.515986:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.515993:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.516001:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.516009:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.516016:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.516023:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.516069:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.516077:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.516085:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.516092:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.516399:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.516425:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.516435:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.516442:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.516451:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.516458:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.516467:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.516474:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.516482:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.516489:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.516498:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.516504:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.516510:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.516531:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.516539:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.516545:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.516551:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.516558:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.516578:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.516586:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.516593:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.516600:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.516607:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.516614:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.516621:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.516648:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.516657:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.516663:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.516670:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.516676:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.516682:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.516716:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.516723:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.516730:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.516739:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.516744:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.516752:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.516773:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.516782:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.516788:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.516796:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.516803:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740420.516824:0:15781:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1790740420.541128:0:15781:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1790740445.048928:0:16546:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg403-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1790740456.438987:0:17145:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1790740456.438995:0:17145:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1790740456.438996:0:17145:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1790740456.439527:0:17145:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98db84771800 00000020:01000004:3.0:1790740456.439544:0:17145:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1790740456.439552:0:17145:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1790740456.439569:0:17145:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff98dcaefc99c0) 00000020:00000080:3.0:1790740456.439583:0:17145:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1790740456.531299:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1790740456.542503:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1790740456.549990:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1790740456.550387:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1790740456.550640:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1790740456.550948:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1790740456.551206:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1790740456.551435:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1790740456.551657:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1790740456.554495:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1790740456.554980:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1790740456.555250:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1790740456.555514:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1790740456.555829:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1790740456.556101:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1790740456.556373:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1790740456.556625:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1790740456.556907:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1790740456.557210:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1790740456.557441:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1790740456.560827:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1790740456.564708:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1790740456.565440:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1790740456.565711:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1790740456.566066:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1790740456.566732:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1790740456.567027:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1790740456.567386:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1790740456.567625:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1790740456.567887:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1790740456.568277:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1790740456.568605:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1790740456.569481:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1790740456.569756:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1790740456.574844:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1790740456.576938:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1790740456.577353:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1790740456.577534:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1790740456.577901:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1790740456.578399:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1790740456.578621:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1790740456.578831:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1790740456.579053:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1790740456.579269:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1790740456.580027:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1790740456.580539:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1790740456.580865:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1790740456.581409:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:0.0:1790740456.582505:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1790740456.582765:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:0.0:1790740456.584081:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1790740456.584544:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1790740456.584810:0:17145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:1.0:1790740456.585970:0:17145:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1790740456.586439:0:17145:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1790740456.586446:0:17145:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:1.0:1790740456.586458:0:17145:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb25dda4f4e92ebe9 00000020:01000004:1.0:1790740456.586466:0:17145:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1790740456.586470:0:17145:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1790740456.586476:0:17145:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98db84771800 from MGS 00000020:01000004:1.0:1790740456.586479:0:17145:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1790740456.586490:0:17145:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff98dcbd5a19c0) 00000020:00000080:1.0:1790740456.586500:0:17145:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1790740456.586559:0:17145:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98db84771800 from MGS, refs=2 00080000:01000000:1.0:1790740456.586565:0:17145:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790740456.586569:0:17145:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb25dda4f4e92ebf7 00000100:00100000:1.0:1790740456.586679:0:17145:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1790740456.586828:0:17145:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1790740456.586834:0:17145:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1790740456.589613:0:17145:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1790740456.589627:0:17145:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1790740456.590612:0:17145:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790740456.590810:0:17145:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1790740456.590816:0:17145:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1790740456.591581:0:17145:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1790740456.591589:0:17145:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1790740456.592434:0:17145:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1790740456.592442:0:17145:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1790740456.593832:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740456.593837:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740456.593839:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740456.594610:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740456.594619:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740456.594621:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740456.595457:0:17145:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1790740456.600215:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1790740456.602944:0:17145:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1790740456.604953:0:17157:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1790740456.605312:0:17145:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1790740456.605355:0:17145:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1790740456.606211:0:17145:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1790740456.606843:0:17145:0:(service.c:173:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790740456.607384:0:17145:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1790740456.607397:0:17145:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1790740456.608285:0:17145:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1790740456.608293:0:17145:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1790740456.609293:0:17145:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1790740456.609303:0:17145:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1790740456.610100:0:17145:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1790740456.610122:0:17145:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.103@tcp' 00000020:01000004:2.0:1790740456.610124:0:17145:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1790740456.610156:0:17145:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.103@tcp (typ=mgc) 00000020:00000080:2.0:1790740456.610170:0:17145:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.103@tcp (ffff98dcbc23b380) 00000020:00000080:2.0:1790740456.610186:0:17145:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1790740456.610268:0:17145:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98db83f22000@MGC192.168.204.103@tcp: add connection 192.168.204.103@tcp at head 00010000:00010000:2.0:1790740456.610413:0:17145:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.103@tcp-0 is initialized 00000040:01000000:2.0:1790740456.610421:0:17145:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.103@tcp ctxt 1 is initialized 00000100:00080000:1.0:1790740456.613295:0:17162:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1790740456.613432:0:17163:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1790740456.613524:0:17145:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.103@tcp (uuid 0847d467-2c8f-428f-ab2a-50e9cfba84d8) 00000020:00000080:2.0:1790740456.613546:0:17145:0:(genops.c:1384:class_connect()) connect: client 0847d467-2c8f-428f-ab2a-50e9cfba84d8, cookie 0xb25dda4f4e92ec05 00000100:00080000:2.0:1790740456.613557:0:17145:0:(import.c:545:import_select_connection()) MGC192.168.204.103@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790740456.613569:0:17145:0:(import.c:666:import_select_connection()) MGC192.168.204.103@tcp: import ffff98db83f22000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:2.0:1790740456.613603:0:17145:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98db84651500 x1877727022062208/t0(0) o250->MGC192.168.204.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790740456.613730:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84651500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3637:1877727022062208:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1790740456.613803:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740456.613916:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022062208 00000100:00100000:0.0:1790740456.613925:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022062208 00000100:00100000:0.0:1790740456.613958:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790740456.613966:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc217450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3637:x1877727022062208:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1790740456.613987:0:17159:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 0847d467-2c8f-428f-ab2a-50e9cfba84d8@0@lo t0 exp 0000000000000000 cur 527 last 0 00000020:00000080:0.0:1790740456.614010:0:17159:0:(genops.c:1384:class_connect()) connect: client 0847d467-2c8f-428f-ab2a-50e9cfba84d8, cookie 0xb25dda4f4e92ec0c 00000100:00080000:0.0:1790740456.614165:0:17159:0:(import.c:65:import_set_state_nolock()) ffff98db846f1000 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1790740456.614248:0:17145:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 0847d467-2c8f-428f-ab2a-50e9cfba84d8->MGS 00000020:01000004:2.0:1790740456.614267:0:17145:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1790740456.614272:0:17145:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1790740456.614287:0:17145:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff98dcbc238000) 00000020:00000080:2.0:1790740456.614297:0:17145:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1790740456.617210:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc217450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+5:3637:x1877727022062208:12345-0@lo:250:mount.lustre.0 Request processed in 3235us (3399us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740456.617224:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790740456.617546:0:3637:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.103@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1790740456.617559:0:3637:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.204.103@tcp: connect to target with instance 0 00000100:00080000:1.0:1790740456.617568:0:3637:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.204.103@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1790740456.617573:0:3637:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1790740456.617578:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98db83f22000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1790740456.617580:0:3637:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1790740456.617589:0:3637:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1790740456.617596:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84651500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3637:1877727022062208:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1790740456.634951:0:17145:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790740456.635426:0:17145:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1790740456.635432:0:17145:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1790740456.636825:0:17145:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1790740456.636836:0:17145:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1790740456.637350:0:17145:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1790740456.637358:0:17145:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1790740456.638516:0:17145:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790740456.638977:0:17145:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1790740456.638984:0:17145:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1790740456.640923:0:17145:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1790740456.640936:0:17145:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1790740456.700961:0:17145:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790740456.701282:0:17145:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1790740456.701289:0:17145:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1790740456.702524:0:17145:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1790740456.702535:0:17145:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1790740456.703369:0:17145:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790740456.703536:0:17145:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1790740456.703543:0:17145:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1790740456.704410:0:17145:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1790740456.704418:0:17145:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1790740456.705588:0:17145:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790740456.705867:0:17145:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790740456.705884:0:17145:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1790740456.706532:0:17145:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790740456.706539:0:17145:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1790740456.708455:0:17145:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790740456.708852:0:17145:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790740456.708860:0:17145:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1790740456.709571:0:17145:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790740456.709579:0:17145:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1790740456.725261:0:17145:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790740456.725485:0:17145:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1790740456.725492:0:17145:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1790740456.728955:0:17145:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1790740456.728973:0:17145:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1790740456.729991:0:17145:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1790740456.730000:0:17145:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1790740456.731514:0:17145:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1790740456.731550:0:17145:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1790740456.731558:0:17145:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.103@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1790740456.731823:0:17145:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.103@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790740456.731860:0:17145:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.103@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1790740456.731864:0:17145:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790740456.731866:0:17145:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790740456.731867:0:17145:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790740456.731869:0:17145:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790740456.731870:0:17145:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790740456.731871:0:17145:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790740456.731883:0:17145:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790740456.731885:0:17145:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790740456.731892:0:17145:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790740456.731893:0:17145:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790740456.731896:0:17145:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1790740456.731898:0:17145:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790740456.731899:0:17145:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790740456.731900:0:17145:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790740456.731901:0:17145:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790740456.731902:0:17145:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790740456.731903:0:17145:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790740456.731903:0:17145:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790740456.731904:0:17145:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790740456.731905:0:17145:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790740456.731906:0:17145:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790740456.731937:0:17145:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1790740456.731958:0:17145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84650380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17145:1877727022062336:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790740456.732637:0:17145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740456.732707:0:17145:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc82d34000 going to sleep for 11 seconds 00000100:00100000:1.0:1790740456.732899:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022062336 00000100:00100000:1.0:1790740456.732908:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022062336 00000100:00100000:1.0:1790740456.732966:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790740456.732976:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+5:17145:x1877727022062336:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790740456.733025:0:17161:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1790740456.733080:0:17161:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1790740456.733085:0:17161:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1790740456.733566:0:17181:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1790740456.734235:0:17161:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:2.0:1790740456.737433:0:17182:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1790740456.737441:0:17182:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1790740456.737444:0:17182:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1790740456.737447:0:17182:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1790740456.737638:0:17182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1790740456.737900:0:17161:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1790740456.737912:0:17161:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1790740456.740369:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+5:17145:x1877727022062336:12345-0@lo:253:mount.lustre.0 Request processed in 7385us (7724us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740456.740384:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790740456.740535:0:17145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84650380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17145:1877727022062336:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790740456.740549:0:17145:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1790740456.740552:0:17145:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790740456.740554:0:17145:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790740456.740555:0:17145:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790740456.740556:0:17145:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790740456.740558:0:17145:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790740456.740559:0:17145:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790740456.740561:0:17145:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790740456.740562:0:17145:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790740456.740564:0:17145:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790740456.740566:0:17145:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790740456.740588:0:17145:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98db84771800 from lustre-MDT0000 10000000:01000000:2.0:1790740456.740692:0:17145:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1790740456.740701:0:17145:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1790740456.740705:0:17145:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff98dcbc23b380 10000000:01000000:2.0:1790740456.740710:0:17145:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790740456.740720:0:17145:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98dcbc23b380 from 1 10000000:01000000:2.0:1790740456.740722:0:17145:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790740456.740764:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98db83f32800/0xb25dda4f4e92ec1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740456.740775:0:17145:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98db83f32800/0xb25dda4f4e92ec1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740456.740785:0:17145:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98db83f32800/0xb25dda4f4e92ec1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740456.740806:0:17145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84650380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17145:1877727022062464:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790740456.740843:0:17145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740456.740926:0:17145:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc82d34600 going to sleep for 11 seconds 00000100:00100000:0.0:1790740456.740968:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022062464 00000100:00100000:0.0:1790740456.740975:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022062464 00000100:00100000:0.0:1790740456.741083:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790740456.741092:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+5:17145:x1877727022062464:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790740456.741105:0:17159:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740456.741118:0:17159:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcaeee2000/0xb25dda4f4e92ec21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92ec1a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740456.741140:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcaeee2000/0xb25dda4f4e92ec21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92ec1a expref: 6 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740456.741150:0:17159:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcaeee2000/0xb25dda4f4e92ec21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92ec1a expref: 6 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740456.741158:0:17159:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaeee2000, rc 0) 00000100:00100000:0.0:1790740456.741208:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+6:17145:x1877727022062464:12345-0@lo:101:mount.lustre.0 Request processed in 117us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740456.741214:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790740456.741284:0:17145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84650380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17145:1877727022062464:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790740456.741310:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98db83f32800/0xb25dda4f4e92ec1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ec21 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740456.741319:0:17145:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98db83f32800/0xb25dda4f4e92ec1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92ec21 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740456.741370:0:17145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17145:1877727022062592:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790740456.741398:0:17145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740456.741764:0:17145:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc990499c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740456.741850:0:17160:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022062592 00000100:00100000:2.0:1790740456.741855:0:17160:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022062592 00000100:00100000:2.0:1790740456.741891:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790740456.741898:0:17160:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc216450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+6:17145:x1877727022062592:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790740456.741987:0:17160:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc216450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+6:17145:x1877727022062592:12345-0@lo:501:mount.lustre.0 Request processed in 89us (588us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790740456.741994:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790740456.742166:0:17145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17145:1877727022062592:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1790740456.742195:0:17145:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1790740456.742217:0:17145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98db83f32800/0xb25dda4f4e92ec1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ec21 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740456.742239:0:17145:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98db83f32800/0xb25dda4f4e92ec1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ec21 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740456.742247:0:17145:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98db84771800 10000000:01000000:3.0:1790740456.742251:0:17145:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790740456.742255:0:17145:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff98db84771800 10000000:01000000:3.0:1790740456.742258:0:17145:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1790740456.742260:0:17145:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff98db84771800 from 1 10000000:01000000:3.0:1790740456.742262:0:17145:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1790740456.742283:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8c00/0xb25dda4f4e92ec28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740456.742290:0:17145:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8c00/0xb25dda4f4e92ec28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740456.742487:0:17145:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8c00/0xb25dda4f4e92ec28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740456.742502:0:17145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17145:1877727022062720:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790740456.742532:0:17145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740456.742562:0:17145:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc990499c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740456.742623:0:17160:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022062720 00000100:00100000:2.0:1790740456.742628:0:17160:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022062720 00000100:00100000:2.0:1790740456.742648:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790740456.742654:0:17160:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc217850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+6:17145:x1877727022062720:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790740456.742662:0:17160:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740456.742684:0:17160:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98db83f33c00/0xb25dda4f4e92ec2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92ec28 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740456.742700:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98db83f33c00/0xb25dda4f4e92ec2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92ec28 expref: 7 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740456.742709:0:17160:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98db83f33c00/0xb25dda4f4e92ec2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92ec28 expref: 7 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740456.742715:0:17160:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f33c00, rc 0) 00000100:00100000:2.0:1790740456.742751:0:17160:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc217850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+7:17145:x1877727022062720:12345-0@lo:101:mount.lustre.0 Request processed in 97us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740456.742757:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790740456.742890:0:17145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17145:1877727022062720:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790740456.742901:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8c00/0xb25dda4f4e92ec28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ec2f expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740456.742909:0:17145:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8c00/0xb25dda4f4e92ec28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92ec2f expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740456.742930:0:17145:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1790740456.742943:0:17145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8c00/0xb25dda4f4e92ec28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ec2f expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740456.742950:0:17145:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8c00/0xb25dda4f4e92ec28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ec2f expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740456.742956:0:17145:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1790740456.742960:0:17145:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790740456.742963:0:17145:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff98db84771800 10000000:01000000:3.0:1790740456.742966:0:17145:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1790740456.742969:0:17145:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1790740456.742971:0:17145:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1790740456.742983:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9e00/0xb25dda4f4e92ec36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740456.742990:0:17145:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9e00/0xb25dda4f4e92ec36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740456.742998:0:17145:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9e00/0xb25dda4f4e92ec36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740456.743008:0:17145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17145:1877727022062848:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790740456.743055:0:17145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740456.743068:0:17145:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc990499c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740456.743159:0:17160:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022062848 00000100:00100000:2.0:1790740456.743163:0:17160:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022062848 00000100:00100000:2.0:1790740456.743180:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790740456.743185:0:17160:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+7:17145:x1877727022062848:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790740456.743191:0:17160:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740456.743198:0:17160:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98db83f32600/0xb25dda4f4e92ec3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92ec36 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740456.743211:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98db83f32600/0xb25dda4f4e92ec3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92ec36 expref: 8 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740456.743219:0:17160:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98db83f32600/0xb25dda4f4e92ec3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92ec36 expref: 8 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740456.743225:0:17160:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f32600, rc 0) 00000100:00100000:2.0:1790740456.743247:0:17160:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+8:17145:x1877727022062848:12345-0@lo:101:mount.lustre.0 Request processed in 62us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740456.743261:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790740456.743368:0:17145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17145:1877727022062848:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790740456.743377:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9e00/0xb25dda4f4e92ec36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ec3d expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740456.743390:0:17145:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9e00/0xb25dda4f4e92ec36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92ec3d expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740456.743432:0:17145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17145:1877727022062976:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790740456.743453:0:17145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740456.743472:0:17145:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc990499c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740456.743517:0:17160:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022062976 00000100:00100000:2.0:1790740456.743521:0:17160:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022062976 00000100:00100000:2.0:1790740456.743536:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790740456.743541:0:17160:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc37b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+8:17145:x1877727022062976:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790740456.743655:0:17160:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc37b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+9:17145:x1877727022062976:12345-0@lo:501:mount.lustre.0 Request processed in 113us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740456.743661:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790740456.743766:0:17145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17145:1877727022062976:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790740456.743802:0:17145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17145:1877727022063104:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790740456.743834:0:17145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740456.743859:0:17145:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc990499c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740456.743911:0:17160:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022063104 00000100:00100000:2.0:1790740456.743915:0:17160:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022063104 00000100:00100000:2.0:1790740456.743930:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790740456.743935:0:17160:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc37b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+9:17145:x1877727022063104:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790740456.744551:0:17160:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc37b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+9:17145:x1877727022063104:12345-0@lo:503:mount.lustre.0 Request processed in 614us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740456.744558:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790740456.744682:0:17145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17145:1877727022063104:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790740456.745125:0:17183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17183:1877727022063232:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790740456.745161:0:17183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740456.745182:0:17183:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc990496c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740456.745326:0:17160:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022063232 00000100:00100000:2.0:1790740456.745331:0:17160:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022063232 00000100:00100000:2.0:1790740456.745354:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790740456.745360:0:17160:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc37bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+9:17183:x1877727022063232:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790740456.746104:0:17160:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc37bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+9:17183:x1877727022063232:12345-0@lo:502:llog_process_th.0 Request processed in 741us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740456.746113:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790740456.746314:0:17183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17183:1877727022063232:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790740456.746346:0:17183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790740456.746359:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790740456.746362:0:17183:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1790740456.746368:0:17183:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1790740456.746371:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790740456.746387:0:17183:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff98dcaefccd40) 00000020:00000080:3.0:1790740456.746403:0:17183:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1790740456.746408:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1790740456.746484:0:17183:0:(osd_handler.c:8931:osd_obd_connect()) connect #2 00000020:00000080:3.0:1790740456.746490:0:17183:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb25dda4f4e92ec4b 00000020:00000080:3.0:1790740456.746812:0:17183:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1790740456.746817:0:17183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790740456.746822:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790740456.746823:0:17183:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1790740456.746826:0:17183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790740456.746830:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790740456.746831:0:17183:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1790740456.746835:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790740456.746843:0:17183:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff98dcaefc8000) 00000020:00000080:3.0:1790740456.746853:0:17183:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1790740456.746857:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1790740456.746860:0:17183:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1790740456.746863:0:17183:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1790740456.746869:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1790740456.746945:0:17183:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98db84771800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1790740456.746958:0:17183:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff98dcaefcb380) 00000020:00000080:3.0:1790740456.746966:0:17183:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1790740456.747014:0:17183:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1790740456.747019:0:17183:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb25dda4f4e92ec60 00000020:00000080:3.0:1790740456.747152:0:17183:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1790740456.747159:0:17183:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1790740456.747164:0:17183:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xb25dda4f4e92ec67 00080000:01000000:3.0:1790740456.747168:0:17183:0:(osd_handler.c:8931:osd_obd_connect()) connect #3 00000020:00000080:3.0:1790740456.747172:0:17183:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb25dda4f4e92ec6e 00010000:00010000:3.0:1790740456.868022:0:17183:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1790740456.869150:0:17183:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:3.0:1790740456.869521:0:17183:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1790740456.871126:0:17183:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff98dc897419c0) 00000020:00000080:3.0:1790740456.871152:0:17183:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1790740456.872396:0:17183:0:(osd_handler.c:8931:osd_obd_connect()) connect #4 00000020:00000080:3.0:1790740456.872684:0:17183:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb25dda4f4e92ec7c 00000020:00000080:1.0:1790740456.878023:0:17183:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1790740456.887595:0:17183:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xb25dda4f4e92ec83 00000020:00000080:1.0:1790740456.888240:0:17183:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1790740456.888252:0:17183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790740456.888261:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740456.888263:0:17183:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1790740456.888266:0:17183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1790740456.888269:0:17183:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1790740456.888271:0:17183:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790740456.888272:0:17183:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790740456.888274:0:17183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1790740456.888276:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740456.888278:0:17183:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1790740456.888284:0:17183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790740456.888290:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740456.888293:0:17183:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1790740456.888307:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1790740456.888353:0:17183:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1790740456.888369:0:17183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790740456.888371:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740456.888373:0:17183:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1790740456.888375:0:17183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790740456.888377:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740456.888379:0:17183:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1790740456.888381:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790740456.888386:0:17183:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.103@tcp to nid 0x20000c0a8cc67 (192.168.204.103@tcp) 00000020:00000080:1.0:1790740456.888410:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790740456.888427:0:17183:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff98dcbd5a4d40) 00000020:00000080:1.0:1790740456.888441:0:17183:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1790740456.888445:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1790740456.888495:0:17183:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1790740456.888500:0:17183:0:(osd_handler.c:8931:osd_obd_connect()) connect #5 00000020:00000080:1.0:1790740456.888505:0:17183:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb25dda4f4e92ec91 00010000:00080000:1.0:1790740456.888534:0:17183:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98dcb5f18000@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.103@tcp at head 00010000:00010000:1.0:1790740456.891403:0:17183:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1790740456.895266:0:17183:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790740456.895282:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1790740456.895518:0:17183:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1790740456.895542:0:17183:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb25dda4f4e92ec98 00000100:00080000:1.0:1790740456.895553:0:17183:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790740456.895565:0:17183:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff98dcb5f18000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:1.0:1790740456.895736:0:17183:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98db84524700 x1877727022063360/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790740456.895828:0:17183:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1790740456.895957:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877727022063360:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790740456.896063:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740456.896149:0:17170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022063360 00000100:00100000:0.0:1790740456.896156:0:17170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022063360 00000100:00100000:0.0:1790740456.896187:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790740456.896194:0:17170:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1877727022063360:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1790740456.896210:0:17170:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000020:01000000:1.0:1790740456.897014:0:17183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790740456.897020:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740456.897022:0:17183:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1790740456.897025:0:17183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1790740456.897028:0:17183:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1790740456.897049:0:17183:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790740456.897052:0:17183:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790740456.897053:0:17183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1790740456.897057:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740456.897059:0:17183:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1790740456.897062:0:17183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790740456.897068:0:17183:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1790740456.897072:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740456.897074:0:17183:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1790740456.897077:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790740456.897081:0:17183:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.103@tcp to nid 0x20000c0a8cc67 (192.168.204.103@tcp) 00000020:01000000:1.0:1790740456.897105:0:17183:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1790740456.897109:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790740456.897124:0:17183:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff98dcbd5a3380) 00000020:00000080:1.0:1790740456.897139:0:17183:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1790740456.897144:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1790740456.897218:0:17183:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1790740456.897224:0:17183:0:(osd_handler.c:8931:osd_obd_connect()) connect #6 00000020:00000080:1.0:1790740456.897230:0:17183:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb25dda4f4e92eca6 00010000:00080000:1.0:1790740456.897258:0:17183:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98dc856aa800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.103@tcp at head 00010000:00010000:1.0:1790740456.897502:0:17183:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1790740456.900753:0:17183:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1790740456.900998:0:17183:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1790740456.907226:0:17183:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790740456.907521:0:17183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1790740456.915248:0:17183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1790740456.919235:0:17189:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1790740456.919243:0:17189:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1790740456.920262:0:17183:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790740456.920275:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1790740456.920448:0:17183:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1790740456.920469:0:17183:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb25dda4f4e92ecad 00000100:00080000:2.0:1790740456.920487:0:17183:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790740456.920499:0:17183:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98dc856aa800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:2.0:1790740456.920535:0:17183:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98db84652300 x1877727022063488/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790740456.920599:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84652300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877727022063488:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1790740456.920673:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877727022063488 offset 0 length 520: 4 00000100:00080000:2.0:1790740456.920733:0:17183:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1790740456.920809:0:17183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790740456.920814:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740456.920816:0:17183:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1790740456.920819:0:17183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1790740456.920821:0:17183:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1790740456.920822:0:17183:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790740456.920824:0:17183:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790740456.920825:0:17183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1790740456.920828:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740456.920829:0:17183:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1790740456.920832:0:17183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790740456.920836:0:17183:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1790740456.920839:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740456.920840:0:17183:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1790740456.920844:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790740456.920847:0:17183:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.103@tcp to nid 0x20000c0a8cc67 (192.168.204.103@tcp) 00000020:01000000:2.0:1790740456.920883:0:17183:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1790740456.920887:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790740456.920899:0:17183:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff98dcbc23cd40) 00000020:00000080:2.0:1790740456.920911:0:17183:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1790740456.920916:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790740456.920976:0:17183:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1790740456.920982:0:17183:0:(osd_handler.c:8931:osd_obd_connect()) connect #7 00000020:00000080:2.0:1790740456.920987:0:17183:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb25dda4f4e92ecbb 00010000:00080000:2.0:1790740456.921025:0:17183:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98dcaeddd000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.103@tcp at head 00010000:00010000:2.0:1790740456.921253:0:17183:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1790740456.921346:0:17183:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1790740456.921363:0:17183:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1790740456.926257:0:17183:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790740456.929402:0:17183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1790740456.932250:0:17183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:0.0:1790740456.934006:0:17170:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1877727022063360:12345-0@lo:38:llog_process_th.0 Request processed in 37803us (37934us total) trans 0 rc -19/-19 00000100:00100000:0.0:1790740456.934056:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1790740456.934199:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98dcb5f18000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790740456.934205:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790740456.934209:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877727022063360:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1790740456.934961:0:17191:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1790740456.934967:0:17191:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1790740456.935893:0:17183:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790740456.935906:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1790740456.935953:0:17183:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1790740456.935977:0:17183:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb25dda4f4e92ecc2 00000100:00080000:1.0:1790740456.935986:0:17183:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790740456.935996:0:17183:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98dcaeddd000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:1.0:1790740456.936179:0:17183:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98db84524700 x1877727022063616/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790740456.936247:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877727022063616:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1790740456.936381:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877727022063616 offset 0 length 520: 4 00000100:00080000:1.0:1790740456.936435:0:17183:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1790740456.936497:0:17183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790740456.936501:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740456.936508:0:17183:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1790740456.936512:0:17183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790740456.936515:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740456.936516:0:17183:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790740456.936519:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790740456.936520:0:17183:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1790740456.936522:0:17183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790740456.936524:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740456.936525:0:17183:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:1.0:1790740456.936527:0:17183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790740456.936529:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740456.936531:0:17183:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790740456.936534:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1790740456.936563:0:17183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84527b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17183:1877727022063744:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790740456.936620:0:17183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740456.936641:0:17183:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc861c0300 going to sleep for 11 seconds 00000100:00100000:0.0:1790740456.936824:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022063744 00000100:00100000:0.0:1790740456.936832:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022063744 00000100:00100000:0.0:1790740456.936917:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790740456.936927:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+9:17183:x1877727022063744:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790740456.937083:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+9:17183:x1877727022063744:12345-0@lo:502:llog_process_th.0 Request processed in 158us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740456.937091:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790740456.937268:0:17183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84527b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17183:1877727022063744:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790740456.937311:0:17183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790740456.937317:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740456.937318:0:17183:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790740456.937322:0:17183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1790740456.937486:0:17145:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1790740456.937506:0:17145:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1790740456.937532:0:17145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9e00/0xb25dda4f4e92ec36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ec3d expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740456.937544:0:17145:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9e00/0xb25dda4f4e92ec36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ec3d expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740456.937551:0:17145:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98db84771800 from 1 10000000:01000000:3.0:1790740456.937553:0:17145:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790740456.937581:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9c00/0xb25dda4f4e92ecc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740456.937588:0:17145:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9c00/0xb25dda4f4e92ecc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740456.937598:0:17145:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9c00/0xb25dda4f4e92ecc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740456.937623:0:17145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17145:1877727022063872:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790740456.937654:0:17145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740456.937985:0:17145:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb62b0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790740456.938165:0:17160:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022063872 00000100:00100000:2.0:1790740456.938171:0:17160:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022063872 00000100:00100000:2.0:1790740456.938202:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790740456.938209:0:17160:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc37a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+9:17145:x1877727022063872:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790740456.938219:0:17160:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740456.938233:0:17160:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98db83f33000/0xb25dda4f4e92ecd0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92ecc9 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740456.938254:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98db83f33000/0xb25dda4f4e92ecd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92ecc9 expref: 10 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740456.938265:0:17160:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98db83f33000/0xb25dda4f4e92ecd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92ecc9 expref: 10 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740456.938273:0:17160:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f33000, rc 0) 00000100:00100000:2.0:1790740456.938386:0:17160:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc37a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+10:17145:x1877727022063872:12345-0@lo:101:mount.lustre.0 Request processed in 177us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740456.938394:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790740456.938474:0:17145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17145:1877727022063872:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790740456.938488:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9c00/0xb25dda4f4e92ecc9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ecd0 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740456.938496:0:17145:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9c00/0xb25dda4f4e92ecc9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92ecd0 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740456.939101:0:17145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17145:1877727022064000:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1790740456.939145:0:17145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740456.939169:0:17145:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb62b0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790740456.939304:0:17160:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022064000 00000100:00100000:2.0:1790740456.939310:0:17160:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022064000 00000100:00100000:2.0:1790740456.939333:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790740456.939339:0:17160:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc378850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+10:17145:x1877727022064000:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1790740456.939353:0:17160:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1790740456.939359:0:17160:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1790740456.939433:0:17160:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc378850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+10:17145:x1877727022064000:12345-0@lo:256:mount.lustre.0 Request processed in 94us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740456.939449:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790740456.939579:0:17145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17145:1877727022064000:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1790740456.940157:0:17145:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790740456.940172:0:17145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9c00/0xb25dda4f4e92ecc9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ecd0 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740456.940182:0:17145:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9c00/0xb25dda4f4e92ecc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ecd0 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740456.940190:0:17145:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98db84771800 from 1 10000000:01000000:3.0:1790740456.940192:0:17145:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790740456.940215:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8200/0xb25dda4f4e92ecd7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740456.940222:0:17145:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8200/0xb25dda4f4e92ecd7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740456.940231:0:17145:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8200/0xb25dda4f4e92ecd7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740456.940245:0:17145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17145:1877727022064128:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790740456.940276:0:17145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740456.940314:0:17145:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb62b0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790740456.940494:0:17160:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022064128 00000100:00100000:2.0:1790740456.940500:0:17160:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022064128 00000100:00100000:2.0:1790740456.940524:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790740456.940530:0:17160:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc37b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+10:17145:x1877727022064128:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790740456.940540:0:17160:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740456.940553:0:17160:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98db83f32000/0xb25dda4f4e92ecde lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92ecd7 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740456.940572:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98db83f32000/0xb25dda4f4e92ecde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92ecd7 expref: 11 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740456.940582:0:17160:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98db83f32000/0xb25dda4f4e92ecde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92ecd7 expref: 11 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740456.940591:0:17160:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f32000, rc 0) 00000100:00100000:2.0:1790740456.940641:0:17160:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc37b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+11:17145:x1877727022064128:12345-0@lo:101:mount.lustre.0 Request processed in 110us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740456.940646:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790740456.940763:0:17145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17145:1877727022064128:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790740456.940787:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8200/0xb25dda4f4e92ecd7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ecde expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740456.940795:0:17145:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8200/0xb25dda4f4e92ecd7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92ecde expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740456.940849:0:17145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17145:1877727022064256:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790740456.940891:0:17145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740456.940916:0:17145:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb62b0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790740456.940975:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022064256 00000100:00100000:0.0:1790740456.940979:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022064256 00000100:00100000:0.0:1790740456.941002:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790740456.941008:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+11:17145:x1877727022064256:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790740456.941171:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+11:17145:x1877727022064256:12345-0@lo:501:mount.lustre.0 Request processed in 163us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740456.941178:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790740456.941293:0:17145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17145:1877727022064256:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790740456.941415:0:17145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17145:1877727022064384:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790740456.941454:0:17145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740456.941468:0:17145:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb62b0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790740456.941523:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022064384 00000100:00100000:0.0:1790740456.941527:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022064384 00000100:00100000:0.0:1790740456.941546:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790740456.941553:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+11:17145:x1877727022064384:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790740456.941715:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+11:17145:x1877727022064384:12345-0@lo:503:mount.lustre.0 Request processed in 162us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740456.941723:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790740456.941812:0:17145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17145:1877727022064384:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790740456.942226:0:17193:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17193:1877727022064512:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790740456.942268:0:17193:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740456.942386:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022064512 00000100:00100000:2.0:1790740456.942391:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022064512 00000100:00100000:2.0:1790740456.942429:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790740456.942436:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc37a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+11:17193:x1877727022064512:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790740456.942951:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc37a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+11:17193:x1877727022064512:12345-0@lo:502:llog_process_th.0 Request processed in 515us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740456.942959:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790740456.943083:0:17193:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc990699c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790740456.943101:0:17193:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17193:1877727022064512:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790740456.943129:0:17193:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790740456.943143:0:17193:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740456.943145:0:17193:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1790740456.943154:0:17193:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98db84771800 00000020:00000080:0.0:1790740456.943157:0:17193:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790740456.943165:0:17193:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790740456.943168:0:17193:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740456.943170:0:17193:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1790740456.943172:0:17193:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790740456.943174:0:17193:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740456.943176:0:17193:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1790740456.943180:0:17193:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98db84771800 00000020:00000080:0.0:1790740456.943182:0:17193:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790740456.943247:0:17193:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790740456.943251:0:17193:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740456.943253:0:17193:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1790740456.943256:0:17193:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790740456.943258:0:17193:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740456.943260:0:17193:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790740456.943263:0:17193:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98db84771800 00000020:00000080:0.0:1790740456.943265:0:17193:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790740456.943283:0:17193:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790740456.943286:0:17193:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740456.943287:0:17193:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790740456.943290:0:17193:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790740456.943292:0:17193:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740456.943293:0:17193:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1790740456.951898:0:17193:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98db84771800 00000020:00000080:3.0:1790740456.951906:0:17193:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790740456.952020:0:17193:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17193:1877727022064640:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790740456.952129:0:17193:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740456.952181:0:17160:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022064640 00000100:00100000:3.0:1790740456.952188:0:17160:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022064640 00000100:00100000:3.0:1790740456.956461:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790740456.956481:0:17160:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+11:17193:x1877727022064640:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790740456.956682:0:17160:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+11:17193:x1877727022064640:12345-0@lo:502:llog_process_th.0 Request processed in 207us (4551us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740456.956691:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790740456.956761:0:17193:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb62b0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790740456.956789:0:17193:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17193:1877727022064640:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790740456.956825:0:17193:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790740456.956835:0:17193:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790740456.956837:0:17193:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1790740456.956841:0:17193:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1790740456.956921:0:17145:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1790740456.956940:0:17145:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790740456.956961:0:17145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8200/0xb25dda4f4e92ecd7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ecde expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740456.956973:0:17145:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8200/0xb25dda4f4e92ecd7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ecde expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740456.957020:0:17145:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790740456.957022:0:17145:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98db84771800 10000000:01000000:3.0:1790740456.957025:0:17145:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98db84771800 10000000:01000000:3.0:1790740456.957048:0:17145:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790740456.957054:0:17145:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98db84771800 from 1 10000000:01000000:3.0:1790740456.957057:0:17145:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790740456.957091:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9400/0xb25dda4f4e92ece5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740456.957100:0:17145:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9400/0xb25dda4f4e92ece5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740456.957110:0:17145:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9400/0xb25dda4f4e92ece5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740456.957131:0:17145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17145:1877727022064768:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790740456.957183:0:17145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740456.957204:0:17145:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb62b06c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790740456.958781:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022064768 00000100:00100000:3.0:1790740456.958794:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022064768 00000100:00100000:3.0:1790740456.958850:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790740456.958858:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+11:17145:x1877727022064768:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790740456.958884:0:17159:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740456.958906:0:17159:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcb5dc9200/0xb25dda4f4e92ecec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92ece5 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740456.958933:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcb5dc9200/0xb25dda4f4e92ecec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92ece5 expref: 12 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740456.958944:0:17159:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcb5dc9200/0xb25dda4f4e92ecec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92ece5 expref: 12 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740456.958953:0:17159:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc9200, rc 0) 00000100:00100000:3.0:1790740456.959018:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+12:17145:x1877727022064768:12345-0@lo:101:mount.lustre.0 Request processed in 160us (1834us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740456.959024:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790740456.959094:0:17145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17145:1877727022064768:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790740456.959111:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9400/0xb25dda4f4e92ece5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ecec expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740456.959120:0:17145:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9400/0xb25dda4f4e92ece5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92ecec expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740456.959187:0:17145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17145:1877727022064896:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790740456.959236:0:17145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740456.959254:0:17145:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb62b06c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790740456.959268:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022064896 00000100:00100000:3.0:1790740456.959272:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022064896 00000100:00100000:3.0:1790740456.959292:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790740456.959313:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb6d1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+12:17145:x1877727022064896:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790740456.959431:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb6d1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+12:17145:x1877727022064896:12345-0@lo:501:mount.lustre.0 Request processed in 118us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740456.959438:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790740456.959470:0:17145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17145:1877727022064896:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790740456.959499:0:17145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17145:1877727022065024:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790740456.959535:0:17145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740456.959548:0:17145:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb62b06c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790740456.959559:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022065024 00000100:00100000:3.0:1790740456.959562:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022065024 00000100:00100000:3.0:1790740456.959582:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790740456.959587:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb6d1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+12:17145:x1877727022065024:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790740456.959798:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb6d1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+12:17145:x1877727022065024:12345-0@lo:503:mount.lustre.0 Request processed in 210us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740456.959805:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790740456.959848:0:17145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17145:1877727022065024:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790740456.967654:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17196:1877727022065152:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790740456.967743:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740456.967782:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022065152 00000100:00100000:3.0:1790740456.967789:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022065152 00000100:00100000:3.0:1790740456.967839:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790740456.967847:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb6d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+12:17196:x1877727022065152:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790740456.967976:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb6d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+12:17196:x1877727022065152:12345-0@lo:502:llog_process_th.0 Request processed in 128us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740456.967983:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790740456.968056:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb62b0300 going to sleep for 11 seconds 00000100:00100000:3.0:1790740456.968078:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17196:1877727022065152:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1790740456.968137:0:17196:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1790740456.968152:0:17196:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff98dc89744d40) 00000020:00000080:3.0:1790740456.968174:0:17196:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1790740456.968247:0:17196:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98db84771800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1790740456.968251:0:17196:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98db84771800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1790740456.968253:0:17196:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98db84771800 4 00010000:00080000:3.0:1790740456.968289:0:17196:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98db83e39800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.103@tcp at head 00010000:00010000:3.0:1790740456.969944:0:17196:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1790740456.970175:0:17196:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1790740456.970210:0:17196:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790740456.975565:0:17196:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xb25dda4f4e92ecfa 00000100:00080000:3.0:1790740456.975590:0:17196:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790740456.975678:0:17196:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff98db83e39800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:3.0:1790740456.975728:0:17196:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98dcbfe2f100 x1877727022065280/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790740456.975760:0:17196:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1790740456.976746:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877727022065280:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790740456.976851:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740456.977713:0:17165:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022065280 00000100:00100000:3.0:1790740456.977727:0:17165:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022065280 00000100:00100000:3.0:1790740456.977771:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790740456.977779:0:17165:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1877727022065280:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790740456.977884:0:17165:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1877727022065280:12345-0@lo:38:llog_process_th.0 Request processed in 104us (1033us total) trans 0 rc -11/-11 00000100:00100000:3.0:1790740456.977893:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790740456.978203:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790740456.978211:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98db83e39800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790740456.978216:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1790740456.978219:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877727022065280:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790740456.981283:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17196:1877727022065408:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790740456.982058:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740456.982106:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb62b0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790740456.982226:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022065408 00000100:00100000:2.0:1790740456.982240:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022065408 00000100:00100000:2.0:1790740456.982399:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790740456.982422:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb6d1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+12:17196:x1877727022065408:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790740456.982551:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb6d1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+12:17196:x1877727022065408:12345-0@lo:502:llog_process_th.0 Request processed in 143us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740456.982559:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790740456.983563:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17196:1877727022065408:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790740456.987728:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84650e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17196:1877727022065536:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790740456.987826:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740456.987881:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc86a18b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790740456.987911:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022065536 00000100:00100000:2.0:1790740456.987918:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022065536 00000100:00100000:2.0:1790740456.987964:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790740456.987973:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb6d1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+12:17196:x1877727022065536:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790740456.988630:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb6d1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+12:17196:x1877727022065536:12345-0@lo:502:llog_process_th.0 Request processed in 656us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740456.988640:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790740456.988702:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84650e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17196:1877727022065536:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1790740456.988736:0:17196:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1790740456.989449:0:17145:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1790740456.989473:0:17145:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790740456.989488:0:17145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9400/0xb25dda4f4e92ece5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ecec expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740456.989500:0:17145:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9400/0xb25dda4f4e92ece5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ecec expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790740456.989555:0:17145:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790740456.989558:0:17145:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790740456.989559:0:17145:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790740456.989560:0:17145:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790740456.989562:0:17145:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790740456.989563:0:17145:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790740456.989565:0:17145:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790740456.989566:0:17145:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790740456.989568:0:17145:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790740456.989569:0:17145:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790740456.989573:0:17145:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1790740456.989576:0:17145:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790740456.989577:0:17145:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790740456.989579:0:17145:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790740456.989580:0:17145:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790740456.989581:0:17145:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790740456.989582:0:17145:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790740456.989583:0:17145:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790740456.989584:0:17145:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790740456.989585:0:17145:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790740456.989586:0:17145:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790740456.989607:0:17145:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1790740456.989624:0:17145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84650e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17145:1877727022065664:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790740456.989675:0:17145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740456.989703:0:17145:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc86a18b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790740456.989728:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022065664 00000100:00100000:2.0:1790740456.989735:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022065664 00000100:00100000:2.0:1790740456.989772:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790740456.989780:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb6d1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+12:17145:x1877727022065664:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1790740456.989807:0:17159:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1790740456.989822:0:17159:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1790740456.992860:0:17159:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790740456.992893:0:17159:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1790740456.993271:0:17181:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790740456.993278:0:17181:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790740456.993315:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98dcb5dc8800/0xb25dda4f4e92ed01 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740456.993335:0:17181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98db83f33000/0xb25dda4f4e92ecd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92ecc9 expref: 12 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740456.993343:0:17181:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98dcb5dc8800/0xb25dda4f4e92ed01 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740456.993387:0:17181:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98db83f33000/0xb25dda4f4e92ecd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92ecc9 expref: 12 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740456.993402:0:17181:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98db83f33000/0xb25dda4f4e92ecd0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92ecc9 expref: 12 pid: 17160 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740456.995351:0:17181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17181:1877727022065792:0@lo:104: 00000100:00100000:3.0:1790740456.995551:0:17181:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740456.995620:0:17181:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb62b0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790740456.995705:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022065792 00000100:00100000:0.0:1790740456.995716:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022065792 00000100:00100000:0.0:1790740456.995775:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790740456.995785:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+3:17181:x1877727022065792:12345-0@lo:104: 00010000:00010000:0.0:1790740456.995805:0:17149:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9c00/0xb25dda4f4e92ecc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92ecd0 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740456.995847:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb6d1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+12:17145:x1877727022065664:12345-0@lo:253:mount.lustre.0 Request processed in 6067us (6171us total) trans 0 rc 0/0 00010000:00010000:0.0:1790740456.995852:0:17149:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790740456.995856:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+3:17181:x1877727022065792:12345-0@lo:104: Request processed in 74us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740456.995857:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790740456.995861:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790740456.995917:0:17181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17181:1877727022065792:0@lo:104: 00010000:00010000:0.0:1790740456.995938:0:17181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98dcb5dc8800/0xb25dda4f4e92ed01 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740456.995947:0:17145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84650e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17145:1877727022065664:0@lo:253:mount.lustre.0 00010000:00010000:0.0:1790740456.995954:0:17155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:2.0:1790740456.995957:0:17145:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00010000:00010000:0.0:1790740456.995959:0:17155:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9c00/0xb25dda4f4e92ecc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92ecd0 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790740456.995960:0:17145:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790740456.995963:0:17145:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790740456.995964:0:17145:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790740456.995965:0:17145:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790740456.995967:0:17145:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00010000:00010000:0.0:1790740456.995967:0:17155:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc9c00 already unused, calling callback (ffffffffc1355c20) 00000020:01000004:2.0:1790740456.995968:0:17145:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790740456.995969:0:17145:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790740456.995971:0:17145:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790740456.995972:0:17145:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 10000000:00010000:0.0:1790740456.995972:0:17155:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9c00/0xb25dda4f4e92ecc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92ecd0 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790740456.995973:0:17145:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790740456.995984:0:17145:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1790740456.995991:0:17155:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9c00/0xb25dda4f4e92ecc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92ecd0 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790740456.995997:0:17155:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9c00/0xb25dda4f4e92ecc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92ecd0 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740456.996003:0:17155:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790740456.996062:0:17155:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9c00/0xb25dda4f4e92ecc9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92ecd0 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740456.996069:0:17155:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790740456.996096:0:17155:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9c00/0xb25dda4f4e92ecc9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92ecd0 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740456.996103:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9c00/0xb25dda4f4e92ecc9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92ecd0 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740456.996122:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740456.996124:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740456.996126:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740456.996168:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3640:1877727022065920:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790740456.996199:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740456.996364:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022065920 00000100:00100000:3.0:1790740456.996369:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022065920 00010000:00010000:3.0:1790740456.996388:0:17151:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98db83f33000/0xb25dda4f4e92ecd0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92ecc9 expref: 12 pid: 17160 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740456.996477:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790740456.996485:0:17151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+12:3640:x1877727022065920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790740456.996496:0:17151:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740456.996500:0:17151:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98db83f33000/0xb25dda4f4e92ecd0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92ecc9 expref: 12 pid: 17160 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740456.996511:0:17151:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98db83f33000/0xb25dda4f4e92ecd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92ecc9 expref: 12 pid: 17160 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740456.996523:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98db83f33000/0xb25dda4f4e92ecd0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92ecc9 expref: 12 pid: 17160 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740456.996537:0:17151:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98dcb5dc8800/0xb25dda4f4e92ed01 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740456.996546:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcb5dc8800/0xb25dda4f4e92ed01 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790740456.996559:0:17151:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003282779s 00010000:00010000:3.0:1790740456.996565:0:17151:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98dcb5dc8800/0xb25dda4f4e92ed01 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740456.996572:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98dcb5dc8800/0xb25dda4f4e92ed01 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740456.996580:0:17151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98dcb5dc8800/0xb25dda4f4e92ed01 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740456.996595:0:17151:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98dcb5dc8800/0xb25dda4f4e92ed01 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740456.996601:0:17151:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc8800 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:3.0:1790740456.996605:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98dcb5dc8800/0xb25dda4f4e92ed01 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740456.996614:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98dcb5dc8800/0xb25dda4f4e92ed01 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740456.996626:0:17151:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98dcb5dc8800/0xb25dda4f4e92ed01 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740456.996635:0:17151:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740456.996667:0:17151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+11:3640:x1877727022065920:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740456.996673:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1790740456.996900:0:17181:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98dcb5dc8800/0xb25dda4f4e92ed01 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740456.996909:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98dcb5dc8800/0xb25dda4f4e92ed01 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740456.996915:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcb5dc8800/0xb25dda4f4e92ed01 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740456.996951:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3640:1877727022065920:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1790740457.036730:0:17145:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1790740457.037058:0:17145:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1790740457.037071:0:17205:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1790740457.037074:0:17205:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1790740457.037448:0:17206:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1790740457.037492:0:17145:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:0.0:1790740457.037840:0:17207:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff98db83dc6d80 x1877727022066048/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740457.037853:0:17207:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc884d7d80 going to sleep for 0 seconds 00000040:00080000:3.0:1790740457.037916:0:17206:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1790740457.038290:0:17145:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1790740457.038322:0:17145:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1790740457.039054:0:17145:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1790740457.039063:0:17145:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1790740457.039106:0:17145:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790740457.040436:0:17145:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1790740457.042204:0:17206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1790740457.042274:0:17206:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:2.0:1790740457.046696:0:17145:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1790740457.047258:0:17145:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1790740457.053494:0:17145:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:0.0:1790740457.054966:0:17145:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:0.0:1790740457.061906:0:17145:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1790740457.065283:0:17145:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1790740457.066259:0:17145:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb5b1016cb988 00100000:10000000:3.0:1790740457.066270:0:17145:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1790740457.067862:0:17145:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790740457.067891:0:17145:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.103@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790740457.067916:0:17145:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1790740457.067944:0:17145:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1790740457.068877:0:17145:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790740457.069131:0:17145:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1790740457.642373:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790740458.028922:0:17201:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790740458.028932:0:17201:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790740458.033534:0:17201:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:0.0:1790740458.033548:0:17201:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:2.0:1790740458.034001:0:17163:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790740458.034005:0:17163:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98db84771800 from 7 10000000:01000000:2.0:1790740458.034008:0:17163:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790740458.034542:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98db83f32e00/0xb25dda4f4e92ed08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740458.034567:0:17163:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98db83f32e00/0xb25dda4f4e92ed08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740458.034580:0:17163:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98db83f32e00/0xb25dda4f4e92ed08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740458.034681:0:17163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84650e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022066176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790740458.034758:0:17163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740458.034862:0:17163:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc887383c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790740458.034916:0:17160:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022066176 00000100:00100000:3.0:1790740458.034924:0:17160:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022066176 00000100:00100000:3.0:1790740458.035015:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790740458.035025:0:17160:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb6d1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+11:17163:x1877727022066176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790740458.035069:0:17160:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740458.035082:0:17160:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcb5dc8000/0xb25dda4f4e92ed0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92ed08 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740458.035105:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcb5dc8000/0xb25dda4f4e92ed0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92ed08 expref: 12 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740458.035115:0:17160:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcb5dc8000/0xb25dda4f4e92ed0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92ed08 expref: 12 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740458.035123:0:17160:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc8000, rc 0) 00000100:00100000:3.0:1790740458.035170:0:17160:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb6d1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+12:17163:x1877727022066176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740458.035177:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790740458.035265:0:17163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84650e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022066176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790740458.035291:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98db83f32e00/0xb25dda4f4e92ed08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ed0f expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740458.035301:0:17163:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98db83f32e00/0xb25dda4f4e92ed08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92ed0f expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740458.035493:0:17163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022066304:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1790740458.035530:0:17163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740458.035730:0:17163:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5c9c240 going to sleep for 11 seconds 00000100:00100000:2.0:1790740458.035781:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022066304 00000100:00100000:2.0:1790740458.035786:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022066304 00000100:00100000:2.0:1790740458.035810:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790740458.035816:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb6d1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+12:17163:x1877727022066304:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1790740458.035830:0:17161:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790740458.035858:0:17161:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790740458.035861:0:17161:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1790740458.035954:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb6d1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+12:17163:x1877727022066304:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 137us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740458.035962:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790740458.036050:0:17163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022066304:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1790740458.036093:0:17163:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790740458.036099:0:17163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98db83f32e00/0xb25dda4f4e92ed08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ed0f expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740458.036108:0:17163:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98db83f32e00/0xb25dda4f4e92ed08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ed0f expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740458.092623:0:17207:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc884d7d80 going to sleep for 0 seconds 00010000:00010000:0.0:1790740458.668446:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790740459.051286:0:17201:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790740459.051302:0:17201:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790740459.051482:0:17201:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1790740459.051531:0:17201:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790740459.052866:0:17201:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00000100:00100000:2.0:1790740459.116678:0:17207:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc884d7d80 going to sleep for 0 seconds 00010000:00010000:3.0:1790740459.690628:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740460.139553:0:17207:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc884d7d80 going to sleep for 0 seconds 00010000:00010000:1.0:1790740460.714235:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740461.166157:0:17207:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc884d7d80 going to sleep for 0 seconds 00010000:00010000:3.0:1790740461.742561:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790740462.122803:0:17449:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg403-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1790740462.186217:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1790740462.186225:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1790740462.186229:0:36:0:(import.c:65:import_set_state_nolock()) ffff98dcb5f18000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790740462.186237:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 528 00000100:00080000:3.0:1790740462.186243:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00100000:1.0:1790740462.186251:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3641:1877727022066432:0@lo:400:kworker.0 00000100:00080000:3.0:1790740462.186256:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff98dcb5f18000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:3.0:1790740462.186283:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98dcbfe2ea00 x1877727022066560/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790740462.186315:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790740462.186318:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790740462.186321:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790740462.186324:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790740462.186327:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1790740462.186334:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1790740462.186334:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790740462.186339:0:36:0:(import.c:65:import_set_state_nolock()) ffff98db83e39800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790740462.186347:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff98db83e39800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:3.0:1790740462.186374:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98dcbfe2fb80 x1877727022066688/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790740462.186444:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022066432 00000100:00100000:1.0:1790740462.186451:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022066432 00000100:00100000:1.0:1790740462.186490:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790740462.186499:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb6d1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+12:3641:x1877727022066432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740462.186550:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb6d1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+12:3641:x1877727022066432:12345-0@lo:400:kworker.0 Request processed in 52us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740462.186568:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790740462.186628:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3641:1877727022066432:0@lo:400:kworker.0 00000100:00100000:1.0:1790740462.186832:0:17207:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc884d7d80 going to sleep for 0 seconds 00000100:00100000:3.0:1790740462.187329:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877727022066560:0@lo:38:kworker.0 00000100:00100000:3.0:1790740462.187969:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740462.190420:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877727022066688:0@lo:38:kworker.0 00000100:00100000:3.0:1790740462.190487:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740462.191208:0:17167:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022066688 00000100:00100000:1.0:1790740462.191217:0:17167:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022066688 00000100:00100000:1.0:1790740462.191256:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790740462.191264:0:17167:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1877727022066688:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1790740462.191292:0:17167:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:1.0:1790740462.191331:0:17167:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xb25dda4f4e92ed16 00000004:00100000:1.0:1790740462.191350:0:17167:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790740462.191496:0:17167:0:(import.c:65:import_set_state_nolock()) ffff98dcaeddf000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790740462.191562:0:17167:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1877727022066688:12345-0@lo:38:kworker.0 Request processed in 297us (1074us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740462.191569:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790740462.192404:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98dcbfe2fb80 x1877727022066688/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790740472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790740462.192424:0:3637:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1790740462.192433:0:3637:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1790740462.192438:0:3637:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1790740462.192441:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98db83e39800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790740462.192447:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877727022066688:0@lo:38:kworker.0 00000100:00100000:2.0:1790740462.193654:0:17171:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022066560 00000100:00100000:2.0:1790740462.193668:0:17171:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022066560 00000100:00100000:2.0:1790740462.194330:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790740462.194339:0:17171:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1877727022066560:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1790740462.194507:0:17171:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790740462.233276:0:17171:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1877727022066560:12345-0@lo:38:kworker.0 Request processed in 38929us (45301us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790740462.233291:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1790740462.238048:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98dcb5f18000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790740462.238065:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790740462.238072:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877727022066560:0@lo:38:kworker.0 00010000:00010000:1.0:1790740462.764305:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740463.216234:0:17207:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc884d7d80 going to sleep for 0 seconds 00000020:00000004:1.0:1790740463.299957:0:17502:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790740463.300204:0:17502:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790740463.787706:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740464.234268:0:17207:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc884d7d80 going to sleep for 0 seconds 00000020:00000004:2.0:1790740464.611686:0:17553:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790740464.611995:0:17553:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1790740464.816633:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740465.259261:0:17207:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc884d7d80 going to sleep for 0 seconds 00010000:00010000:3.0:1790740465.836583:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740466.286536:0:17207:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc884d7d80 going to sleep for 0 seconds 00000100:00100000:2.0:1790740466.287361:0:3637:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790740456/real 1790740456] req@ffff98db84524700 x1877727022063616/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790740466 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740466.287399:0:3637:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98db84524700 x1877727022063616/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790740466 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740466.287413:0:3637:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790740456/real 1790740456] req@ffff98db84652300 x1877727022063488/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790740466 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740466.287428:0:3637:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98db84652300 x1877727022063488/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790740466 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790740466.287452:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98dcaeddd000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790740466.287477:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790740466.287481:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877727022063616:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1790740466.287488:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98dc856aa800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790740466.287494:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790740466.287524:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84652300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877727022063488:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1790740466.287908:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1790740466.287914:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1790740466.287917:0:37:0:(import.c:65:import_set_state_nolock()) ffff98dcb5f18000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790740466.287923:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 533 00000100:00080000:1.0:1790740466.287930:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1790740466.287944:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff98dcb5f18000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:1.0:1790740466.287969:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98db84524700 x1877727022066944/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790740466.287992:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790740466.287996:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1790740466.287998:0:37:0:(import.c:65:import_set_state_nolock()) ffff98dc856aa800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790740466.288001:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 528 00000100:00080000:1.0:1790740466.288005:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1790740466.288009:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98dc856aa800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:1.0:1790740466.288020:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98db84526d80 x1877727022067072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790740466.288050:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790740466.288054:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1790740466.288056:0:37:0:(import.c:65:import_set_state_nolock()) ffff98dcaeddd000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790740466.288059:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 528 00000100:00080000:1.0:1790740466.288062:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1790740466.288066:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98dcaeddd000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:1.0:1790740466.288076:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98db84525500 x1877727022067200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790740466.288113:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877727022066944:0@lo:38:kworker.0 00000100:00100000:3.0:1790740466.288347:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877727022067328:0@lo:400:kworker.0 00000100:00100000:3.0:1790740466.288437:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740466.288507:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790740466.288513:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3639:1877727022066816:0@lo:400:kworker.0 00000100:00100000:3.0:1790740466.288549:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740466.288599:0:17166:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022067328 00000100:00100000:3.0:1790740466.288609:0:17166:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022067328 00000100:00100000:3.0:1790740466.288668:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790740466.288679:0:17166:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877727022067328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740466.288758:0:17166:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877727022067328:12345-0@lo:400:kworker.0 Request processed in 80us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740466.288766:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790740466.288791:0:17160:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022066816 00000100:00100000:3.0:1790740466.288795:0:17160:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022066816 00000100:00100000:3.0:1790740466.288821:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790740466.288827:0:17160:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb6d1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+12:3639:x1877727022066816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740466.288854:0:17160:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb6d1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+12:3639:x1877727022066816:12345-0@lo:400:kworker.0 Request processed in 27us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740466.288860:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790740466.288908:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3639:1877727022066816:0@lo:400:kworker.0 00010000:00080000:3.0:1790740466.288920:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98db84524000 x1877727022067328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740466.288931:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877727022067328:0@lo:400:kworker.0 00000100:00100000:1.0:1790740466.289360:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740466.289403:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877727022067072:0@lo:8:kworker.0 00000400:00000100:1.0:1790740466.289425:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877727022067072 offset 0 length 520: 4 00000100:00100000:1.0:1790740466.289443:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877727022067200:0@lo:8:kworker.0 00000400:00000100:1.0:1790740466.289467:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877727022067200 offset 0 length 520: 4 00000100:00100000:3.0:1790740466.290357:0:17170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022066944 00000100:00100000:3.0:1790740466.290383:0:17170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022066944 00000100:00100000:3.0:1790740466.290427:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790740466.290435:0:17170:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1877727022066944:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1790740466.290458:0:17170:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790740466.307889:0:17170:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1877727022066944:12345-0@lo:38:kworker.0 Request processed in 17441us (18516us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790740466.307910:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1790740466.308782:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98dcb5f18000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790740466.308807:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790740466.308813:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877727022066944:0@lo:38:kworker.0 00010000:00010000:2.0:1790740466.858802:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740467.306449:0:17207:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc884d7d80 going to sleep for 0 seconds 00010000:00010000:2.0:1790740467.893671:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740468.332373:0:17207:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc884d7d80 going to sleep for 0 seconds 00010000:00010000:2.0:1790740468.906372:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790740469.291193:0:17201:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1790740469.354272:0:17207:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc884d7d80 going to sleep for 0 seconds 00010000:00010000:2.0:1790740469.930486:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740470.379491:0:17207:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc884d7d80 going to sleep for 0 seconds 00010000:00010000:0.0:1790740470.954385:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740471.411209:0:17207:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc884d7d80 going to sleep for 0 seconds 00000100:00080000:0.0:1790740471.411420:0:15342:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1790740471.411427:0:15342:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1790740471.411432:0:15342:0:(import.c:65:import_set_state_nolock()) ffff98dcb5f18000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790740471.411442:0:15342:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 537 00000100:00080000:0.0:1790740471.411450:0:15342:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1790740471.411467:0:15342:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff98dcb5f18000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:0.0:1790740471.411495:0:15342:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98db83dc7100 x1877727022067584/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790740471.411512:0:15342:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790740471.411516:0:15342:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790740471.411519:0:15342:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790740471.411522:0:15342:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790740471.411555:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3640:1877727022067456:0@lo:400:kworker.0 00000100:00100000:0.0:1790740471.411669:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740471.411736:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790740471.411743:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877727022067712:0@lo:400:kworker.0 00000100:00100000:0.0:1790740471.411788:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740471.411833:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022067456 00000100:00100000:0.0:1790740471.411844:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022067456 00000100:00100000:0.0:1790740471.411901:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790740471.411912:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb6d1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+12:3640:x1877727022067456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740471.411970:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb6d1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+12:3640:x1877727022067456:12345-0@lo:400:kworker.0 Request processed in 60us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740471.411978:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790740471.412024:0:17165:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022067712 00000100:00100000:0.0:1790740471.412029:0:17165:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022067712 00000100:00100000:0.0:1790740471.412082:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790740471.412089:0:17165:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877727022067712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740471.412125:0:17165:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877727022067712:12345-0@lo:400:kworker.0 Request processed in 37us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740471.412131:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790740471.412160:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877727022067584:0@lo:38:kworker.0 00000100:00100000:0.0:1790740471.412193:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740471.412228:0:17171:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022067584 00000100:00100000:0.0:1790740471.412232:0:17171:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022067584 00000100:00100000:0.0:1790740471.412255:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790740471.412260:0:17171:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1877727022067584:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1790740471.412280:0:17171:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:2.0:1790740471.416454:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98db83dc6a00 x1877727022067712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740471.416481:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877727022067712:0@lo:400:kworker.0 00000100:00100000:2.0:1790740471.416500:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3640:1877727022067456:0@lo:400:kworker.0 00000100:00100000:0.0:1790740471.437099:0:17171:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1877727022067584:12345-0@lo:38:kworker.0 Request processed in 24822us (24890us total) trans 0 rc -19/-19 00000100:00100000:0.0:1790740471.437120:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1790740471.439696:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98dcb5f18000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790740471.439710:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790740471.439716:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877727022067584:0@lo:38:kworker.0 00010000:00010000:2.0:1790740471.979123:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740472.426676:0:17207:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc884d7d80 going to sleep for 0 seconds 00010000:00010000:0.0:1790740473.002550:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740473.450646:0:17207:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc884d7d80 going to sleep for 0 seconds 00000020:01000004:2.0:1790740473.720844:0:17898:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790740473.720849:0:17898:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1790740473.720850:0:17898:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1790740473.721055:0:17898:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98dcae18b800 00000020:01000004:2.0:1790740473.721085:0:17898:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1790740473.721105:0:17898:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1790740473.721129:0:17898:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff98dcbc2399c0) 00000020:00000080:2.0:1790740473.721155:0:17898:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1790740473.821248:0:17898:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1790740473.823328:0:17898:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1790740473.826899:0:17898:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1790740473.827473:0:17898:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1790740473.827815:0:17898:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1790740473.828115:0:17898:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1790740473.828419:0:17898:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1790740473.828708:0:17898:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:1.0:1790740473.829000:0:17898:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1790740473.829328:0:17898:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1790740473.829609:0:17898:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1790740473.829821:0:17898:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:1.0:1790740473.830066:0:17898:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1790740473.830439:0:17898:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1790740473.831168:0:17898:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1790740473.831399:0:17898:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1790740473.831883:0:17898:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1790740473.832236:0:17898:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1790740473.832602:0:17898:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1790740473.832891:0:17898:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1790740473.833237:0:17898:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1790740473.833608:0:17898:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:1.0:1790740473.834924:0:17898:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1790740473.835269:0:17898:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1790740473.835490:0:17898:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1790740473.835818:0:17898:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:1.0:1790740473.836195:0:17898:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:1.0:1790740473.836559:0:17898:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1790740473.836823:0:17898:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1790740473.837351:0:17898:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1790740473.837679:0:17898:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1790740473.837927:0:17898:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1790740473.838203:0:17898:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1790740473.838446:0:17898:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1790740473.838925:0:17898:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1790740473.839569:0:17898:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:1.0:1790740473.839817:0:17898:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1790740473.840185:0:17898:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:1.0:1790740473.840838:0:17898:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1790740473.841139:0:17898:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:1.0:1790740473.841426:0:17898:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1790740473.841772:0:17898:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1790740473.842297:0:17898:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1790740473.842688:0:17898:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1790740473.843091:0:17898:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1790740473.843362:0:17898:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00080000:01000000:1.0:1790740473.844297:0:17898:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1790740473.844621:0:17898:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1790740473.844632:0:17898:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:1.0:1790740473.844652:0:17898:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb25dda4f4e92ed24 00000020:01000004:1.0:1790740473.844660:0:17898:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1790740473.844682:0:17898:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.103@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1790740473.844686:0:17898:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1790740473.844692:0:17898:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1790740473.844720:0:17898:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1790740473.844724:0:17898:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.103@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1790740473.849024:0:17898:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.103@tcp ctxt 0 is initialized 00000020:01000004:1.0:1790740473.849098:0:17898:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.103@tcp, index=0001, flags=0x20001 00000020:01000004:1.0:1790740473.849103:0:17898:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1790740473.849105:0:17898:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1790740473.849106:0:17898:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790740473.849107:0:17898:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790740473.849109:0:17898:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790740473.849110:0:17898:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790740473.849112:0:17898:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790740473.849113:0:17898:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790740473.849115:0:17898:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790740473.849118:0:17898:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:1.0:1790740473.849120:0:17898:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790740473.849121:0:17898:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1790740473.849123:0:17898:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790740473.849124:0:17898:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790740473.849125:0:17898:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790740473.849126:0:17898:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790740473.849127:0:17898:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790740473.849128:0:17898:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790740473.849129:0:17898:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790740473.849157:0:17898:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1790740473.849177:0:17898:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84524700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17898:1877727022067840:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1790740473.849251:0:17898:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740473.849388:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022067840 00000100:00100000:3.0:1790740473.849397:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022067840 00000100:00100000:1.0:1790740473.849539:0:17898:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc9a7be9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790740473.852884:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790740473.852912:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb6d1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+12:17898:x1877727022067840:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1790740473.853001:0:17161:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1790740473.853005:0:17161:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1790740473.853013:0:17161:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1790740473.853608:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb6d1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+12:17898:x1877727022067840:12345-0@lo:253:mount.lustre.0 Request processed in 709us (4355us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740473.853618:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790740473.853709:0:17898:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84524700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17898:1877727022067840:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790740473.853727:0:17898:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1790740473.853737:0:17898:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790740473.853739:0:17898:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1790740473.853741:0:17898:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790740473.853742:0:17898:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790740473.853743:0:17898:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790740473.853744:0:17898:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790740473.853745:0:17898:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790740473.853747:0:17898:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790740473.853748:0:17898:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1790740473.853768:0:17898:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98dcae18b800 from lustre-MDT0001 10000000:01000000:1.0:1790740473.853798:0:17898:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1790740473.853802:0:17898:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1790740473.853809:0:17898:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98dcbc23b380 local copy 00010000:00010000:1.0:1790740473.853820:0:17898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98db83f32800/0xb25dda4f4e92ec1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ec21 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740473.853920:0:17898:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84524700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17898:1877727022067968:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790740473.853957:0:17898:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740473.855240:0:17898:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc81377480 going to sleep for 11 seconds 00000100:00100000:0.0:1790740473.855289:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022067968 00000100:00100000:0.0:1790740473.855298:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022067968 00000100:00100000:3.0:1790740473.855376:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790740473.855388:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb6d1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+12:17898:x1877727022067968:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790740473.855524:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb6d1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+12:17898:x1877727022067968:12345-0@lo:501:mount.lustre.0 Request processed in 131us (1558us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790740473.855532:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790740473.855759:0:17898:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84524700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17898:1877727022067968:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1790740473.855780:0:17898:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1790740473.855805:0:17898:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1790740473.855813:0:17898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98db83f32800/0xb25dda4f4e92ec1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ec21 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740473.855823:0:17898:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98db83f32800/0xb25dda4f4e92ec1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ec21 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740473.855852:0:17898:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98dcae18b800 10000000:01000000:1.0:1790740473.855858:0:17898:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790740473.855863:0:17898:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff98dcbc23b380 10000000:01000000:1.0:1790740473.855877:0:17898:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1790740473.855881:0:17898:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff98dcbc23b380 from 1 10000000:01000000:1.0:1790740473.855884:0:17898:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1790740473.855914:0:17898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcbfc45a00/0xb25dda4f4e92ed2b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740473.855921:0:17898:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dcbfc45a00/0xb25dda4f4e92ed2b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740473.855944:0:17898:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dcbfc45a00/0xb25dda4f4e92ed2b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740473.855965:0:17898:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84524700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17898:1877727022068096:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790740473.856007:0:17898:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740473.856062:0:17898:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc81377480 going to sleep for 11 seconds 00000100:00100000:2.0:1790740473.856232:0:17160:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022068096 00000100:00100000:2.0:1790740473.856244:0:17160:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022068096 00000100:00100000:2.0:1790740473.856268:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790740473.856274:0:17160:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb6d1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+12:17898:x1877727022068096:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790740473.856283:0:17160:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740473.856297:0:17160:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98db83f32a00/0xb25dda4f4e92ed32 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92ed2b expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740473.856320:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98db83f32a00/0xb25dda4f4e92ed32 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92ed2b expref: 13 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740473.856332:0:17160:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98db83f32a00/0xb25dda4f4e92ed32 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92ed2b expref: 13 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740473.856340:0:17160:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f32a00, rc 0) 00000100:00100000:2.0:1790740473.856384:0:17160:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb6d1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+13:17898:x1877727022068096:12345-0@lo:101:mount.lustre.0 Request processed in 109us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740473.856391:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790740473.856476:0:17898:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84524700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17898:1877727022068096:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790740473.856490:0:17898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dcbfc45a00/0xb25dda4f4e92ed2b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ed32 expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740473.856498:0:17898:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dcbfc45a00/0xb25dda4f4e92ed2b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92ed32 expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740473.856512:0:17898:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1790740473.856537:0:17898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcbfc45a00/0xb25dda4f4e92ed2b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ed32 expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740473.856545:0:17898:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dcbfc45a00/0xb25dda4f4e92ed2b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ed32 expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740473.856561:0:17898:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff98dcae18b800 10000000:01000000:1.0:1790740473.856573:0:17898:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1790740473.856577:0:17898:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff98dcae18b800 from 1 10000000:01000000:1.0:1790740473.856579:0:17898:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1790740473.856596:0:17898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcbfc45000/0xb25dda4f4e92ed39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740473.856604:0:17898:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dcbfc45000/0xb25dda4f4e92ed39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740473.856611:0:17898:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dcbfc45000/0xb25dda4f4e92ed39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740473.856624:0:17898:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84524700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17898:1877727022068224:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790740473.856650:0:17898:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740473.856675:0:17160:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022068224 00000100:00100000:1.0:1790740473.856680:0:17160:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022068224 00000100:00100000:1.0:1790740473.856699:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790740473.856705:0:17160:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83b40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+13:17898:x1877727022068224:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790740473.856711:0:17160:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740473.856721:0:17160:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcbfc44400/0xb25dda4f4e92ed40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92ed39 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740473.856736:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcbfc44400/0xb25dda4f4e92ed40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92ed39 expref: 14 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740473.856744:0:17160:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcbfc44400/0xb25dda4f4e92ed40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92ed39 expref: 14 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740473.856751:0:17160:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcbfc44400, rc 0) 00000100:00100000:1.0:1790740473.856776:0:17160:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83b40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+14:17898:x1877727022068224:12345-0@lo:101:mount.lustre.0 Request processed in 71us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740473.856787:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790740473.856819:0:17898:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc81377480 going to sleep for 11 seconds 00000100:00100000:1.0:1790740473.856831:0:17898:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84524700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17898:1877727022068224:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790740473.856841:0:17898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dcbfc45000/0xb25dda4f4e92ed39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ed40 expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740473.856849:0:17898:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dcbfc45000/0xb25dda4f4e92ed39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92ed40 expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740473.856859:0:17898:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1790740473.856863:0:17898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcbfc45000/0xb25dda4f4e92ed39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ed40 expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740473.856869:0:17898:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dcbfc45000/0xb25dda4f4e92ed39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ed40 expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740473.856875:0:17898:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1790740473.856879:0:17898:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790740473.856883:0:17898:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff98dcae18b800 10000000:01000000:1.0:1790740473.856885:0:17898:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1790740473.856888:0:17898:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1790740473.856890:0:17898:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1790740473.856902:0:17898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcbfc44200/0xb25dda4f4e92ed47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740473.856908:0:17898:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dcbfc44200/0xb25dda4f4e92ed47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740473.856914:0:17898:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dcbfc44200/0xb25dda4f4e92ed47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740473.857281:0:17898:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84524700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17898:1877727022068352:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790740473.857312:0:17898:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740473.857331:0:17898:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc81377480 going to sleep for 11 seconds 00000100:00100000:2.0:1790740473.857379:0:17160:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022068352 00000100:00100000:2.0:1790740473.857385:0:17160:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022068352 00000100:00100000:2.0:1790740473.857407:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790740473.857414:0:17160:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83b43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+14:17898:x1877727022068352:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790740473.857423:0:17160:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740473.857433:0:17160:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98db83f32400/0xb25dda4f4e92ed4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92ed47 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740473.857448:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98db83f32400/0xb25dda4f4e92ed4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92ed47 expref: 15 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740473.857470:0:17160:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98db83f32400/0xb25dda4f4e92ed4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92ed47 expref: 15 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740473.857485:0:17160:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f32400, rc 0) 00000100:00100000:2.0:1790740473.857534:0:17160:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83b43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+15:17898:x1877727022068352:12345-0@lo:101:mount.lustre.0 Request processed in 120us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740473.857540:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790740473.857735:0:17898:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84524700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17898:1877727022068352:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790740473.857748:0:17898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dcbfc44200/0xb25dda4f4e92ed47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ed4e expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740473.857757:0:17898:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dcbfc44200/0xb25dda4f4e92ed47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92ed4e expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790740473.859653:0:17898:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:1.0:1790740473.860680:0:17898:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790740473.870411:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1790740473.870537:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1790740473.870571:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1790740473.870587:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1790740473.870602:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:1.0:1790740473.870617:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:1.0:1790740473.870631:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:1.0:1790740473.870645:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1790740473.870660:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1790740473.870674:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:1.0:1790740473.870689:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:1.0:1790740473.870702:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:1.0:1790740473.870716:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:1.0:1790740473.870730:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1790740473.870744:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1790740473.870756:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:1.0:1790740473.870770:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1790740473.870796:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1790740473.870810:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:1.0:1790740473.870823:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1790740473.870838:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1790740473.870851:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1790740473.870863:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1790740473.870891:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:1.0:1790740473.870897:0:17898:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:1.0:1790740473.873026:0:17898:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84524700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17898:1877727022068480:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790740473.873123:0:17898:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740473.873171:0:17898:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc86af1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790740473.873451:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022068480 00000100:00100000:0.0:1790740473.873469:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022068480 00000100:00100000:0.0:1790740473.873539:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790740473.873562:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83b42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+15:17898:x1877727022068480:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790740473.873740:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83b42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+15:17898:x1877727022068480:12345-0@lo:501:mount.lustre.0 Request processed in 180us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740473.873750:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790740473.873862:0:17898:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84524700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17898:1877727022068480:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790740473.873903:0:17898:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17898:1877727022068608:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790740473.873953:0:17898:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740473.873991:0:17898:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc88738b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790740473.874240:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022068608 00000100:00100000:0.0:1790740473.874245:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022068608 00000100:00100000:0.0:1790740473.874282:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790740473.874290:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83b43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+15:17898:x1877727022068608:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790740473.877085:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83b43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+15:17898:x1877727022068608:12345-0@lo:503:mount.lustre.0 Request processed in 2783us (3119us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740473.877100:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790740473.877272:0:17898:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17898:1877727022068608:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1790740473.877800:0:17898:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790740473.877892:0:17898:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84525f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17898:1877727022068736:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790740473.877948:0:17898:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740473.877994:0:17898:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc86af1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790740473.878290:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022068736 00000100:00100000:0.0:1790740473.878299:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022068736 00000100:00100000:0.0:1790740473.878344:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790740473.878353:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83b40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+15:17898:x1877727022068736:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790740473.880965:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83b40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+15:17898:x1877727022068736:12345-0@lo:502:mount.lustre.0 Request processed in 2604us (3006us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740473.880991:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790740473.881322:0:17898:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84525f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17898:1877727022068736:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790740473.882299:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1790740473.882343:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:1.0:1790740473.882359:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:1.0:1790740473.882371:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:1.0:1790740473.882385:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:1.0:1790740473.882790:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:1.0:1790740473.882812:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:1.0:1790740473.882826:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:1.0:1790740473.882844:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:1.0:1790740473.882860:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:1.0:1790740473.882875:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:1.0:1790740473.882891:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:1.0:1790740473.882920:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:1.0:1790740473.885917:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:1.0:1790740473.885983:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:1.0:1790740473.886001:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:1.0:1790740473.886016:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:1.0:1790740473.886052:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:1.0:1790740473.886071:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:1.0:1790740473.886166:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:1.0:1790740473.886185:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:1.0:1790740473.886200:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:1.0:1790740473.886217:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:1.0:1790740473.886229:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:1.0:1790740473.886243:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:1.0:1790740473.886257:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:1.0:1790740473.886268:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:1.0:1790740473.886281:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:1.0:1790740473.886294:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:1.0:1790740473.886315:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:1.0:1790740473.886333:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:1.0:1790740473.886345:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:1.0:1790740473.886357:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:1.0:1790740473.886370:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:1.0:1790740473.886382:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:1.0:1790740473.886397:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:1.0:1790740473.886412:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:1.0:1790740473.886427:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:1.0:1790740473.886441:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:1.0:1790740473.888795:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:1.0:1790740473.888932:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:1.0:1790740473.888949:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:1.0:1790740473.888962:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:1.0:1790740473.888977:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:1.0:1790740473.889111:0:17898:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84525f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17898:1877727022068864:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790740473.889216:0:17898:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740473.890693:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022068864 00000100:00100000:3.0:1790740473.890706:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022068864 00000100:00100000:3.0:1790740473.890770:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790740473.890780:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83b42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+15:17898:x1877727022068864:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790740473.890929:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83b42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+15:17898:x1877727022068864:12345-0@lo:502:mount.lustre.0 Request processed in 150us (1712us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740473.890938:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790740473.891314:0:17898:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc86af1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790740473.891340:0:17898:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84525f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17898:1877727022068864:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790740473.891424:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:0.0:1790740473.891445:0:17898:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1790740473.895801:0:17902:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790740473.895816:0:17902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740473.895818:0:17902:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1790740473.895825:0:17902:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1790740473.895828:0:17902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790740473.895844:0:17902:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff98dcb6c6b380) 00000020:00000080:0.0:1790740473.895868:0:17902:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1790740473.895875:0:17902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1790740473.895971:0:17902:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:0.0:1790740473.895980:0:17902:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb25dda4f4e92ed5c 00000020:00000080:0.0:1790740473.896317:0:17902:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1790740473.896322:0:17902:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790740473.896326:0:17902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740473.896328:0:17902:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1790740473.896331:0:17902:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790740473.896334:0:17902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740473.896336:0:17902:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1790740473.896339:0:17902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790740473.896346:0:17902:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff98dcb6c68000) 00000020:00000080:0.0:1790740473.896358:0:17902:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1790740473.896362:0:17902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1790740473.896364:0:17902:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1790740473.896367:0:17902:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1790740473.896373:0:17902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1790740473.896419:0:17902:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98dcae18b800 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1790740473.896432:0:17902:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff98dcb6c699c0) 00000020:00000080:0.0:1790740473.896444:0:17902:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1790740473.896610:0:17902:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1790740473.896616:0:17902:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb25dda4f4e92ed71 00000020:00000080:0.0:1790740473.896790:0:17902:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1790740473.896798:0:17902:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1790740473.896803:0:17902:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xb25dda4f4e92ed78 00080000:01000000:0.0:1790740473.896815:0:17902:0:(osd_handler.c:8931:osd_obd_connect()) connect #2 00000020:00000080:0.0:1790740473.896819:0:17902:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb25dda4f4e92ed7f 00010000:00010000:2.0:1790740474.026291:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740474.036017:0:17902:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1790740474.037276:0:17902:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:3.0:1790740474.039298:0:17902:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1790740474.042791:0:17902:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1790740474.042814:0:17902:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790740474.042916:0:17902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790740474.042919:0:17902:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1790740474.042923:0:17902:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790740474.042931:0:17902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790740474.042932:0:17902:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1790740474.042936:0:17902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790740474.042942:0:17902:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.103@tcp to nid 0x20000c0a8cc67 (192.168.204.103@tcp) 00000020:00000080:3.0:1790740474.042972:0:17902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790740474.042988:0:17902:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff98dc89740000) 00000020:00000080:3.0:1790740474.043011:0:17902:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1790740474.043016:0:17902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790740474.043117:0:17902:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1790740474.043125:0:17902:0:(osd_handler.c:8931:osd_obd_connect()) connect #3 00000020:00000080:3.0:1790740474.043132:0:17902:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb25dda4f4e92ed8d 00010000:00080000:3.0:1790740474.043166:0:17902:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98dcb5cc7800@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.103@tcp at head 00010000:00010000:1.0:1790740474.054643:0:17902:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1790740474.057070:0:17902:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1790740474.057085:0:17902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1790740474.057127:0:17902:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1790740474.057148:0:17902:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb25dda4f4e92ed94 00000100:00080000:1.0:1790740474.057160:0:17902:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790740474.057171:0:17902:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98dcb5cc7800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:1.0:1790740474.057206:0:17902:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98db84525c00 x1877727022068992/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790740474.057228:0:17902:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1790740474.057411:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84525c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877727022068992:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790740474.057483:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740474.057953:0:17170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022068992 00000100:00100000:0.0:1790740474.057961:0:17170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022068992 00000100:00100000:0.0:1790740474.057992:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790740474.057999:0:17170:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1877727022068992:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1790740474.058021:0:17170:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 545 last 0 00000020:00000080:0.0:1790740474.058074:0:17170:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb25dda4f4e92ed9b 00000004:00100000:0.0:1790740474.058089:0:17170:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1790740474.058094:0:17170:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1790740474.058330:0:15342:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1790740474.058335:0:15342:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1790740474.058337:0:15342:0:(import.c:65:import_set_state_nolock()) ffff98dcb5f18000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790740474.058342:0:15342:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 542 00000100:00080000:0.0:1790740474.058346:0:15342:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1790740474.058352:0:15342:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff98dcb5f18000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:0.0:1790740474.058373:0:15342:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98db83dc5c00 x1877727022069120/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790740474.058390:0:15342:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790740474.058394:0:15342:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790740474.058396:0:15342:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790740474.058399:0:15342:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790740474.058433:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727022069248:0@lo:400:kworker.0 00000100:00100000:0.0:1790740474.058475:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740474.058524:0:17167:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022069248 00000100:00100000:0.0:1790740474.058528:0:17167:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022069248 00000100:00100000:0.0:1790740474.058568:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790740474.058575:0:17167:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727022069248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740474.058617:0:17167:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727022069248:12345-0@lo:400:kworker.0 Request processed in 43us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740474.058624:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1790740474.058659:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98db83dc5180 x1877727022069248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740474.058672:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727022069248:0@lo:400:kworker.0 00000100:00100000:0.0:1790740474.058691:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877727022069120:0@lo:38:kworker.0 00000100:00100000:0.0:1790740474.058713:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740474.058735:0:17171:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1790740474.058741:0:17171:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000020:01000000:1.0:1790740474.059064:0:17902:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790740474.059070:0:17902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740474.059072:0:17902:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1790740474.059076:0:17902:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1790740474.059079:0:17902:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1790740474.059080:0:17902:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790740474.059081:0:17902:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790740474.059083:0:17902:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1790740474.059085:0:17902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740474.059086:0:17902:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1790740474.059088:0:17902:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790740474.059092:0:17902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740474.059093:0:17902:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1790740474.059097:0:17902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1790740474.059140:0:17902:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1790740474.059155:0:17902:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790740474.059158:0:17902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740474.059160:0:17902:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1790740474.059162:0:17902:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1790740474.059163:0:17902:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:1.0:1790740474.059170:0:17902:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790740474.059172:0:17902:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790740474.059174:0:17902:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1790740474.059177:0:17902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740474.059178:0:17902:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:1.0:1790740474.059180:0:17902:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790740474.059184:0:17902:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1790740474.059187:0:17902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740474.059189:0:17902:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1790740474.059191:0:17902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790740474.059195:0:17902:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.103@tcp to nid 0x20000c0a8cc67 (192.168.204.103@tcp) 00000020:01000000:1.0:1790740474.059216:0:17902:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1790740474.059219:0:17902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790740474.059234:0:17902:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff98dcbd5a0000) 00000020:00000080:1.0:1790740474.059397:0:17902:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1790740474.059404:0:17902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1790740474.059469:0:17902:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1790740474.059475:0:17902:0:(osd_handler.c:8931:osd_obd_connect()) connect #4 00000020:00000080:1.0:1790740474.059483:0:17902:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb25dda4f4e92eda9 00010000:00080000:1.0:1790740474.059964:0:17902:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98dcb5dda800@lustre-OST0000-osc-MDT0001: add connection 192.168.204.103@tcp at head 00010000:00010000:1.0:1790740474.061286:0:17902:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:0.0:1790740474.061412:0:17171:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022069120 00000100:00100000:0.0:1790740474.061422:0:17171:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022069120 00000100:00100000:2.0:1790740474.061671:0:17907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790740474.061679:0:17907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3637:x1877727022069120:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1790740474.061781:0:17907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3637:x1877727022069120:12345-0@lo:38:kworker.0 Request processed in 102us (3066us total) trans 0 rc -11/-11 00000100:00100000:2.0:1790740474.061788:0:17907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790740474.062742:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000040:01000000:1.0:1790740474.062751:0:17902:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00080000:0.0:1790740474.062753:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98dcb5f18000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790740474.062758:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1790740474.062762:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877727022069120:0@lo:38:kworker.0 00000040:01000000:1.0:1790740474.063017:0:17902:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1790740474.065728:0:17902:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790740474.066955:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1790740474.067328:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:1.0:1790740474.068245:0:17908:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1790740474.068251:0:17908:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1790740474.071672:0:17902:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1790740474.071688:0:17902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1790740474.071738:0:17902:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1790740474.071767:0:17902:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb25dda4f4e92edb0 00000100:00080000:1.0:1790740474.071794:0:17902:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790740474.071808:0:17902:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff98dcb5dda800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:1.0:1790740474.071852:0:17902:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98db84526300 x1877727022069376/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790740474.071977:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877727022069376:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1790740474.072074:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877727022069376 offset 0 length 520: 4 00000100:00080000:1.0:1790740474.073061:0:17902:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1790740474.073318:0:17170:0:(import.c:65:import_set_state_nolock()) ffff98dcb5cc2800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1790740474.073451:0:15342:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790740474.073457:0:15342:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790740474.073460:0:15342:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790740474.073463:0:15342:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:1.0:1790740474.073710:0:17902:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790740474.073719:0:17902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740474.073721:0:17902:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1790740474.073725:0:17902:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1790740474.073729:0:17902:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1790740474.073730:0:17902:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790740474.073732:0:17902:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790740474.073733:0:17902:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1790740474.073735:0:17902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740474.073736:0:17902:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1790740474.073739:0:17902:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790740474.073744:0:17902:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1790740474.073747:0:17902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740474.073749:0:17902:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1790740474.073752:0:17902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790740474.073756:0:17902:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.103@tcp to nid 0x20000c0a8cc67 (192.168.204.103@tcp) 00000020:01000000:1.0:1790740474.073778:0:17902:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1790740474.073781:0:17902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790740474.073796:0:17902:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff98dcb81db380) 00000020:00000080:1.0:1790740474.073955:0:17902:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1790740474.073963:0:17902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:3.0:1790740474.074054:0:17170:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3637:x1877727022068992:12345-0@lo:38:llog_process_th.0 Request processed in 16052us (16568us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740474.074073:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:1.0:1790740474.074096:0:17902:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1790740474.074103:0:17902:0:(osd_handler.c:8931:osd_obd_connect()) connect #5 00000020:00000080:1.0:1790740474.074110:0:17902:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb25dda4f4e92edbe 00010000:00080000:1.0:1790740474.074140:0:17902:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98dc88508000@lustre-OST0001-osc-MDT0001: add connection 192.168.204.103@tcp at head 00010000:00010000:1.0:1790740474.074446:0:17902:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1790740474.074601:0:17902:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1790740474.074616:0:17902:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:0.0:1790740474.075208:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790740474.075219:0:3637:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1790740474.075227:0:3637:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1790740474.075350:0:3637:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790740474.075355:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98dcb5cc7800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790740474.075379:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84525c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877727022068992:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790740474.075598:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84652300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022069504:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790740474.076634:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740474.076900:0:17171:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022069504 00000100:00100000:2.0:1790740474.076909:0:17171:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022069504 00000100:00100000:2.0:1790740474.076954:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790740474.076963:0:17171:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3639:x1877727022069504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790740474.076996:0:17171:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1790740474.077288:0:17171:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3639:x1877727022069504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 325us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740474.077296:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790740474.077427:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84652300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022069504:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1790740474.078983:0:17902:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790740474.079337:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1790740474.079590:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1790740474.080687:0:17910:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1790740474.080693:0:17910:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1790740474.082328:0:17902:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1790740474.082344:0:17902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1790740474.082415:0:17902:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1790740474.082441:0:17902:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb25dda4f4e92edc5 00000100:00080000:2.0:1790740474.082454:0:17902:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790740474.082466:0:17902:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff98dc88508000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:2.0:1790740474.082592:0:17902:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98db84652d80 x1877727022069632/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790740474.082670:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84652d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877727022069632:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1790740474.082725:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877727022069632 offset 0 length 520: 4 00000100:00080000:2.0:1790740474.082922:0:17902:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1790740474.083006:0:17902:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790740474.083012:0:17902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740474.083014:0:17902:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1790740474.083017:0:17902:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790740474.083021:0:17902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740474.083023:0:17902:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790740474.083026:0:17902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790740474.083027:0:17902:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790740474.083058:0:17902:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790740474.083061:0:17902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740474.083063:0:17902:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:2.0:1790740474.083065:0:17902:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790740474.083067:0:17902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740474.083069:0:17902:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1790740474.083072:0:17902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1790740474.083099:0:17902:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790740474.083103:0:17902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740474.083104:0:17902:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790740474.083107:0:17902:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000100:00080000:3.0:1790740474.083287:0:15342:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790740474.083292:0:15342:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790740474.083295:0:15342:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790740474.083297:0:15342:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:3.0:1790740474.083318:0:17898:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1790740474.083347:0:17898:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1790740474.083370:0:17898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcbfc44200/0xb25dda4f4e92ed47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ed4e expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740474.083383:0:17898:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dcbfc44200/0xb25dda4f4e92ed47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ed4e expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740474.083391:0:17898:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98dcae18b800 from 1 10000000:01000000:3.0:1790740474.083394:0:17898:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790740474.083424:0:17898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9a00/0xb25dda4f4e92edcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740474.083433:0:17898:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9a00/0xb25dda4f4e92edcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740474.083445:0:17898:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9a00/0xb25dda4f4e92edcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740474.083465:0:17898:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17898:1877727022069760:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790740474.083534:0:17898:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740474.083579:0:17898:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc86ae3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790740474.084226:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022069760 00000100:00100000:1.0:1790740474.084294:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022069760 00000100:00100000:1.0:1790740474.084352:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790740474.084361:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83b41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+15:17898:x1877727022069760:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790740474.084378:0:17161:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740474.084393:0:17161:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcbfc44c00/0xb25dda4f4e92edd3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92edcc expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740474.084419:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcbfc44c00/0xb25dda4f4e92edd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92edcc expref: 16 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740474.084430:0:17161:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcbfc44c00/0xb25dda4f4e92edd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92edcc expref: 16 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740474.084439:0:17161:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcbfc44c00, rc 0) 00000100:00100000:1.0:1790740474.084725:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83b41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+16:17898:x1877727022069760:12345-0@lo:101:mount.lustre.0 Request processed in 364us (1189us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740474.084733:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790740474.084930:0:17898:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17898:1877727022069760:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790740474.084950:0:17898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9a00/0xb25dda4f4e92edcc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92edd3 expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740474.084959:0:17898:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9a00/0xb25dda4f4e92edcc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92edd3 expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740474.089444:0:17898:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17898:1877727022069888:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1790740474.089617:0:17898:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740474.089791:0:17898:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc86ae3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790740474.089938:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022069888 00000100:00100000:0.0:1790740474.089946:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022069888 00000100:00100000:0.0:1790740474.090185:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790740474.090196:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83b43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+16:17898:x1877727022069888:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1790740474.090220:0:17159:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1790740474.090339:0:17159:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1790740474.090343:0:17159:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1790740474.091025:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83b43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+16:17898:x1877727022069888:12345-0@lo:256:mount.lustre.0 Request processed in 829us (1406us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740474.091063:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790740474.091388:0:17898:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17898:1877727022069888:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1790740474.094358:0:17898:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790740474.094463:0:17898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9a00/0xb25dda4f4e92edcc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92edd3 expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740474.094477:0:17898:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9a00/0xb25dda4f4e92edcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92edd3 expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740474.094565:0:17898:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98dcae18b800 from 1 10000000:01000000:2.0:1790740474.094568:0:17898:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790740474.094619:0:17898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92edda lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740474.094628:0:17898:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92edda lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740474.094650:0:17898:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92edda lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740474.094681:0:17898:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84653800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17898:1877727022070016:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790740474.094751:0:17898:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740474.094800:0:17898:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc86af0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790740474.095065:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022070016 00000100:00100000:1.0:1790740474.095074:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022070016 00000100:00100000:1.0:1790740474.095125:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790740474.095135:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83b41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+16:17898:x1877727022070016:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790740474.095149:0:17161:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740474.095162:0:17161:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcbfc44600/0xb25dda4f4e92ede1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92edda expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740474.095189:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcbfc44600/0xb25dda4f4e92ede1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92edda expref: 17 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740474.095210:0:17161:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcbfc44600/0xb25dda4f4e92ede1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92edda expref: 17 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740474.095219:0:17161:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcbfc44600, rc 0) 00000100:00100000:1.0:1790740474.095285:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83b41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+17:17898:x1877727022070016:12345-0@lo:101:mount.lustre.0 Request processed in 152us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740474.095292:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790740474.095773:0:17898:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84653800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17898:1877727022070016:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790740474.095791:0:17898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92edda lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ede1 expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740474.095801:0:17898:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92edda lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92ede1 expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790740474.095952:0:17898:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790740474.096004:0:17898:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17898:1877727022070144:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790740474.096064:0:17898:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740474.096095:0:17898:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc86ae3d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790740474.096791:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022070144 00000100:00100000:1.0:1790740474.096799:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022070144 00000100:00100000:1.0:1790740474.096854:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790740474.096863:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83b42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+17:17898:x1877727022070144:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790740474.096997:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83b42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+17:17898:x1877727022070144:12345-0@lo:501:mount.lustre.0 Request processed in 135us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740474.097005:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790740474.097608:0:17898:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17898:1877727022070144:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790740474.097738:0:17898:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17898:1877727022070272:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790740474.097801:0:17898:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740474.098090:0:17898:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc86ae3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790740474.098171:0:17160:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022070272 00000100:00100000:0.0:1790740474.098178:0:17160:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022070272 00000100:00100000:0.0:1790740474.098217:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790740474.098225:0:17160:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83b43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+17:17898:x1877727022070272:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790740474.098791:0:17160:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83b43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+17:17898:x1877727022070272:12345-0@lo:503:mount.lustre.0 Request processed in 564us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740474.098807:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790740474.099596:0:17898:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17898:1877727022070272:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1790740474.102587:0:17898:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790740474.102752:0:17898:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84527800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17898:1877727022070400:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790740474.102892:0:17898:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740474.102935:0:17898:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc81377480 going to sleep for 11 seconds 00000100:00100000:2.0:1790740474.103066:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022070400 00000100:00100000:2.0:1790740474.103073:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022070400 00000100:00100000:2.0:1790740474.103120:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790740474.103130:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83b41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+17:17898:x1877727022070400:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790740474.103349:0:17898:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84527800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17898:1877727022070400:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790740474.103763:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83b41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+17:17898:x1877727022070400:12345-0@lo:502:mount.lustre.0 Request processed in 633us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740474.103773:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000040:00080000:1.0:1790740474.103938:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1790740474.104155:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:1.0:1790740474.104193:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:1.0:1790740474.104210:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:1.0:1790740474.104222:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:1.0:1790740474.104313:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:1.0:1790740474.104470:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:1.0:1790740474.104585:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:1.0:1790740474.104605:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1790740474.104617:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:1.0:1790740474.104630:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:1.0:1790740474.104735:0:17898:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84527800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17898:1877727022070528:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790740474.104792:0:17898:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740474.104948:0:17898:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dca08079c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790740474.105359:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022070528 00000100:00100000:0.0:1790740474.105367:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022070528 00000100:00100000:0.0:1790740474.105417:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790740474.105426:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83b42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+17:17898:x1877727022070528:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790740474.105779:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83b42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+17:17898:x1877727022070528:12345-0@lo:502:mount.lustre.0 Request processed in 353us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740474.105788:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790740474.106460:0:17898:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84527800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17898:1877727022070528:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790740474.106705:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:3.0:1790740474.106722:0:17898:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1790740474.107892:0:17912:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790740474.107906:0:17912:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740474.107908:0:17912:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1790740474.107918:0:17912:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98dcae18b800 00000020:00000080:0.0:1790740474.107921:0:17912:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790740474.107930:0:17912:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790740474.107932:0:17912:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740474.107934:0:17912:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1790740474.107937:0:17912:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790740474.107940:0:17912:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740474.107941:0:17912:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1790740474.107944:0:17912:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98dcae18b800 00000020:00000080:0.0:1790740474.107947:0:17912:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790740474.108190:0:17912:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790740474.108195:0:17912:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740474.108196:0:17912:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1790740474.108200:0:17912:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790740474.108202:0:17912:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740474.108204:0:17912:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790740474.108207:0:17912:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98dcae18b800 00000020:00000080:0.0:1790740474.108210:0:17912:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790740474.109420:0:17912:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790740474.109439:0:17912:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740474.109441:0:17912:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790740474.109447:0:17912:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790740474.109450:0:17912:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740474.109452:0:17912:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1790740474.109457:0:17912:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98dcae18b800 00000020:00000080:0.0:1790740474.109459:0:17912:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790740474.109522:0:17912:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790740474.109526:0:17912:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740474.109527:0:17912:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1790740474.109531:0:17912:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:1.0:1790740474.109926:0:17898:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1790740474.109962:0:17898:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790740474.109995:0:17898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92edda lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ede1 expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740474.110008:0:17898:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92edda lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ede1 expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740474.110088:0:17898:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1790740474.110092:0:17898:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98dcae18b800 10000000:01000000:1.0:1790740474.110095:0:17898:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98dcae18b800 10000000:01000000:1.0:1790740474.110099:0:17898:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790740474.110105:0:17898:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98dcae18b800 from 1 10000000:01000000:1.0:1790740474.110108:0:17898:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790740474.110144:0:17898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcbfc44e00/0xb25dda4f4e92ede8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740474.110154:0:17898:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dcbfc44e00/0xb25dda4f4e92ede8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740474.110164:0:17898:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dcbfc44e00/0xb25dda4f4e92ede8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740474.110188:0:17898:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84526a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17898:1877727022070656:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790740474.110395:0:17898:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740474.110553:0:17898:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dca0807600 going to sleep for 11 seconds 00000100:00100000:3.0:1790740474.112369:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022070656 00000100:00100000:3.0:1790740474.112383:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022070656 00000100:00100000:3.0:1790740474.115435:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790740474.115454:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+17:17898:x1877727022070656:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790740474.115474:0:17161:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740474.115504:0:17161:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcb5dc9600/0xb25dda4f4e92edef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92ede8 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740474.115536:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcb5dc9600/0xb25dda4f4e92edef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92ede8 expref: 18 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740474.115559:0:17161:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcb5dc9600/0xb25dda4f4e92edef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92ede8 expref: 18 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740474.115568:0:17161:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc9600, rc 0) 00000100:00100000:3.0:1790740474.115669:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+18:17898:x1877727022070656:12345-0@lo:101:mount.lustre.0 Request processed in 220us (5273us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740474.115675:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790740474.121154:0:17898:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84526a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17898:1877727022070656:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790740474.121186:0:17898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dcbfc44e00/0xb25dda4f4e92ede8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92edef expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740474.121198:0:17898:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dcbfc44e00/0xb25dda4f4e92ede8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92edef expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790740474.123085:0:17898:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1790740474.123906:0:17898:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790740474.127438:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1790740474.128197:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:0.0:1790740474.128224:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:0.0:1790740474.129191:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:0.0:1790740474.129222:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:0.0:1790740474.129250:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:0.0:1790740474.129269:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:0.0:1790740474.129282:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:0.0:1790740474.129295:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:0.0:1790740474.129308:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:0.0:1790740474.129323:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:0.0:1790740474.129335:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:0.0:1790740474.129363:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:0.0:1790740474.129378:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:0.0:1790740474.129391:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:0.0:1790740474.129404:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:0.0:1790740474.129433:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:0.0:1790740474.129450:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:0.0:1790740474.129464:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:0.0:1790740474.129477:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:0.0:1790740474.129491:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:0.0:1790740474.129505:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:0.0:1790740474.129519:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:0.0:1790740474.129532:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:0.0:1790740474.129558:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:0.0:1790740474.129575:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:0.0:1790740474.129588:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:0.0:1790740474.129601:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:0.0:1790740474.129629:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:0.0:1790740474.129636:0:17898:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1790740474.131472:0:17898:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17898:1877727022070784:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790740474.131924:0:17898:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740474.132327:0:17898:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc9853a000 going to sleep for 11 seconds 00000100:00100000:1.0:1790740474.132663:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022070784 00000100:00100000:1.0:1790740474.132671:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022070784 00000100:00100000:1.0:1790740474.132725:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790740474.132734:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+18:17898:x1877727022070784:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790740474.132886:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+18:17898:x1877727022070784:12345-0@lo:501:mount.lustre.0 Request processed in 153us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740474.132895:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790740474.133457:0:17898:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17898:1877727022070784:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790740474.133719:0:17898:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17898:1877727022070912:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790740474.133778:0:17898:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740474.134720:0:17898:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc9853a000 going to sleep for 11 seconds 00000100:00100000:2.0:1790740474.136418:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022070912 00000100:00100000:2.0:1790740474.136432:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022070912 00000100:00100000:2.0:1790740474.136571:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790740474.136583:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+18:17898:x1877727022070912:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790740474.137131:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+18:17898:x1877727022070912:12345-0@lo:503:mount.lustre.0 Request processed in 549us (3351us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740474.137152:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790740474.138977:0:17898:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17898:1877727022070912:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1790740474.139630:0:17898:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790740474.139943:0:17898:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17898:1877727022071040:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790740474.140029:0:17898:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740474.140427:0:17898:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc9853a480 going to sleep for 11 seconds 00000100:00100000:1.0:1790740474.140773:0:17160:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022071040 00000100:00100000:1.0:1790740474.140782:0:17160:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022071040 00000100:00100000:1.0:1790740474.140853:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790740474.140863:0:17160:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+18:17898:x1877727022071040:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790740474.140992:0:17160:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+18:17898:x1877727022071040:12345-0@lo:502:mount.lustre.0 Request processed in 130us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740474.141000:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790740474.141415:0:17898:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17898:1877727022071040:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790740474.141619:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1790740474.142342:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:0.0:1790740474.142362:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:0.0:1790740474.142378:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:0.0:1790740474.142389:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:0.0:1790740474.142400:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:0.0:1790740474.142411:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:0.0:1790740474.142421:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:0.0:1790740474.142432:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:0.0:1790740474.142443:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:0.0:1790740474.142456:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:0.0:1790740474.142469:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:0.0:1790740474.142499:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:0.0:1790740474.142514:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:0.0:1790740474.142526:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:0.0:1790740474.142539:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:0.0:1790740474.142569:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:0.0:1790740474.142581:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:0.0:1790740474.142591:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:0.0:1790740474.142602:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:0.0:1790740474.142613:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:0.0:1790740474.142625:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:0.0:1790740474.142748:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:0.0:1790740474.142881:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:0.0:1790740474.142901:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:0.0:1790740474.142916:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:0.0:1790740474.142929:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:0.0:1790740474.142941:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:0.0:1790740474.142976:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:0.0:1790740474.142991:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:0.0:1790740474.143004:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:0.0:1790740474.143018:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:0.0:1790740474.143447:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:0.0:1790740474.143470:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:0.0:1790740474.143484:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:0.0:1790740474.143497:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:0.0:1790740474.143511:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:0.0:1790740474.143524:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:0.0:1790740474.143538:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:0.0:1790740474.143564:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:0.0:1790740474.143577:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:0.0:1790740474.143590:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:0.0:1790740474.143604:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:0.0:1790740474.143617:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:0.0:1790740474.144403:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:0.0:1790740474.144427:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:0.0:1790740474.144441:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:0.0:1790740474.144454:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:0.0:1790740474.144511:0:17898:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17898:1877727022071168:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790740474.144601:0:17898:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740474.144658:0:17898:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc9853a480 going to sleep for 11 seconds 00000100:00100000:3.0:1790740474.145271:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022071168 00000100:00100000:3.0:1790740474.145280:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022071168 00000100:00100000:3.0:1790740474.145340:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790740474.145350:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+18:17898:x1877727022071168:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790740474.145506:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+18:17898:x1877727022071168:12345-0@lo:502:mount.lustre.0 Request processed in 157us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740474.145515:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790740474.147288:0:17898:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17898:1877727022071168:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790740474.147583:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:1.0:1790740474.147614:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:1.0:1790740474.147668:0:17898:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84525880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17898:1877727022071296:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790740474.147735:0:17898:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740474.147789:0:17898:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dca0807840 going to sleep for 11 seconds 00000100:00100000:3.0:1790740474.147962:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022071296 00000100:00100000:3.0:1790740474.147970:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022071296 00000100:00100000:3.0:1790740474.148014:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790740474.148022:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+18:17898:x1877727022071296:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790740474.148160:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+18:17898:x1877727022071296:12345-0@lo:502:mount.lustre.0 Request processed in 139us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740474.148168:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790740474.149063:0:17898:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84525880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17898:1877727022071296:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790740474.149150:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:1.0:1790740474.149163:0:17898:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1790740474.151218:0:17917:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1790740474.151237:0:17917:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff98dc89743380) 00000020:00000080:3.0:1790740474.151260:0:17917:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1790740474.151362:0:17917:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98dcae18b800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1790740474.151367:0:17917:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98dcae18b800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1790740474.151369:0:17917:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98dcae18b800 3 00010000:00080000:3.0:1790740474.151402:0:17917:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98dc9892d800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.103@tcp at head 00010000:00010000:3.0:1790740474.153116:0:17917:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1790740474.154865:0:17917:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1790740474.154914:0:17917:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790740474.154928:0:17917:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xb25dda4f4e92edfd 00000100:00080000:2.0:1790740474.154940:0:17917:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790740474.154952:0:17917:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98dc9892d800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:2.0:1790740474.155005:0:17917:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98db84653800 x1877727022071424/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790740474.155052:0:17917:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1790740474.155937:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84653800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877727022071424:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790740474.156014:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740474.156419:0:17166:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022071424 00000100:00100000:0.0:1790740474.156429:0:17166:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022071424 00000100:00100000:0.0:1790740474.156478:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790740474.156485:0:17166:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1877727022071424:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1790740474.156512:0:17166:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 545 last 0 00000020:00000080:0.0:1790740474.156558:0:17166:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xb25dda4f4e92ee04 00000004:00100000:0.0:1790740474.156574:0:17166:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790740474.156613:0:17166:0:(import.c:65:import_set_state_nolock()) ffff98dcb5cb6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790740474.156684:0:17166:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877727022071424:12345-0@lo:38:llog_process_th.0 Request processed in 198us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740474.156692:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1790740474.156736:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98db84653800 x1877727022071424/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790740484 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740474.156746:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790740474.156756:0:3637:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1790740474.156765:0:3637:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1790740474.156769:0:3637:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790740474.156772:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98dc9892d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790740474.156779:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84653800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877727022071424:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1790740474.158580:0:15342:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790740474.158588:0:15342:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790740474.158591:0:15342:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790740474.158594:0:15342:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1790740474.162950:0:17917:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:1.0:1790740474.163012:0:17898:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1790740474.163065:0:17898:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790740474.163335:0:17898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcbfc44e00/0xb25dda4f4e92ede8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92edef expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740474.163349:0:17898:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dcbfc44e00/0xb25dda4f4e92ede8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92edef expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1790740474.163402:0:17898:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1790740474.163405:0:17898:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1790740474.163406:0:17898:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790740474.163408:0:17898:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790740474.163409:0:17898:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790740474.163411:0:17898:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790740474.163413:0:17898:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790740474.163415:0:17898:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790740474.163416:0:17898:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790740474.163420:0:17898:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1790740474.163423:0:17898:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790740474.163424:0:17898:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1790740474.163425:0:17898:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790740474.163427:0:17898:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790740474.163428:0:17898:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790740474.163429:0:17898:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790740474.163430:0:17898:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790740474.163431:0:17898:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790740474.163432:0:17898:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790740474.163457:0:17898:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1790740474.163477:0:17898:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84524380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17898:1877727022071552:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1790740474.163557:0:17898:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740474.163599:0:17898:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dca0807300 going to sleep for 11 seconds 00000100:00100000:3.0:1790740474.164065:0:17160:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022071552 00000100:00100000:3.0:1790740474.164073:0:17160:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022071552 00000100:00100000:3.0:1790740474.164116:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790740474.164126:0:17160:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+18:17898:x1877727022071552:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1790740474.164306:0:17160:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1790740474.164321:0:17160:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1790740474.166362:0:17146:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1790740474.166397:0:17160:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1790740474.166408:0:17160:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1790740474.167006:0:17181:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1790740474.167012:0:17181:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:3.0:1790740474.167726:0:17160:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+18:17898:x1877727022071552:12345-0@lo:253:mount.lustre.0 Request processed in 3596us (4163us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740474.167739:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790740474.167864:0:17898:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84524380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17898:1877727022071552:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790740474.167879:0:17898:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1790740474.167882:0:17898:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790740474.167884:0:17898:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1790740474.167885:0:17898:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790740474.167886:0:17898:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790740474.167888:0:17898:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790740474.167889:0:17898:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790740474.167890:0:17898:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790740474.167891:0:17898:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790740474.167893:0:17898:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790740474.167906:0:17898:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1790740474.169253:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98dcaeee3a00/0xb25dda4f4e92ee0b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740474.169276:0:17181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dcb5dc8000/0xb25dda4f4e92ed0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92ed08 expref: 17 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740474.169285:0:17181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dcbfc44c00/0xb25dda4f4e92edd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92edcc expref: 17 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740474.169293:0:17181:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98dcaeee3a00/0xb25dda4f4e92ee0b lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740474.169339:0:17181:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dcbfc44c00/0xb25dda4f4e92edd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92edcc expref: 17 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740474.169371:0:17181:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98dcbfc44c00/0xb25dda4f4e92edd3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92edcc expref: 17 pid: 17161 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740474.169387:0:17181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc7b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17181:1877727022071680:0@lo:104: 00000100:00100000:0.0:1790740474.169445:0:17181:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790740474.169514:0:17181:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dcb5dc8000/0xb25dda4f4e92ed0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92ed08 expref: 17 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740474.169522:0:17181:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98dcb5dc8000/0xb25dda4f4e92ed0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92ed08 expref: 17 pid: 17160 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740474.169530:0:17181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc7480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17181:1877727022071808:0@lo:104: 00000100:00100000:0.0:1790740474.169577:0:17181:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740474.170993:0:17150:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022071680 00000100:00100000:3.0:1790740474.171005:0:17150:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022071680 00000100:00100000:3.0:1790740474.171055:0:17150:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022071808 00000100:00100000:3.0:1790740474.171059:0:17150:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022071808 00000100:00100000:3.0:1790740474.171086:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790740474.171096:0:17150:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+4:17181:x1877727022071680:12345-0@lo:104: 00010000:00010000:3.0:1790740474.171112:0:17150:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9a00/0xb25dda4f4e92edcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92edd3 expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740474.171222:0:17181:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc9853ab40 going to sleep for 11 seconds 00010000:00010000:3.0:1790740474.173321:0:17150:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790740474.173337:0:17150:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+4:17181:x1877727022071680:12345-0@lo:104: Request processed in 2239us (3888us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740474.173349:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790740474.173384:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790740474.173395:0:17150:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+3:17181:x1877727022071808:12345-0@lo:104: 00010000:00010000:3.0:1790740474.173412:0:17150:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff98db83f32e00/0xb25dda4f4e92ed08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92ed0f expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740474.173465:0:17150:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790740474.173470:0:17150:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+3:17181:x1877727022071808:12345-0@lo:104: Request processed in 80us (3893us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740474.173483:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1790740474.173519:0:17154:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790740474.173526:0:17154:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9a00/0xb25dda4f4e92edcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92edd3 expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740474.173534:0:17154:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc9a00 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:3.0:1790740474.173539:0:17154:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9a00/0xb25dda4f4e92edcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92edd3 expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740474.173558:0:17154:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9a00/0xb25dda4f4e92edcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92edd3 expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790740474.173566:0:17154:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9a00/0xb25dda4f4e92edcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92edd3 expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740474.173572:0:17154:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790740474.173605:0:17154:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9a00/0xb25dda4f4e92edcc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92edd3 expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740474.173611:0:17154:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790740474.173632:0:17154:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9a00/0xb25dda4f4e92edcc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92edd3 expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740474.173639:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9a00/0xb25dda4f4e92edcc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92edd3 expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740474.173653:0:17154:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740474.173657:0:17154:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98db83f32e00/0xb25dda4f4e92ed08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92ed0f expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740474.173673:0:17154:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f32e00 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:3.0:1790740474.173676:0:17154:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98db83f32e00/0xb25dda4f4e92ed08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92ed0f expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740474.173682:0:17154:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98db83f32e00/0xb25dda4f4e92ed08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92ed0f expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790740474.173688:0:17154:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98db83f32e00/0xb25dda4f4e92ed08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92ed0f expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740474.173694:0:17154:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790740474.173708:0:17154:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98db83f32e00/0xb25dda4f4e92ed08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92ed0f expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740474.173714:0:17154:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790740474.173721:0:17154:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98db83f32e00/0xb25dda4f4e92ed08 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92ed0f expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740474.173727:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98db83f32e00/0xb25dda4f4e92ed08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92ed0f expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740474.173744:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740474.173746:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740474.173747:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740474.174010:0:17181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc7b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17181:1877727022071680:0@lo:104: 00000100:00100000:0.0:1790740474.174024:0:17181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc7480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17181:1877727022071808:0@lo:104: 00010000:00010000:0.0:1790740474.174070:0:17181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98dcaeee3a00/0xb25dda4f4e92ee0b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740474.174088:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740474.174105:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3641:1877727022072064:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790740474.174144:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740474.174183:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790740474.174189:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3641:1877727022071936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790740474.174209:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740474.174235:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022072064 00000100:00100000:0.0:1790740474.174247:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022072064 00010000:00010000:0.0:1790740474.174274:0:17151:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dcb5dc8000/0xb25dda4f4e92ed0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92ed08 expref: 18 pid: 17160 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740474.174307:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022071936 00000100:00100000:0.0:1790740474.174311:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022071936 00010000:00010000:0.0:1790740474.174322:0:17151:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dcbfc44c00/0xb25dda4f4e92edd3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92edcc expref: 19 pid: 17161 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740474.174333:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790740474.174338:0:17151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+19:3641:x1877727022072064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790740474.174349:0:17151:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740474.174353:0:17151:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dcb5dc8000/0xb25dda4f4e92ed0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92ed08 expref: 19 pid: 17160 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740474.174362:0:17151:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dcb5dc8000/0xb25dda4f4e92ed0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92ed08 expref: 19 pid: 17160 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740474.174375:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcb5dc8000/0xb25dda4f4e92ed0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92ed08 expref: 19 pid: 17160 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740474.174389:0:17151:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740474.174419:0:17151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+18:3641:x1877727022072064:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740474.174426:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790740474.174440:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790740474.174446:0:17151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+17:3641:x1877727022071936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790740474.174452:0:17151:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740474.174457:0:17151:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dcbfc44c00/0xb25dda4f4e92edd3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92edcc expref: 17 pid: 17161 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740474.174476:0:17151:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dcbfc44c00/0xb25dda4f4e92edd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92edcc expref: 17 pid: 17161 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740474.174485:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcbfc44c00/0xb25dda4f4e92edd3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92edcc expref: 17 pid: 17161 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740474.174497:0:17151:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98dcaeee3a00/0xb25dda4f4e92ee0b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740474.174505:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcaeee3a00/0xb25dda4f4e92ee0b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790740474.174519:0:17151:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007507663s 00010000:00010000:0.0:1790740474.174524:0:17151:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98dcaeee3a00/0xb25dda4f4e92ee0b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740474.174531:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98dcaeee3a00/0xb25dda4f4e92ee0b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740474.174538:0:17151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98dcaeee3a00/0xb25dda4f4e92ee0b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740474.174556:0:17151:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98dcaeee3a00/0xb25dda4f4e92ee0b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740474.174562:0:17151:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee3a00 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:0.0:1790740474.174566:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98dcaeee3a00/0xb25dda4f4e92ee0b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740474.174573:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98dcaeee3a00/0xb25dda4f4e92ee0b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740474.174594:0:17151:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98dcaeee3a00/0xb25dda4f4e92ee0b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740474.174603:0:17151:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740474.174628:0:17151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+16:3641:x1877727022071936:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740474.174635:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790740474.175675:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3641:1877727022071936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790740474.175686:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3641:1877727022072064:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790740474.175711:0:17181:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98dcaeee3a00/0xb25dda4f4e92ee0b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740474.175720:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98dcaeee3a00/0xb25dda4f4e92ee0b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740474.175726:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcaeee3a00/0xb25dda4f4e92ee0b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:2.0:1790740474.189606:0:17898:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1790740474.190065:0:17924:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1790740474.190070:0:17924:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:0.0:1790740474.191247:0:17925:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:0.0:1790740474.192071:0:17925:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1790740474.195252:0:17898:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:0.0:1790740474.197938:0:17925:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1790740474.198473:0:17925:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:3.0:1790740474.198481:0:17926:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2ca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17926:1877727022072192:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1790740474.198582:0:17926:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740474.198617:0:17926:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc86fb9300 going to sleep for 11 seconds 00000100:00100000:0.0:1790740474.199164:0:17170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022072192 00000100:00100000:0.0:1790740474.199172:0:17170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022072192 00000040:01000000:1.0:1790740474.199201:0:17898:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:0.0:1790740474.199224:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790740474.199233:0:17170:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17926:x1877727022072192:12345-0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1790740474.199251:0:17898:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790740474.200488:0:17170:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17926:x1877727022072192:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 1250us (1900us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740474.200499:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790740474.200613:0:17926:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2ca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17926:1877727022072192:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1790740474.200661:0:17926:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1790740474.200703:0:17926:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2ca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17926:1877727022072320:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1790740474.200750:0:17926:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740474.200770:0:17926:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc86fb9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790740474.200930:0:17171:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022072320 00000100:00100000:2.0:1790740474.200937:0:17171:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022072320 00000100:00100000:2.0:1790740474.200981:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790740474.200990:0:17171:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17926:x1877727022072320:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1790740474.201132:0:17171:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17926:x1877727022072320:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 142us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740474.201139:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790740474.201319:0:17926:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2ca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17926:1877727022072320:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1790740474.201382:0:17926:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2ca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17926:1877727022072448:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1790740474.201416:0:17926:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740474.201447:0:17926:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc86fb9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790740474.201590:0:17176:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022072448 00000100:00100000:2.0:1790740474.201595:0:17176:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022072448 00000100:00100000:2.0:1790740474.201624:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790740474.201631:0:17176:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17926:x1877727022072448:12345-0@lo:900:lod0001_rec0000.0 00000004:00000080:1.0:1790740474.201953:0:17898:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1790740474.201966:0:17898:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1790740474.202071:0:17898:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790740474.202699:0:17176:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17926:x1877727022072448:12345-0@lo:900:lod0001_rec0000.0 Request processed in 1066us (1278us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740474.202709:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:1.0:1790740474.204161:0:17898:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1790740474.205224:0:17898:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1790740474.205280:0:17898:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1790740474.205423:0:17898:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00080000:3.0:1790740474.205973:0:17926:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98dcbfe2ca80 x1877727022072448/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790740490 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740474.205991:0:17926:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2ca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17926:1877727022072448:0@lo:900:lod0001_rec0000.0 00080000:10000000:1.0:1790740474.206329:0:17898:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000100:00100000:3.0:1790740474.206798:0:17926:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2ca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17926:1877727022072576:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1790740474.207101:0:17926:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740474.207193:0:17926:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc86fb9300 going to sleep for 11 seconds 00000100:00100000:0.0:1790740474.207398:0:17170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022072576 00000100:00100000:0.0:1790740474.207406:0:17170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022072576 00000100:00100000:0.0:1790740474.207585:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790740474.207597:0:17170:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17926:x1877727022072576:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1790740474.207693:0:17170:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17926:x1877727022072576:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 98us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740474.207702:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790740474.207765:0:17926:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2ca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17926:1877727022072576:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1790740474.207838:0:17926:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790740474.209868:0:17926:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1790740474.209947:0:17926:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1790740474.209952:0:17926:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:1.0:1790740474.210570:0:17898:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1790740474.230622:0:17898:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1790740474.230664:0:17898:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb5b101d8b988 00100000:10000000:1.0:1790740474.230673:0:17898:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1790740474.231441:0:17898:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790740474.231477:0:17898:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.103@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790740474.232162:0:17898:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1790740474.232193:0:17898:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1790740474.232907:0:17898:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790740474.233154:0:17898:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1790740474.474720:0:17207:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc884d7d80 going to sleep for 0 seconds 00010000:00010000:3.0:1790740475.050335:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790740475.250278:0:17922:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1790740475.498295:0:17207:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc884d7d80 going to sleep for 0 seconds 10000000:01000000:0.0:1790740475.754246:0:17163:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790740475.754254:0:17163:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98dcae18b800 from 8 10000000:01000000:0.0:1790740475.754259:0:17163:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790740475.754312:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2c00/0xb25dda4f4e92ee12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740475.754324:0:17163:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2c00/0xb25dda4f4e92ee12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740475.754336:0:17163:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2c00/0xb25dda4f4e92ee12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740475.754363:0:17163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022072704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790740475.754442:0:17163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740475.754541:0:17163:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc887383c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790740475.755164:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022072704 00000100:00100000:3.0:1790740475.755173:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022072704 00000100:00100000:3.0:1790740475.755239:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790740475.755249:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+16:17163:x1877727022072704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790740475.755263:0:17159:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740475.755277:0:17159:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcb5dc9a00/0xb25dda4f4e92ee19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92ee12 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740475.755301:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcb5dc9a00/0xb25dda4f4e92ee19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92ee12 expref: 17 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740475.755311:0:17159:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcb5dc9a00/0xb25dda4f4e92ee19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92ee12 expref: 17 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740475.755320:0:17159:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc9a00, rc 0) 00000100:00100000:3.0:1790740475.755385:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+17:17163:x1877727022072704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740475.755392:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790740475.755506:0:17163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022072704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790740475.755533:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2c00/0xb25dda4f4e92ee12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ee19 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740475.755543:0:17163:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2c00/0xb25dda4f4e92ee12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92ee19 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740475.755622:0:17163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84527480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022072832:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1790740475.760225:0:17163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740475.760299:0:17163:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83dd1d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790740475.761182:0:17160:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022072832 00000100:00100000:3.0:1790740475.761194:0:17160:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022072832 00000100:00100000:3.0:1790740475.761264:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790740475.761274:0:17160:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+17:17163:x1877727022072832:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1790740475.761301:0:17160:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790740475.761325:0:17160:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790740475.761329:0:17160:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1790740475.764240:0:17160:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+17:17163:x1877727022072832:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 2957us (4014us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740475.764269:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790740475.764875:0:17163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84527480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022072832:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1790740475.764955:0:17163:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790740475.764969:0:17163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2c00/0xb25dda4f4e92ee12 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ee19 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740475.764982:0:17163:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2c00/0xb25dda4f4e92ee12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ee19 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740475.765003:0:17163:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790740475.765007:0:17163:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98db84771800 from 8 10000000:01000000:1.0:1790740475.765010:0:17163:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790740475.765084:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcbfc45200/0xb25dda4f4e92ee20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740475.765094:0:17163:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dcbfc45200/0xb25dda4f4e92ee20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740475.765104:0:17163:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dcbfc45200/0xb25dda4f4e92ee20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740475.765125:0:17163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84527480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022072960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790740475.765165:0:17163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740475.765205:0:17163:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83dd1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790740475.765325:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022072960 00000100:00100000:0.0:1790740475.765333:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022072960 00000100:00100000:0.0:1790740475.765401:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790740475.765411:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+17:17163:x1877727022072960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790740475.765423:0:17161:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740475.765436:0:17161:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcaeee2200/0xb25dda4f4e92ee27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92ee20 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740475.765471:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcaeee2200/0xb25dda4f4e92ee27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92ee20 expref: 18 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740475.765482:0:17161:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcaeee2200/0xb25dda4f4e92ee27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92ee20 expref: 18 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740475.765491:0:17161:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaeee2200, rc 0) 00000100:00100000:0.0:1790740475.765546:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+18:17163:x1877727022072960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740475.765554:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790740475.765964:0:17163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84527480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022072960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790740475.765979:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dcbfc45200/0xb25dda4f4e92ee20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ee27 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740475.765988:0:17163:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dcbfc45200/0xb25dda4f4e92ee20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92ee27 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740475.766072:0:17163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84527480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022073088:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1790740475.766108:0:17163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740475.766141:0:17163:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83dd1d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790740475.766198:0:17160:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022073088 00000100:00100000:3.0:1790740475.766203:0:17160:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022073088 00000100:00100000:3.0:1790740475.766262:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790740475.766269:0:17160:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+18:17163:x1877727022073088:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1790740475.766285:0:17160:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790740475.766301:0:17160:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790740475.766304:0:17160:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1790740475.766408:0:17160:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+18:17163:x1877727022073088:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 138us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740475.766416:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790740475.766606:0:17163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84527480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022073088:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1790740475.766656:0:17163:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790740475.766663:0:17163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcbfc45200/0xb25dda4f4e92ee20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ee27 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740475.766671:0:17163:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dcbfc45200/0xb25dda4f4e92ee20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ee27 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740476.075212:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790740476.267748:0:17922:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790740476.522726:0:17207:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc884d7d80 going to sleep for 0 seconds 00010000:00010000:3.0:1790740477.100971:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740477.550780:0:17207:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc884d7d80 going to sleep for 0 seconds 00010000:00010000:0.0:1790740478.127246:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740478.580991:0:17207:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc884d7d80 going to sleep for 0 seconds 00000100:00100000:3.0:1790740479.085846:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790740479.085870:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022073216:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790740479.085941:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740479.085995:0:17907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022073216 00000100:00100000:0.0:1790740479.086003:0:17907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022073216 00000100:00100000:0.0:1790740479.086060:0:17907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790740479.086069:0:17907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022073216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790740479.086104:0:17907:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1790740479.086231:0:17907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022073216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 163us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740479.086239:0:17907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790740479.086282:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022073216:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1790740479.147211:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790740479.461749:0:18169:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg403-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:3.0:1790740479.534151:0:17201:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790740479.597205:0:17207:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc884d7d80 going to sleep for 0 seconds 00000100:00080000:1.0:1790740479.597480:0:15342:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1790740479.597485:0:15342:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1790740479.597488:0:15342:0:(import.c:65:import_set_state_nolock()) ffff98dcb5f18000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790740479.597502:0:15342:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff98dcb5f18000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:1.0:1790740479.597526:0:15342:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98db84524e00 x1877727022073472/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790740479.597543:0:15342:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790740479.597548:0:15342:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790740479.597550:0:15342:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790740479.597554:0:15342:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790740479.597583:0:15342:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790740479.597587:0:15342:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790740479.597590:0:15342:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790740479.597593:0:15342:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790740479.597618:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790740479.597777:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84526680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877727022073600:0@lo:400:kworker.0 00000100:00100000:3.0:1790740479.597842:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740479.597913:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790740479.597920:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84527100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877727022073728:0@lo:400:kworker.0 00000100:00100000:3.0:1790740479.597942:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740479.597973:0:17165:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022073600 00000100:00100000:3.0:1790740479.597982:0:17165:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022073600 00000100:00100000:3.0:1790740479.598023:0:17165:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022073728 00000100:00100000:3.0:1790740479.598026:0:17165:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022073728 00000100:00100000:3.0:1790740479.598064:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790740479.598084:0:17165:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877727022073600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740479.598140:0:17165:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877727022073600:12345-0@lo:400:kworker.0 Request processed in 56us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740479.598148:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790740479.598165:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790740479.598171:0:17165:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877727022073728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740479.598211:0:17165:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877727022073728:12345-0@lo:400:kworker.0 Request processed in 41us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740479.598218:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1790740479.598256:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98db84527100 x1877727022073728/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740479.598270:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84527100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877727022073728:0@lo:400:kworker.0 00010000:00080000:3.0:1790740479.598281:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98db84526680 x1877727022073600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740479.598289:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84526680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877727022073600:0@lo:400:kworker.0 00000100:00100000:1.0:1790740479.598487:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3638:1877727022073344:0@lo:400:kworker.0 00000100:00100000:1.0:1790740479.598526:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740479.598571:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877727022073472:0@lo:38:kworker.0 00000100:00100000:1.0:1790740479.598609:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740479.598784:0:17170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022073472 00000100:00100000:1.0:1790740479.598796:0:17170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022073472 00000100:00100000:1.0:1790740479.598818:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790740479.598823:0:17170:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1877727022073472:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1790740479.598848:0:17170:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 550 last 0 00000020:00000080:1.0:1790740479.598897:0:17170:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb25dda4f4e92ee2e 00000004:00100000:1.0:1790740479.598913:0:17170:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1790740479.598920:0:17170:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1790740479.602565:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022073344 00000100:00100000:3.0:1790740479.602589:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022073344 00000100:00100000:3.0:1790740479.602766:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790740479.602776:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+18:3638:x1877727022073344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740479.602947:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+18:3638:x1877727022073344:12345-0@lo:400:kworker.0 Request processed in 172us (4419us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740479.602955:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790740479.603085:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3638:1877727022073344:0@lo:400:kworker.0 00000100:00080000:0.0:1790740479.624067:0:17170:0:(import.c:65:import_set_state_nolock()) ffff98dcb5cb4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790740479.624314:0:17170:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3637:x1877727022073472:12345-0@lo:38:kworker.0 Request processed in 25488us (25702us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740479.624326:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1790740479.634528:0:3637:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1790740479.634543:0:3637:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1790740479.634549:0:3637:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1790740479.634564:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98dcb5f18000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1790740479.634594:0:3637:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000006eae40d3): req@ffff98db83dc6d80 x1877727022066048/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740479.634613:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877727022073472:0@lo:38:kworker.0 00000100:00100000:1.0:1790740479.634822:0:17207:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740479.634881:0:17207:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc884d7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790740479.634901:0:17907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022066048 00000100:00100000:1.0:1790740479.634908:0:17907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022066048 00000100:00100000:1.0:1790740479.634957:0:17907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790740479.634965:0:17907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17207:x1877727022066048:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1790740479.635095:0:17907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17207:x1877727022066048:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 129us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740479.635102:0:17907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790740479.635138:0:17207:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc6d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17207:1877727022066048:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1790740479.635190:0:17207:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1790740479.635232:0:17207:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84527100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17207:1877727022073856:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1790740479.635261:0:17207:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740479.635282:0:17207:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83dd1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790740479.635295:0:17170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022073856 00000100:00100000:1.0:1790740479.635298:0:17170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022073856 00000100:00100000:1.0:1790740479.635319:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790740479.635325:0:17170:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17207:x1877727022073856:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1790740479.635447:0:17170:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17207:x1877727022073856:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 110us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740479.635453:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790740479.635481:0:17207:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84527100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17207:1877727022073856:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1790740479.635547:0:17207:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84527100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17207:1877727022073984:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1790740479.635571:0:17207:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740479.635586:0:17207:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83dd1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790740479.635598:0:17171:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022073984 00000100:00100000:1.0:1790740479.635601:0:17171:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022073984 00000100:00100000:1.0:1790740479.635622:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790740479.635628:0:17171:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17207:x1877727022073984:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1790740479.636134:0:17171:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17207:x1877727022073984:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 505us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740479.636142:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790740479.636165:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84652300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022074112:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790740479.636204:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740479.636234:0:17907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022074112 00000100:00100000:1.0:1790740479.636238:0:17907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022074112 00000100:00100000:1.0:1790740479.636259:0:17907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790740479.636266:0:17907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3638:x1877727022074112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790740479.636287:0:17907:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1790740479.636326:0:17907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3638:x1877727022074112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740479.636332:0:17907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790740479.636360:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84652300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022074112:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790740479.636400:0:17207:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84527100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17207:1877727022073984:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1790740479.636453:0:17207:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790740479.655150:0:17207:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1790740479.657986:0:17207:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 22, retries 0 00000004:00080000:1.0:1790740479.657998:0:17207:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1790740480.171679:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1790740480.754366:0:18221:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790740480.754862:0:18221:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1790740481.195700:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740481.707251:0:3637:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790740466/real 1790740466] req@ffff98db84526d80 x1877727022067072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790740481 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740481.707297:0:3637:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98db84526d80 x1877727022067072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790740481 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740481.707321:0:3637:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790740466/real 1790740466] req@ffff98db84525500 x1877727022067200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790740481 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740481.708096:0:3637:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98db84525500 x1877727022067200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790740481 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790740481.708267:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98dc856aa800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790740481.708296:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790740481.708302:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877727022067072:0@lo:8:kworker.0 00000100:00080000:0.0:1790740481.708494:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98dcaeddd000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790740481.708503:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790740481.708507:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877727022067200:0@lo:8:kworker.0 00000100:00080000:3.0:1790740481.708713:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790740481.708719:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1790740481.708723:0:36:0:(import.c:65:import_set_state_nolock()) ffff98dc856aa800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790740481.708729:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 537 00000100:00080000:3.0:1790740481.708737:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1790740481.708751:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98dc856aa800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:3.0:1790740481.708778:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98dcbfe2c000 x1877727022074496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790740481.708791:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790740481.708794:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790740481.708796:0:36:0:(import.c:65:import_set_state_nolock()) ffff98dcaeddd000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790740481.708799:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 537 00000100:00080000:3.0:1790740481.708802:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1790740481.708806:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98dcaeddd000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:3.0:1790740481.708816:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98dcbfe2d500 x1877727022074624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790740481.709447:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3639:1877727022074240:0@lo:400:kworker.0 00000100:00100000:0.0:1790740481.709566:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740481.709758:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877727022074496:0@lo:8:kworker.0 00000400:00000100:0.0:1790740481.709791:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877727022074496 offset 0 length 520: 4 00000100:00080000:3.0:1790740481.710133:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790740481.710138:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790740481.710141:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790740481.710144:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790740481.710185:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022074368:0@lo:400:kworker.0 00000100:00100000:3.0:1790740481.710227:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740481.710257:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790740481.710262:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877727022074752:0@lo:400:kworker.0 00000100:00100000:3.0:1790740481.710291:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740481.710373:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022074240 00000100:00100000:1.0:1790740481.710383:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022074240 00000100:00100000:1.0:1790740481.710457:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790740481.710467:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+18:3639:x1877727022074240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740481.710489:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022074880:0@lo:400:kworker.0 00000100:00100000:2.0:1790740481.710521:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740481.710528:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+18:3639:x1877727022074240:12345-0@lo:400:kworker.0 Request processed in 63us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740481.710536:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790740481.710543:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790740481.710548:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877727022075008:0@lo:400:kworker.0 00000100:00100000:2.0:1790740481.710573:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740481.710600:0:17170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022074368 00000100:00100000:1.0:1790740481.710602:0:17166:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022074752 00000100:00100000:2.0:1790740481.710604:0:17170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022074368 00000100:00100000:1.0:1790740481.710605:0:17166:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022074752 00000100:00100000:2.0:1790740481.710631:0:17170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022074880 00000100:00100000:1.0:1790740481.710631:0:17166:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022075008 00000100:00100000:2.0:1790740481.710634:0:17170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022074880 00000100:00100000:1.0:1790740481.710634:0:17166:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022075008 00000100:00100000:1.0:1790740481.710647:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790740481.710653:0:17166:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc884b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877727022074752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740481.710659:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790740481.710665:0:17170:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc884b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1877727022074368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740481.710692:0:17166:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc884b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877727022074752:12345-0@lo:400:kworker.0 Request processed in 39us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740481.710697:0:17170:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc884b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1877727022074368:12345-0@lo:400:kworker.0 Request processed in 33us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740481.710699:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790740481.710704:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790740481.710710:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790740481.710715:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790740481.710716:0:17166:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84650380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877727022075008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740481.710719:0:17170:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84650e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022074880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740481.710746:0:17166:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84650380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877727022075008:12345-0@lo:400:kworker.0 Request processed in 30us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740481.710764:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790740481.711421:0:17170:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84650e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022074880:12345-0@lo:400:kworker.0 Request processed in 697us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740481.711431:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1790740481.711484:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98dcbfe2f800 x1877727022075008/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740497 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740481.711500:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877727022075008:0@lo:400:kworker.0 00000100:00100000:2.0:1790740481.711513:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022074880:0@lo:400:kworker.0 00000100:00100000:3.0:1790740481.712060:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877727022074624:0@lo:8:kworker.0 00000400:00000100:3.0:1790740481.712113:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877727022074624 offset 0 length 520: 4 00000100:00100000:3.0:1790740481.712187:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3639:1877727022074240:0@lo:400:kworker.0 00010000:00080000:3.0:1790740481.712243:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98dcbfe2ca80 x1877727022074752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740497 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740481.712255:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877727022074752:0@lo:400:kworker.0 00000100:00100000:3.0:1790740481.712266:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022074368:0@lo:400:kworker.0 00000020:00000004:2.0:1790740482.205012:0:18272:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790740482.205443:0:18272:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1790740482.218612:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740483.247844:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790740483.568854:0:18320:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe134a1f00 20000000:00000080:0.0:1790740483.568872:0:18320:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98dcb790f000 uarg=0000000000000000 20000000:01000000:0.0:1790740483.568913:0:18320:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1790740483.568921:0:18320:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1790740483.568925:0:18320:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1790740483.569702:0:18321:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1790740483.569907:0:18320:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1790740483.578391:0:18320:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1790740483.578508:0:18320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98dcaeee2600/0xb25dda4f4e92ee35 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740483.578529:0:18320:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98db83f32000/0xb25dda4f4e92ecde lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92ecd7 expref: 17 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740483.578537:0:18320:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dcbfc44600/0xb25dda4f4e92ede1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92edda expref: 17 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740483.578568:0:18320:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98dcaeee2600/0xb25dda4f4e92ee35 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740483.578611:0:18320:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dcbfc44600/0xb25dda4f4e92ede1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92edda expref: 17 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740483.578627:0:18320:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98dcbfc44600/0xb25dda4f4e92ede1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92edda expref: 17 pid: 17161 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740483.578644:0:18320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18320:1877727022075136:0@lo:104: 00000100:00100000:0.0:1790740483.578711:0:18320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790740483.578828:0:18320:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98db83f32000/0xb25dda4f4e92ecde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92ecd7 expref: 17 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740483.578836:0:18320:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98db83f32000/0xb25dda4f4e92ecde lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92ecd7 expref: 17 pid: 17160 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740483.578846:0:18320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18320:1877727022075264:0@lo:104: 00000100:00100000:0.0:1790740483.578868:0:18320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740483.579000:0:18320:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcad22a180 going to sleep for 11 seconds 00000100:00100000:3.0:1790740483.581307:0:17150:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022075136 00000100:00100000:3.0:1790740483.581322:0:17150:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022075136 00000100:00100000:3.0:1790740483.581374:0:17150:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022075264 00000100:00100000:3.0:1790740483.581378:0:17150:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022075264 00000100:00100000:3.0:1790740483.581397:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790740483.581406:0:17150:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+4:18320:x1877727022075136:12345-0@lo:104: 00010000:00010000:3.0:1790740483.581424:0:17150:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92edda lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92ede1 expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740483.581739:0:17150:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790740483.581748:0:17150:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+4:18320:x1877727022075136:12345-0@lo:104: Request processed in 342us (3036us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740483.581755:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790740483.581803:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790740483.581810:0:17150:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+3:18320:x1877727022075264:12345-0@lo:104: 00010000:00010000:3.0:1790740483.581820:0:17150:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8200/0xb25dda4f4e92ecd7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92ecde expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740483.581948:0:18320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18320:1877727022075136:0@lo:104: 00000100:00100000:0.0:1790740483.581958:0:18320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18320:1877727022075264:0@lo:104: 00010000:00010000:0.0:1790740483.581983:0:18320:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98dcaeee2600/0xb25dda4f4e92ee35 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740483.582374:0:17155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790740483.582382:0:17155:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92edda lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92ede1 expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740483.582391:0:17155:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f33a00 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:1.0:1790740483.582395:0:17155:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92edda lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92ede1 expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740483.582403:0:17155:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92edda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92ede1 expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790740483.582410:0:17155:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92edda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92ede1 expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740483.582415:0:17155:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790740483.582452:0:17155:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92edda lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92ede1 expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740483.582459:0:17155:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790740483.582483:0:17155:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92edda lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92ede1 expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740483.582489:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92edda lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92ede1 expref: -99 pid: 17898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740483.582499:0:17155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790740483.582509:0:17155:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8200/0xb25dda4f4e92ecd7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92ecde expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740483.582515:0:17155:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc8200 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:1.0:1790740483.582517:0:17155:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8200/0xb25dda4f4e92ecd7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92ecde expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740483.582523:0:17155:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8200/0xb25dda4f4e92ecd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92ecde expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790740483.582528:0:17155:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8200/0xb25dda4f4e92ecd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92ecde expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740483.582532:0:17155:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790740483.582545:0:17155:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8200/0xb25dda4f4e92ecd7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92ecde expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740483.582550:0:17155:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790740483.582555:0:17155:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8200/0xb25dda4f4e92ecd7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92ecde expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740483.582561:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8200/0xb25dda4f4e92ecd7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92ecde expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740483.582572:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740483.582573:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740483.582575:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740483.582588:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84527100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3640:1877727022075392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790740483.582633:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740483.582679:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790740483.582685:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84527800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3640:1877727022075520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790740483.582716:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740483.582764:0:17152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022075392 00000100:00100000:1.0:1790740483.582770:0:17152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022075392 00010000:00010000:1.0:1790740483.582945:0:17152:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dcbfc44600/0xb25dda4f4e92ede1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92edda expref: 18 pid: 17161 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740483.583054:0:17150:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1790740483.583062:0:17150:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+3:18320:x1877727022075264:12345-0@lo:104: Request processed in 1252us (4192us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740483.583069:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790740483.583141:0:17152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022075520 00000100:00100000:1.0:1790740483.583145:0:17152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022075520 00010000:00010000:1.0:1790740483.583159:0:17152:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98db83f32000/0xb25dda4f4e92ecde lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92ecd7 expref: 19 pid: 17160 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740483.583244:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790740483.583255:0:17153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84525c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+19:3640:x1877727022075392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790740483.583268:0:17153:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740483.583287:0:17153:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dcbfc44600/0xb25dda4f4e92ede1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92edda expref: 19 pid: 17161 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740483.583299:0:17153:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dcbfc44600/0xb25dda4f4e92ede1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92edda expref: 19 pid: 17161 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740483.583313:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcbfc44600/0xb25dda4f4e92ede1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92edda expref: 19 pid: 17161 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740483.583325:0:17153:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740483.583381:0:17153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84525c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+18:3640:x1877727022075392:12345-0@lo:103:ldlm_bl.0 Request processed in 129us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740483.583387:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790740483.583404:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790740483.583411:0:17153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84525f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+17:3640:x1877727022075520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790740483.583419:0:17153:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740483.583423:0:17153:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98db83f32000/0xb25dda4f4e92ecde lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92ecd7 expref: 17 pid: 17160 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740483.583431:0:17153:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98db83f32000/0xb25dda4f4e92ecde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92ecd7 expref: 17 pid: 17160 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740483.583440:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98db83f32000/0xb25dda4f4e92ecde lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92ecd7 expref: 17 pid: 17160 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740483.583463:0:17153:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98dcaeee2600/0xb25dda4f4e92ee35 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740483.583471:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcaeee2600/0xb25dda4f4e92ee35 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740483.583487:0:17153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98dcaeee2600/0xb25dda4f4e92ee35 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740483.583495:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98dcaeee2600/0xb25dda4f4e92ee35 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740483.583502:0:17153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98dcaeee2600/0xb25dda4f4e92ee35 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740483.583509:0:17153:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98dcaeee2600/0xb25dda4f4e92ee35 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740483.583515:0:17153:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee2600 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:2.0:1790740483.583519:0:17153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98dcaeee2600/0xb25dda4f4e92ee35 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740483.583527:0:17153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98dcaeee2600/0xb25dda4f4e92ee35 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740483.583541:0:17153:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98dcaeee2600/0xb25dda4f4e92ee35 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740483.583551:0:17153:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740483.583576:0:17153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84525f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+16:3640:x1877727022075520:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740483.583589:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790740483.583727:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84527800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3640:1877727022075520:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790740483.583737:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84527100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3640:1877727022075392:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790740483.583887:0:18320:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98dcaeee2600/0xb25dda4f4e92ee35 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740483.583895:0:18320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98dcaeee2600/0xb25dda4f4e92ee35 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740483.583908:0:18320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcaeee2600/0xb25dda4f4e92ee35 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740483.592197:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740484.202398:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790740484.202422:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc884b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022075648:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790740484.202492:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740484.202545:0:17170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022075648 00000100:00100000:3.0:1790740484.202552:0:17170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022075648 00000100:00100000:3.0:1790740484.202605:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790740484.202613:0:17170:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc884b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022075648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790740484.202648:0:17170:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1790740484.202697:0:17170:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc884b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022075648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740484.202704:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790740484.202751:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc884b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022075648:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1790740484.271133:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740484.720093:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790740484.720117:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84651500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022075776:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790740484.720188:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740484.720235:0:17907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022075776 00000100:00100000:2.0:1790740484.720242:0:17907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022075776 00000100:00100000:2.0:1790740484.720290:0:17907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790740484.720299:0:17907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84652680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3638:x1877727022075776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790740484.720336:0:17907:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790740484.720401:0:17907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84652680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3638:x1877727022075776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740484.720409:0:17907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790740484.720456:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84651500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022075776:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790740484.778162:0:3637:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790740474/real 1790740474] req@ffff98db84652d80 x1877727022069632/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790740484 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740484.778211:0:3637:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98db84652d80 x1877727022069632/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790740484 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740484.778222:0:3637:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790740474/real 1790740474] req@ffff98db84526300 x1877727022069376/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790740484 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740484.778235:0:3637:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98db84526300 x1877727022069376/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790740484 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790740484.778254:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98dc88508000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790740484.778284:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790740484.778289:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84652d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877727022069632:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1790740484.778295:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98dcb5dda800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790740484.778300:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790740484.778303:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877727022069376:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1790740484.778447:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790740484.778451:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790740484.778455:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790740484.778458:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790740484.778485:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790740484.778488:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1790740484.778491:0:36:0:(import.c:65:import_set_state_nolock()) ffff98dcb5dda800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790740484.778496:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 545 00000100:00080000:0.0:1790740484.778501:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790740484.778511:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff98dcb5dda800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:0.0:1790740484.778532:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98db84533800 x1877727022076288/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790740484.778546:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790740484.778549:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790740484.778551:0:36:0:(import.c:65:import_set_state_nolock()) ffff98dc88508000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790740484.778553:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 545 00000100:00080000:0.0:1790740484.778556:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790740484.778559:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff98dc88508000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:0.0:1790740484.778568:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98db84530000 x1877727022076416/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790740484.778614:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022076160:0@lo:400:kworker.0 00000100:00100000:1.0:1790740484.778834:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877727022076032:0@lo:400:kworker.0 00000100:00100000:1.0:1790740484.778893:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740484.778930:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790740484.778935:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3641:1877727022075904:0@lo:400:kworker.0 00000100:00100000:1.0:1790740484.778966:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740484.779010:0:17166:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022076032 00000100:00100000:1.0:1790740484.779018:0:17166:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022076032 00000100:00100000:1.0:1790740484.779096:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790740484.779105:0:17166:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877727022076032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740484.779158:0:17166:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877727022076032:12345-0@lo:400:kworker.0 Request processed in 55us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740484.779167:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790740484.779192:0:17160:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022075904 00000100:00100000:1.0:1790740484.779196:0:17160:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022075904 00000100:00100000:1.0:1790740484.779221:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790740484.779227:0:17160:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+16:3641:x1877727022075904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740484.779267:0:17160:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+16:3641:x1877727022075904:12345-0@lo:400:kworker.0 Request processed in 40us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740484.779274:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790740484.779318:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3641:1877727022075904:0@lo:400:kworker.0 00010000:00080000:1.0:1790740484.779331:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98db83dc7100 x1877727022076032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740484.779355:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877727022076032:0@lo:400:kworker.0 00000100:00100000:0.0:1790740484.779495:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740484.779526:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790740484.779532:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84531180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877727022076544:0@lo:400:kworker.0 00000100:00100000:0.0:1790740484.779555:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740484.779585:0:17167:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022076544 00000100:00100000:0.0:1790740484.779589:0:17167:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022076544 00000100:00100000:0.0:1790740484.779612:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790740484.779618:0:17167:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877727022076544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740484.779651:0:17167:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877727022076544:12345-0@lo:400:kworker.0 Request processed in 34us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740484.779657:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1790740484.779680:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98db84531180 x1877727022076544/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740484.779689:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84531180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877727022076544:0@lo:400:kworker.0 00000100:00100000:0.0:1790740484.779706:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84533800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877727022076288:0@lo:8:kworker.0 00000400:00000100:0.0:1790740484.779725:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877727022076288 offset 0 length 520: 4 00000100:00100000:0.0:1790740484.779743:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84530000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877727022076416:0@lo:8:kworker.0 00000400:00000100:0.0:1790740484.779757:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877727022076416 offset 0 length 520: 4 00000100:00100000:3.0:1790740484.779814:0:17171:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022076160 00000100:00100000:3.0:1790740484.779819:0:17171:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022076160 00000100:00100000:3.0:1790740484.779857:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790740484.779864:0:17171:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022076160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740484.779905:0:17171:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022076160:12345-0@lo:400:kworker.0 Request processed in 42us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740484.779910:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790740484.780163:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022076160:0@lo:400:kworker.0 00010000:00010000:1.0:1790740485.290222:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790740485.482245:0:17163:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790740485.482254:0:17163:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98dcae18b800 from 13 10000000:01000000:2.0:1790740485.482260:0:17163:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790740485.482310:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98db83f33000/0xb25dda4f4e92ee3c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740485.482321:0:17163:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98db83f33000/0xb25dda4f4e92ee3c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740485.482343:0:17163:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98db83f33000/0xb25dda4f4e92ee3c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740485.482369:0:17163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84651500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022076672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790740485.482440:0:17163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740485.482504:0:17163:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc85779b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790740485.482564:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022076672 00000100:00100000:3.0:1790740485.482573:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022076672 00000100:00100000:3.0:1790740485.482660:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790740485.482670:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc889c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+16:17163:x1877727022076672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790740485.482694:0:17159:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740485.482708:0:17159:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcb5dc8e00/0xb25dda4f4e92ee43 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92ee3c expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740485.482733:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcb5dc8e00/0xb25dda4f4e92ee43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92ee3c expref: 17 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740485.482742:0:17159:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcb5dc8e00/0xb25dda4f4e92ee43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92ee3c expref: 17 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740485.482750:0:17159:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc8e00, rc 0) 00000100:00100000:3.0:1790740485.482801:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc889c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+17:17163:x1877727022076672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740485.482807:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790740485.482985:0:17163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84651500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022076672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790740485.483002:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98db83f33000/0xb25dda4f4e92ee3c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ee43 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740485.483010:0:17163:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98db83f33000/0xb25dda4f4e92ee3c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92ee43 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740485.483108:0:17163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84651500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022076800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790740485.483134:0:17163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740485.483154:0:17163:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc85779b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790740485.483316:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022076800 00000100:00100000:3.0:1790740485.483321:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022076800 00000100:00100000:3.0:1790740485.483366:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790740485.483373:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc889c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+17:17163:x1877727022076800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790740485.483489:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc889c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+17:17163:x1877727022076800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740485.483496:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790740485.483526:0:17163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84651500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022076800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790740485.483558:0:17163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc884b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022076928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790740485.483598:0:17163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740485.483613:0:17163:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc909bfe40 going to sleep for 11 seconds 00000100:00100000:3.0:1790740485.483624:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022076928 00000100:00100000:3.0:1790740485.483627:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022076928 00000100:00100000:3.0:1790740485.483669:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790740485.483676:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc889c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+17:17163:x1877727022076928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790740485.483751:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc889c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+17:17163:x1877727022076928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740485.483758:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790740485.483795:0:17163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc884b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022076928:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790740485.484504:0:18389:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1790740485.484553:0:17163:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1790740485.484581:0:17163:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790740485.484590:0:17163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98db83f33000/0xb25dda4f4e92ee3c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ee43 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740485.484600:0:17163:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98db83f33000/0xb25dda4f4e92ee3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ee43 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740485.484611:0:17163:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790740485.484613:0:17163:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98db84771800 from 13 10000000:01000000:3.0:1790740485.484616:0:17163:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790740485.484637:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8600/0xb25dda4f4e92ee4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740485.484644:0:17163:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8600/0xb25dda4f4e92ee4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740485.484653:0:17163:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8600/0xb25dda4f4e92ee4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740485.484667:0:17163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc884b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022077056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790740485.484698:0:17163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740485.484729:0:17163:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc909bf0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790740485.484743:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022077056 00000100:00100000:3.0:1790740485.484747:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022077056 00000100:00100000:3.0:1790740485.484768:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790740485.484774:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc889c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+17:17163:x1877727022077056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790740485.484783:0:17161:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740485.484793:0:17161:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcb5dc9800/0xb25dda4f4e92ee51 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92ee4a expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740485.484812:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcb5dc9800/0xb25dda4f4e92ee51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92ee4a expref: 18 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740485.484821:0:17161:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcb5dc9800/0xb25dda4f4e92ee51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92ee4a expref: 18 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740485.484829:0:17161:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc9800, rc 0) 00000100:00100000:3.0:1790740485.484856:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc889c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+18:17163:x1877727022077056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 82us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740485.484862:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790740485.484892:0:17163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc884b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022077056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790740485.484902:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8600/0xb25dda4f4e92ee4a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ee51 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740485.484911:0:17163:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8600/0xb25dda4f4e92ee4a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92ee51 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740485.484949:0:17163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc884b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022077184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790740485.484972:0:17163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740485.484992:0:17163:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc909bf0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790740485.485002:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022077184 00000100:00100000:3.0:1790740485.485006:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022077184 00000100:00100000:3.0:1790740485.485021:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790740485.485026:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc889c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+18:17163:x1877727022077184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790740485.485126:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc889c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+18:17163:x1877727022077184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 99us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740485.485132:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790740485.485156:0:17163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc884b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022077184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790740485.485178:0:17163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc884b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022077312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790740485.485211:0:17163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740485.485228:0:17163:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc909bf0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790740485.485238:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022077312 00000100:00100000:3.0:1790740485.485241:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022077312 00000100:00100000:3.0:1790740485.485256:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790740485.485261:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc217450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+18:17163:x1877727022077312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790740485.485320:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc217450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+18:17163:x1877727022077312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 58us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740485.485339:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790740485.485371:0:17163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc884b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022077312:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790740485.486076:0:18390:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1790740485.486110:0:17163:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1790740485.486121:0:17163:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790740485.486128:0:17163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8600/0xb25dda4f4e92ee4a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ee51 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740485.486147:0:17163:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8600/0xb25dda4f4e92ee4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ee51 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1790740485.746424:0:17899:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1790740486.315110:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790740486.506976:0:17922:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790740487.343182:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740488.363568:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740489.322372:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc884b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022077440:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790740489.322460:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740489.322554:0:17170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022077440 00000100:00100000:3.0:1790740489.322563:0:17170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022077440 00000100:00100000:3.0:1790740489.322616:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790740489.322626:0:17170:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022077440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790740489.322661:0:17170:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1790740489.322845:0:17170:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022077440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 221us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740489.322853:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790740489.323164:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc884b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022077440:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1790740489.392998:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790740489.774804:0:17201:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790740489.834467:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc884b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022077568:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790740489.834575:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740489.834688:0:17907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022077568 00000100:00100000:1.0:1790740489.834699:0:17907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022077568 00000100:00100000:1.0:1790740489.834759:0:17907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790740489.834770:0:17907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022077568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790740489.834820:0:17907:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1790740489.834873:0:17907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022077568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740489.834882:0:17907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790740489.834964:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc884b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022077568:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1790740489.837922:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790740489.837931:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790740489.837934:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790740489.837937:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790740489.837972:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790740489.837975:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790740489.837978:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790740489.837981:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790740489.838019:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84651f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877727022077824:0@lo:400:kworker.0 00000100:00100000:2.0:1790740489.838134:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740489.838265:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790740489.838283:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84651880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3639:1877727022077696:0@lo:400:kworker.0 00000100:00100000:2.0:1790740489.838321:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740489.838373:0:17165:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022077824 00000100:00100000:2.0:1790740489.838382:0:17165:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022077824 00000100:00100000:2.0:1790740489.838441:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790740489.838450:0:17165:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84650000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877727022077824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740489.838512:0:17165:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84650000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877727022077824:12345-0@lo:400:kworker.0 Request processed in 63us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740489.838520:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790740489.838547:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022077696 00000100:00100000:2.0:1790740489.838550:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022077696 00000100:00100000:2.0:1790740489.838579:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790740489.838586:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+18:3639:x1877727022077696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740489.838618:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+18:3639:x1877727022077696:12345-0@lo:400:kworker.0 Request processed in 33us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740489.838624:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790740489.838662:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84650a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022077952:0@lo:400:kworker.0 00000100:00100000:2.0:1790740489.838704:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740489.838727:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790740489.838733:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84650700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877727022078080:0@lo:400:kworker.0 00000100:00100000:2.0:1790740489.838754:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740489.838779:0:17170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022077952 00000100:00100000:2.0:1790740489.838783:0:17170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022077952 00000100:00100000:2.0:1790740489.838811:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790740489.838818:0:17170:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84653480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022077952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740489.838854:0:17170:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84653480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022077952:12345-0@lo:400:kworker.0 Request processed in 37us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740489.838870:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790740489.838888:0:17166:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022078080 00000100:00100000:2.0:1790740489.838891:0:17166:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022078080 00000100:00100000:2.0:1790740489.838913:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790740489.838919:0:17166:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84651c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877727022078080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740489.838950:0:17166:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84651c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877727022078080:12345-0@lo:400:kworker.0 Request processed in 31us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740489.838956:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1790740489.838993:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98db84650700 x1877727022078080/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740489.839010:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84650700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877727022078080:0@lo:400:kworker.0 00000100:00100000:2.0:1790740489.839020:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84650a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022077952:0@lo:400:kworker.0 00000100:00100000:2.0:1790740489.839085:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84651880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3639:1877727022077696:0@lo:400:kworker.0 00010000:00080000:2.0:1790740489.839095:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98db84651f80 x1877727022077824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740489.839105:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84651f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877727022077824:0@lo:400:kworker.0 00010000:00010000:2.0:1790740490.410768:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740491.435200:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790740491.567652:0:18668:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1790740491.567657:0:18668:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1790740491.567658:0:18668:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1790740491.567768:0:18668:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98dc9892f000 00000020:01000004:3.0:1790740491.567785:0:18668:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1790740491.567799:0:18668:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1790740491.567827:0:18668:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff98dcb13f0000) 00000020:00000080:3.0:1790740491.567845:0:18668:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1790740491.631853:0:18668:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1790740491.637985:0:18668:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1790740491.638781:0:18668:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1790740491.639406:0:18668:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1790740491.639668:0:18668:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1790740491.639914:0:18668:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1790740491.640166:0:18668:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:2.0:1790740491.641314:0:18668:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1790740491.641520:0:18668:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1790740491.641535:0:18668:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790740491.641546:0:18668:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb25dda4f4e92ee5f 00000020:01000004:2.0:1790740491.641553:0:18668:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1790740491.641575:0:18668:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.103@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790740491.641578:0:18668:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790740491.641585:0:18668:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1790740491.641589:0:18668:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1790740491.641601:0:18668:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff98dc992499c0) 00000020:00000080:2.0:1790740491.641612:0:18668:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1790740491.652058:0:18668:0:(service.c:173:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790740491.652268:0:18668:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1790740491.652275:0:18668:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1790740491.657790:0:18668:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1790740491.657814:0:18668:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1790740491.658501:0:18668:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1790740491.658509:0:18668:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1790740491.660389:0:18668:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790740491.660602:0:18668:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1790740491.660608:0:18668:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1790740491.662320:0:18668:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1790740491.662334:0:18668:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1790740491.692116:0:18668:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790740491.692470:0:18668:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1790740491.692486:0:18668:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1790740491.695064:0:18668:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1790740491.695077:0:18668:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1790740491.698361:0:18668:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1790740491.698379:0:18668:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1790740491.708606:0:18668:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790740491.709808:0:18668:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1790740491.709816:0:18668:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1790740491.725635:0:18668:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1790740491.725672:0:18668:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1790740491.784906:0:18668:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790740491.785230:0:18668:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1790740491.785238:0:18668:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1790740491.787369:0:18668:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1790740491.787384:0:18668:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1790740491.789609:0:18668:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1790740491.789873:0:18668:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1790740491.789882:0:18668:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.103@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1790740491.800527:0:18668:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.103@tcp ctxt 0 is initialized 00000020:01000004:3.0:1790740491.800590:0:18668:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.103@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1790740491.800594:0:18668:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1790740491.800596:0:18668:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790740491.800597:0:18668:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790740491.800598:0:18668:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790740491.800599:0:18668:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790740491.800600:0:18668:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790740491.800602:0:18668:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790740491.800604:0:18668:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790740491.800605:0:18668:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790740491.800609:0:18668:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1790740491.800611:0:18668:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790740491.800612:0:18668:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790740491.800614:0:18668:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790740491.800615:0:18668:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790740491.800616:0:18668:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790740491.800618:0:18668:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790740491.800619:0:18668:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790740491.800620:0:18668:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790740491.800621:0:18668:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790740491.800656:0:18668:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1790740491.800677:0:18668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc884b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:18668:1877727022078208:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790740491.801144:0:18668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740491.801262:0:18668:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc85697d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790740491.801307:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022078208 00000100:00100000:2.0:1790740491.801316:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022078208 00000100:00100000:2.0:1790740491.801404:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790740491.801414:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+18:18668:x1877727022078208:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1790740491.801448:0:17159:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1790740491.801451:0:17159:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1790740491.801455:0:17159:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1790740491.801773:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+18:18668:x1877727022078208:12345-0@lo:253:mount.lustre.0 Request processed in 359us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740491.801795:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790740491.801885:0:18668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc884b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:18668:1877727022078208:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1790740491.801897:0:18668:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1790740491.801900:0:18668:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790740491.801902:0:18668:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790740491.801903:0:18668:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790740491.801904:0:18668:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790740491.801906:0:18668:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790740491.801907:0:18668:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790740491.801908:0:18668:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790740491.801910:0:18668:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790740491.801911:0:18668:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1790740491.801929:0:18668:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98dc9892f000 from lustre-OST0000 10000000:01000000:0.0:1790740491.801969:0:18668:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1790740491.801972:0:18668:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1790740491.801982:0:18668:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98dcbc23b380 local copy 00010000:00010000:0.0:1790740491.801991:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98db83f32800/0xb25dda4f4e92ec1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ec21 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740491.802108:0:18668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84531180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:18668:1877727022078336:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790740491.802142:0:18668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740491.802655:0:18668:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83dd1480 going to sleep for 11 seconds 00000100:00100000:3.0:1790740491.802870:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022078336 00000100:00100000:3.0:1790740491.802877:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022078336 00000100:00100000:3.0:1790740491.802909:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790740491.802918:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc216450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+18:18668:x1877727022078336:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790740491.803010:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc216450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+18:18668:x1877727022078336:12345-0@lo:501:mount.lustre.0 Request processed in 92us (866us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790740491.803017:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1790740491.803143:0:18668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84531180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:18668:1877727022078336:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1790740491.803160:0:18668:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1790740491.803181:0:18668:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1790740491.803189:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98db83f32800/0xb25dda4f4e92ec1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ec21 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740491.803235:0:18668:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98db83f32800/0xb25dda4f4e92ec1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ec21 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740491.803265:0:18668:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98dc9892f000 10000000:01000000:0.0:1790740491.803271:0:18668:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1790740491.803277:0:18668:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1790740491.803280:0:18668:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790740491.803284:0:18668:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1790740491.803287:0:18668:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1790740491.803313:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2e00/0xb25dda4f4e92ee6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740491.803322:0:18668:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2e00/0xb25dda4f4e92ee6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740491.803332:0:18668:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2e00/0xb25dda4f4e92ee6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740491.803348:0:18668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84531180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:18668:1877727022078464:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790740491.803378:0:18668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740491.803400:0:18668:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83dd1480 going to sleep for 11 seconds 00000100:00100000:3.0:1790740491.803459:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022078464 00000100:00100000:3.0:1790740491.803469:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022078464 00000100:00100000:3.0:1790740491.803491:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790740491.803498:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc217850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+18:18668:x1877727022078464:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790740491.803506:0:17161:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740491.803520:0:17161:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcb5dc8a00/0xb25dda4f4e92ee74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92ee6d expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740491.803543:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcb5dc8a00/0xb25dda4f4e92ee74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92ee6d expref: 19 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740491.803556:0:17161:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcb5dc8a00/0xb25dda4f4e92ee74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92ee6d expref: 19 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740491.803566:0:17161:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc8a00, rc 0) 00000100:00100000:3.0:1790740491.803605:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc217850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+19:18668:x1877727022078464:12345-0@lo:101:mount.lustre.0 Request processed in 108us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740491.803612:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790740491.803871:0:18668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84531180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:18668:1877727022078464:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790740491.803887:0:18668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2e00/0xb25dda4f4e92ee6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ee74 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740491.803898:0:18668:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2e00/0xb25dda4f4e92ee6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92ee74 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790740491.805356:0:18668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1790740491.806176:0:18668:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790740491.808493:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1790740491.808554:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1790740491.808571:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1790740491.808585:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1790740491.808606:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1790740491.808622:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1790740491.808852:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1790740491.808860:0:18668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1790740491.808973:0:18668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc884b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:18668:1877727022078592:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790740491.809169:0:18668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740491.809270:0:18668:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc85697a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790740491.809364:0:17160:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022078592 00000100:00100000:1.0:1790740491.809372:0:17160:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022078592 00000100:00100000:0.0:1790740491.809555:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1790740491.809566:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+19:18668:x1877727022078592:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790740491.809831:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+19:18668:x1877727022078592:12345-0@lo:501:mount.lustre.0 Request processed in 267us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740491.809840:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790740491.810071:0:18668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc884b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:18668:1877727022078592:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790740491.810128:0:18668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc884b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:18668:1877727022078720:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790740491.810176:0:18668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740491.810377:0:18668:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc85697a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790740491.810440:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022078720 00000100:00100000:2.0:1790740491.810447:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022078720 00000100:00100000:2.0:1790740491.810474:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790740491.810480:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc37b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+19:18668:x1877727022078720:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790740491.811472:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc37b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+19:18668:x1877727022078720:12345-0@lo:503:mount.lustre.0 Request processed in 988us (1293us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740491.811483:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790740491.811584:0:18668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc884b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:18668:1877727022078720:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790740491.812356:0:18668:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790740491.812445:0:18668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc884b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:18668:1877727022078848:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790740491.812501:0:18668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740491.812534:0:18668:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc85697a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790740491.812603:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022078848 00000100:00100000:2.0:1790740491.812610:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022078848 00000100:00100000:2.0:1790740491.812647:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790740491.812655:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc37b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+19:18668:x1877727022078848:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790740491.813166:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc37b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+19:18668:x1877727022078848:12345-0@lo:502:mount.lustre.0 Request processed in 510us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740491.813174:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790740491.813266:0:18668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc884b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:18668:1877727022078848:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790740491.813443:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1790740491.813471:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1790740491.813486:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1790740491.813499:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1790740491.813511:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1790740491.813521:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1790740491.813533:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1790740491.813546:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1790740491.813575:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1790740491.813591:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1790740491.813606:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1790740491.813619:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1790740491.813711:0:18668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc884b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:18668:1877727022078976:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790740491.813830:0:18668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740491.813911:0:18668:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc85697a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790740491.813996:0:17160:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022078976 00000100:00100000:1.0:1790740491.814002:0:17160:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022078976 00000100:00100000:0.0:1790740491.814118:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790740491.814130:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc37bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+19:18668:x1877727022078976:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790740491.814238:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc37bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+19:18668:x1877727022078976:12345-0@lo:502:mount.lustre.0 Request processed in 110us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740491.814245:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790740491.814334:0:18668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc884b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:18668:1877727022078976:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790740491.814380:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1790740491.814396:0:18668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1790740491.815365:0:18685:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790740491.815375:0:18685:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1790740491.815383:0:18685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740491.815385:0:18685:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1790740491.815392:0:18685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790740491.815405:0:18685:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff98dc9924cd40) 00000020:00000080:2.0:1790740491.815426:0:18685:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1790740491.815431:0:18685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1790740491.815495:0:18685:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98dc9892f000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1790740491.815505:0:18685:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790740491.815511:0:18685:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb25dda4f4e92ee82 00010000:00010000:3.0:1790740491.822106:0:18685:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1790740491.822790:0:18685:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:3.0:1790740491.824218:0:18685:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1790740491.825415:0:18685:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1790740491.825427:0:18685:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790740491.825434:0:18685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790740491.825436:0:18685:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1790740491.825439:0:18685:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1790740491.825442:0:18685:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1790740491.825443:0:18685:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790740491.825444:0:18685:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790740491.825446:0:18685:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1790740491.825448:0:18685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790740491.825449:0:18685:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1790740491.825452:0:18685:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790740491.825455:0:18685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790740491.825457:0:18685:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790740491.825459:0:18685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790740491.825461:0:18685:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1790740491.825463:0:18685:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790740491.825466:0:18685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790740491.825467:0:18685:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1790740491.825469:0:18685:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790740491.825472:0:18685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790740491.825473:0:18685:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1790740491.825476:0:18685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1790740491.825502:0:18685:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790740491.825506:0:18685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790740491.825507:0:18685:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1790740491.825511:0:18685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1790740491.825744:0:18668:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1790740491.825778:0:18668:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1790740491.825802:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2e00/0xb25dda4f4e92ee6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ee74 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740491.825815:0:18668:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2e00/0xb25dda4f4e92ee6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ee74 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740491.825825:0:18668:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98dc9892f000 from 1 10000000:01000000:0.0:1790740491.825828:0:18668:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790740491.825864:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3000/0xb25dda4f4e92ee89 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740491.825873:0:18668:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3000/0xb25dda4f4e92ee89 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740491.825891:0:18668:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3000/0xb25dda4f4e92ee89 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740491.825918:0:18668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84531180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:18668:1877727022079104:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790740491.825987:0:18668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740491.826055:0:18668:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83dd19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740491.826129:0:17160:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022079104 00000100:00100000:2.0:1790740491.826137:0:17160:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022079104 00000100:00100000:2.0:1790740491.826191:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790740491.826200:0:17160:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+19:18668:x1877727022079104:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790740491.826224:0:17160:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740491.826237:0:17160:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98db83f32200/0xb25dda4f4e92ee90 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92ee89 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740491.826259:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98db83f32200/0xb25dda4f4e92ee90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92ee89 expref: 20 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740491.826271:0:17160:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98db83f32200/0xb25dda4f4e92ee90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92ee89 expref: 20 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740491.826280:0:17160:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f32200, rc 0) 00000100:00100000:2.0:1790740491.826318:0:17160:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+20:18668:x1877727022079104:12345-0@lo:101:mount.lustre.0 Request processed in 119us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740491.826326:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790740491.826455:0:18668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84531180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:18668:1877727022079104:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790740491.826470:0:18668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3000/0xb25dda4f4e92ee89 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ee90 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740491.826479:0:18668:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3000/0xb25dda4f4e92ee89 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92ee90 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790740491.827520:0:18668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1790740491.827820:0:18668:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790740491.827986:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1790740491.828010:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1790740491.828026:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1790740491.828223:0:18668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1790740491.828295:0:18668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84531180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:18668:1877727022079232:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790740491.828350:0:18668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740491.828433:0:18668:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83dd1180 going to sleep for 11 seconds 00000100:00100000:3.0:1790740491.832839:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022079232 00000100:00100000:3.0:1790740491.832856:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022079232 00000100:00100000:3.0:1790740491.832915:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790740491.832935:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc37a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+20:18668:x1877727022079232:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790740491.833141:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc37a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+20:18668:x1877727022079232:12345-0@lo:501:mount.lustre.0 Request processed in 208us (4790us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740491.833149:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1790740491.833336:0:18668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84531180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:18668:1877727022079232:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790740491.833392:0:18668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84531180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:18668:1877727022079360:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790740491.833445:0:18668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740491.833483:0:18668:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83dd1180 going to sleep for 11 seconds 00000100:00100000:1.0:1790740491.833538:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022079360 00000100:00100000:1.0:1790740491.833544:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022079360 00000100:00100000:1.0:1790740491.833596:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790740491.833604:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc378850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+20:18668:x1877727022079360:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790740491.833719:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc378850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+20:18668:x1877727022079360:12345-0@lo:503:mount.lustre.0 Request processed in 116us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740491.833726:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1790740491.833860:0:18668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84531180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:18668:1877727022079360:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1790740491.834328:0:18668:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790740491.834402:0:18668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84531180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:18668:1877727022079488:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790740491.834445:0:18668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740491.834466:0:18668:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83dd19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790740491.834541:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022079488 00000100:00100000:3.0:1790740491.834547:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022079488 00000100:00100000:3.0:1790740491.834582:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1790740491.834590:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc37b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+20:18668:x1877727022079488:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790740491.834685:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc37b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+20:18668:x1877727022079488:12345-0@lo:502:mount.lustre.0 Request processed in 96us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740491.834692:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1790740491.834869:0:18668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84531180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:18668:1877727022079488:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790740491.835064:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1790740491.835101:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1790740491.835118:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1790740491.835130:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1790740491.835142:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1790740491.835154:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1790740491.835167:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1790740491.835181:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1790740491.835193:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1790740491.835213:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1790740491.835228:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1790740491.835249:0:18668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84531180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:18668:1877727022079616:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790740491.835283:0:18668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740491.835309:0:18668:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83dd19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790740491.835400:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022079616 00000100:00100000:3.0:1790740491.835406:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022079616 00000100:00100000:3.0:1790740491.835441:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1790740491.835449:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+20:18668:x1877727022079616:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790740491.835523:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+20:18668:x1877727022079616:12345-0@lo:502:mount.lustre.0 Request processed in 75us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740491.835531:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1790740491.839659:0:18668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84531180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:18668:1877727022079616:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790740491.839784:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1790740491.839799:0:18668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1790740491.841811:0:18689:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790740491.841825:0:18689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740491.841827:0:18689:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1790740491.841836:0:18689:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98dc9892f000 00000020:00000080:0.0:1790740491.841839:0:18689:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790740491.841855:0:18689:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790740491.841858:0:18689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740491.841859:0:18689:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1790740491.841862:0:18689:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790740491.841864:0:18689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740491.841865:0:18689:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1790740491.841869:0:18689:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98dc9892f000 00000020:00000080:0.0:1790740491.841870:0:18689:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790740491.841938:0:18689:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790740491.841942:0:18689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740491.841943:0:18689:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1790740491.841945:0:18689:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790740491.841948:0:18689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740491.841950:0:18689:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790740491.841953:0:18689:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98dc9892f000 00000020:00000080:0.0:1790740491.841955:0:18689:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790740491.841973:0:18689:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790740491.841975:0:18689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740491.841977:0:18689:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790740491.841979:0:18689:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790740491.841981:0:18689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740491.841982:0:18689:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1790740491.841985:0:18689:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98dc9892f000 00000020:00000080:0.0:1790740491.841986:0:18689:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790740491.842005:0:18689:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790740491.842008:0:18689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740491.842010:0:18689:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1790740491.842013:0:18689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1790740491.843266:0:18668:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1790740491.843296:0:18668:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790740491.843320:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3000/0xb25dda4f4e92ee89 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ee90 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740491.843333:0:18668:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3000/0xb25dda4f4e92ee89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ee90 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740491.843384:0:18668:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790740491.843393:0:18668:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98dc9892f000 10000000:01000000:3.0:1790740491.843396:0:18668:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98dc9892f000 10000000:01000000:3.0:1790740491.843400:0:18668:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790740491.843406:0:18668:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98dc9892f000 from 1 10000000:01000000:3.0:1790740491.843409:0:18668:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790740491.843445:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9000/0xb25dda4f4e92ee97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740491.843453:0:18668:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9000/0xb25dda4f4e92ee97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740491.843463:0:18668:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9000/0xb25dda4f4e92ee97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740491.843487:0:18668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc884b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:18668:1877727022079744:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790740491.843553:0:18668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740491.843593:0:18668:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc88738e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790740491.843714:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022079744 00000100:00100000:0.0:1790740491.843722:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022079744 00000100:00100000:0.0:1790740491.848659:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1790740491.848680:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+20:18668:x1877727022079744:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790740491.848701:0:17159:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740491.848729:0:17159:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcaeee3800/0xb25dda4f4e92ee9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92ee97 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740491.848760:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcaeee3800/0xb25dda4f4e92ee9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92ee97 expref: 21 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740491.848773:0:17159:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcaeee3800/0xb25dda4f4e92ee9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92ee97 expref: 21 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740491.848782:0:17159:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaeee3800, rc 0) 00000100:00100000:0.0:1790740491.848865:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+21:18668:x1877727022079744:12345-0@lo:101:mount.lustre.0 Request processed in 193us (5311us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740491.848872:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790740491.851404:0:18668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc884b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:18668:1877727022079744:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790740491.851433:0:18668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9000/0xb25dda4f4e92ee97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ee9e expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740491.851447:0:18668:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9000/0xb25dda4f4e92ee97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92ee9e expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790740491.854729:0:18668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1790740491.855060:0:18668:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790740491.855247:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1790740491.855273:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1790740491.855289:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1790740491.855302:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1790740491.855324:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1790740491.855339:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1790740491.855351:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1790740491.855364:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1790740491.855376:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1790740491.855387:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1790740491.855414:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1790740491.855428:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1790740491.855442:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1790740491.855454:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1790740491.855467:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1790740491.855480:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1790740491.855493:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1790740491.855507:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1790740491.855519:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1790740491.855531:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1790740491.855544:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1790740491.855557:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1790740491.855569:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1790740491.855583:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1790740491.855596:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1790740491.855608:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1790740491.856289:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1790740491.856313:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1790740491.856326:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1790740491.856339:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1790740491.856351:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1790740491.856363:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1790740491.856375:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1790740491.856388:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1790740491.856400:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1790740491.856411:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1790740491.856423:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1790740491.856454:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1790740491.856460:0:18668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1790740491.856555:0:18668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc884b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:18668:1877727022079872:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790740491.856623:0:18668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740491.856922:0:18668:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc984733c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740491.863824:0:17160:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022079872 00000100:00100000:2.0:1790740491.863839:0:17160:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022079872 00000100:00100000:2.0:1790740491.863912:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1790740491.863923:0:17160:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc37a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+21:18668:x1877727022079872:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790740491.864141:0:17160:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc37a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+21:18668:x1877727022079872:12345-0@lo:501:mount.lustre.0 Request processed in 219us (7516us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740491.864149:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1790740491.864266:0:18668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc884b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:18668:1877727022079872:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790740491.864331:0:18668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84531180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:18668:1877727022080000:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790740491.864389:0:18668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740491.864433:0:18668:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83dd1300 going to sleep for 11 seconds 00000100:00100000:0.0:1790740491.864469:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022080000 00000100:00100000:0.0:1790740491.864474:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022080000 00000100:00100000:0.0:1790740491.864508:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1790740491.864514:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+21:18668:x1877727022080000:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790740491.864626:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+21:18668:x1877727022080000:12345-0@lo:503:mount.lustre.0 Request processed in 111us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740491.864635:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1790740491.864691:0:18668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84531180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:18668:1877727022080000:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1790740491.865173:0:18668:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790740491.865267:0:18668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84531180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:18668:1877727022080128:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790740491.865322:0:18668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740491.865347:0:18668:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83dd1300 going to sleep for 11 seconds 00000100:00100000:2.0:1790740491.865819:0:17160:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022080128 00000100:00100000:2.0:1790740491.865826:0:17160:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022080128 00000100:00100000:2.0:1790740491.865870:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1790740491.865877:0:17160:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+21:18668:x1877727022080128:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790740491.865975:0:17160:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+21:18668:x1877727022080128:12345-0@lo:502:mount.lustre.0 Request processed in 97us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740491.865987:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1790740491.866916:0:18668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84531180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:18668:1877727022080128:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790740491.867184:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1790740491.867231:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1790740491.867246:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1790740491.867260:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1790740491.867294:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1790740491.867311:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1790740491.867326:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1790740491.867340:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1790740491.867354:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1790740491.867368:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1790740491.867382:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1790740491.867395:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1790740491.867409:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1790740491.867423:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1790740491.867436:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1790740491.867449:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1790740491.867463:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1790740491.867476:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1790740491.867490:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1790740491.867502:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1790740491.867530:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1790740491.867544:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1790740491.867556:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1790740491.867568:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1790740491.867582:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1790740491.867593:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1790740491.867605:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1790740491.867618:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1790740491.869482:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1790740491.869512:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1790740491.869523:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1790740491.869536:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1790740491.869549:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1790740491.869561:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1790740491.869575:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1790740491.869589:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1790740491.869621:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1790740491.869780:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1790740491.869800:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1790740491.869815:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1790740491.869828:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1790740491.869845:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1790740491.869860:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1790740491.869874:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1790740491.869890:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1790740491.869906:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1790740491.869922:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1790740491.869941:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1790740491.870003:0:18668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84531180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:18668:1877727022080256:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790740491.870113:0:18668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740491.870163:0:18668:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83dd1300 going to sleep for 11 seconds 00000100:00100000:0.0:1790740491.870196:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022080256 00000100:00100000:0.0:1790740491.870215:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022080256 00000100:00100000:0.0:1790740491.870268:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1790740491.870278:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb6d1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+21:18668:x1877727022080256:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790740491.870405:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb6d1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+21:18668:x1877727022080256:12345-0@lo:502:mount.lustre.0 Request processed in 128us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740491.870414:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1790740491.870482:0:18668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84531180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:18668:1877727022080256:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790740491.873927:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1790740491.873995:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1790740491.874065:0:18668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84531180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:18668:1877727022080384:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790740491.874148:0:18668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740491.874194:0:18668:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83dd1300 going to sleep for 11 seconds 00000100:00100000:0.0:1790740491.874239:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022080384 00000100:00100000:0.0:1790740491.874247:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022080384 00000100:00100000:0.0:1790740491.874311:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1790740491.874320:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb6d1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+21:18668:x1877727022080384:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790740491.874436:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb6d1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+21:18668:x1877727022080384:12345-0@lo:502:mount.lustre.0 Request processed in 117us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740491.874444:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1790740491.874504:0:18668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84531180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:18668:1877727022080384:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790740491.874548:0:18668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1790740491.874557:0:18668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1790740491.883325:0:18694:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1790740491.883345:0:18694:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff98dcb6c6cd40) 00000020:00000080:0.0:1790740491.883371:0:18694:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1790740491.883469:0:18694:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98dc9892f000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1790740491.883474:0:18694:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98dc9892f000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1790740491.883478:0:18694:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98dc9892f000 3 00010000:00080000:0.0:1790740491.883510:0:18694:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98db8295b000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.103@tcp at head 00010000:00010000:0.0:1790740491.885179:0:18694:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1790740491.885386:0:18694:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1790740491.885429:0:18694:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790740491.885441:0:18694:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xb25dda4f4e92eeac 00000100:00080000:0.0:1790740491.885451:0:18694:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790740491.885467:0:18694:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98db8295b000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:0.0:1790740491.885510:0:18694:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98db84531180 x1877727022080512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790740491.885531:0:18694:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1790740491.886695:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84531180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1877727022080512:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790740491.886788:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790740491.886890:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790740491.886895:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790740491.886897:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790740491.886900:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790740491.886921:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790740491.886925:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790740491.886927:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790740491.886930:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790740491.887061:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84651880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022080640:0@lo:400:kworker.0 00000100:00100000:2.0:1790740491.887106:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740491.887130:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790740491.887136:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84650a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727022080768:0@lo:400:kworker.0 00000100:00100000:2.0:1790740491.887157:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740491.887188:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84650700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022080896:0@lo:400:kworker.0 00000100:00100000:2.0:1790740491.887223:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740491.887241:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790740491.887246:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84652a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877727022081024:0@lo:400:kworker.0 00000100:00100000:2.0:1790740491.887265:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740491.887300:0:17171:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022080640 00000100:00100000:2.0:1790740491.887314:0:17171:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022080640 00000100:00100000:2.0:1790740491.887352:0:17171:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022080896 00000100:00100000:2.0:1790740491.887355:0:17171:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022080896 00000100:00100000:2.0:1790740491.887384:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790740491.887392:0:17171:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84653100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022080640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740491.887456:0:17171:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84653100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022080640:12345-0@lo:400:kworker.0 Request processed in 64us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740491.887463:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790740491.887481:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790740491.887487:0:17171:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84651180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022080896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740491.887522:0:17171:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84651180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022080896:12345-0@lo:400:kworker.0 Request processed in 35us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740491.887528:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790740491.887558:0:17166:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022080512 00000100:00100000:2.0:1790740491.887562:0:17166:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022080512 00000100:00100000:2.0:1790740491.887575:0:17166:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022080768 00000100:00100000:2.0:1790740491.887577:0:17166:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022080768 00000100:00100000:2.0:1790740491.887589:0:17166:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022081024 00000100:00100000:2.0:1790740491.887590:0:17166:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022081024 00000100:00100000:2.0:1790740491.887602:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790740491.887607:0:17166:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84653b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727022080768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740491.887640:0:17166:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84653b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727022080768:12345-0@lo:400:kworker.0 Request processed in 33us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740491.887646:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790740491.887657:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790740491.887663:0:17166:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84651500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877727022081024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740491.887692:0:17166:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84651500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877727022081024:12345-0@lo:400:kworker.0 Request processed in 29us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740491.887708:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790740491.887723:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790740491.887727:0:17166:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84651f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1877727022080512:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1790740491.887748:0:17166:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 563 last 0 00000020:00000080:2.0:1790740491.887780:0:17166:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xb25dda4f4e92eeb3 00000004:00100000:2.0:1790740491.887795:0:17166:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790740491.887827:0:17166:0:(import.c:65:import_set_state_nolock()) ffff98db83cee000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790740491.887870:0:17166:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84651f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1877727022080512:12345-0@lo:38:llog_process_th.0 Request processed in 141us (1082us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740491.887878:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1790740491.887927:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98db84652a00 x1877727022081024/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740491.887942:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84652a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877727022081024:0@lo:400:kworker.0 00000100:00100000:2.0:1790740491.887953:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84650700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022080896:0@lo:400:kworker.0 00010000:00080000:3.0:1790740491.887973:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98db84650a80 x1877727022080768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1790740491.887982:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98db84531180 x1877727022080512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790740501 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740491.887983:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84650a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727022080768:0@lo:400:kworker.0 00000100:00100000:2.0:1790740491.887990:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00100000:3.0:1790740491.887992:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84651880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022080640:0@lo:400:kworker.0 00000100:00080000:2.0:1790740491.887997:0:3637:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1790740491.888005:0:3637:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1790740491.888009:0:3637:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790740491.888012:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98db8295b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790740491.888018:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84531180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1877727022080512:0@lo:38:llog_process_th.0 00000020:01000004:2.0:1790740491.891144:0:18694:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1790740491.891170:0:18694:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff98dc9924b380) 00000020:00000080:2.0:1790740491.891194:0:18694:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1790740491.891289:0:18694:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98dc9892f000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1790740491.891293:0:18694:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98dc9892f000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1790740491.891295:0:18694:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98dc9892f000 3 00010000:00080000:2.0:1790740491.891324:0:18694:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98db83cea800@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.103@tcp at head 00010000:00010000:2.0:1790740491.897876:0:18694:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1790740491.898130:0:18694:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1790740491.898185:0:18694:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790740491.898200:0:18694:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xb25dda4f4e92eec1 00000100:00080000:2.0:1790740491.898224:0:18694:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790740491.898236:0:18694:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff98db83cea800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:2.0:1790740491.898273:0:18694:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98db84650700 x1877727022081152/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790740491.898311:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84650700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1877727022081152:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1790740491.903688:0:18694:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1790740491.907671:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790740491.907682:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790740491.907685:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790740491.907688:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790740491.907692:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790740491.907695:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790740491.907698:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790740491.907701:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1790740491.909356:0:18694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000100:00100000:2.0:1790740491.909654:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740491.909697:0:17166:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022081152 00000100:00100000:2.0:1790740491.909708:0:17166:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022081152 00000100:00100000:2.0:1790740491.909751:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790740491.909760:0:17166:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84652a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1877727022081152:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1790740491.909797:0:17166:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 563 last 0 00000020:00000080:2.0:1790740491.909850:0:17166:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xb25dda4f4e92eec8 00000004:00100000:2.0:1790740491.909871:0:17166:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790740491.909914:0:17166:0:(import.c:65:import_set_state_nolock()) ffff98db83ceb800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790740491.909972:0:17166:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84652a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1877727022081152:12345-0@lo:38:llog_process_th.0 Request processed in 212us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740491.909981:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1790740491.910062:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98db84650700 x1877727022081152/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790740501 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740491.910076:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790740491.910085:0:3637:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1790740491.910099:0:3637:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1790740491.910103:0:3637:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1790740491.910106:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98db83cea800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790740491.910112:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84650700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1877727022081152:0@lo:38:llog_process_th.0 00000020:01000000:0.0:1790740491.910400:0:18668:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1790740491.910444:0:18668:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790740491.911095:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9000/0xb25dda4f4e92ee97 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ee9e expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740491.911112:0:18668:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9000/0xb25dda4f4e92ee97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ee9e expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1790740491.911180:0:18668:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1790740491.911183:0:18668:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790740491.911185:0:18668:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790740491.911186:0:18668:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790740491.911187:0:18668:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790740491.911189:0:18668:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790740491.911190:0:18668:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790740491.911193:0:18668:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790740491.911194:0:18668:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790740491.911199:0:18668:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1790740491.911215:0:18668:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790740491.911217:0:18668:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790740491.911218:0:18668:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790740491.911219:0:18668:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790740491.911220:0:18668:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790740491.911222:0:18668:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790740491.911223:0:18668:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790740491.911224:0:18668:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790740491.911225:0:18668:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790740491.911260:0:18668:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1790740491.911285:0:18668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84530a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:18668:1877727022081280:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1790740491.911362:0:18668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740491.911415:0:18668:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb62b03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740491.912911:0:17160:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022081280 00000100:00100000:2.0:1790740491.912924:0:17160:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022081280 00000100:00100000:2.0:1790740491.912987:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790740491.912998:0:17160:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb6d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+21:18668:x1877727022081280:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1790740491.913045:0:17160:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1790740491.913061:0:17160:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1790740491.915716:0:17160:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790740491.915741:0:17160:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1790740491.915930:0:17181:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1790740491.915937:0:17181:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1790740491.915967:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98dcaeee2800/0xb25dda4f4e92eecf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740491.915988:0:17181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dcb5dc9a00/0xb25dda4f4e92ee19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92ee12 expref: 21 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740491.915996:0:17181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dcaeee2200/0xb25dda4f4e92ee27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92ee20 expref: 21 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740491.916006:0:17181:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98dcaeee2800/0xb25dda4f4e92eecf lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740491.916083:0:17181:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dcaeee2200/0xb25dda4f4e92ee27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92ee20 expref: 21 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740491.916100:0:17181:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98dcaeee2200/0xb25dda4f4e92ee27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92ee20 expref: 21 pid: 17161 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740491.916115:0:17181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84530700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17181:1877727022081408:0@lo:104: 00000100:00100000:0.0:1790740491.916182:0:17181:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790740491.916252:0:17181:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dcb5dc9a00/0xb25dda4f4e92ee19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92ee12 expref: 21 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740491.916261:0:17181:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98dcb5dc9a00/0xb25dda4f4e92ee19 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92ee12 expref: 21 pid: 17159 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740491.916270:0:17181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84531c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17181:1877727022081536:0@lo:104: 00000100:00100000:0.0:1790740491.916297:0:17181:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740491.916335:0:17181:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83dd1000 going to sleep for 11 seconds 00000100:00100000:2.0:1790740491.916447:0:17149:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1790740491.916467:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022081408 00000100:00100000:2.0:1790740491.916474:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022081408 00000100:00100000:2.0:1790740491.916511:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022081536 00000100:00100000:2.0:1790740491.916514:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022081536 00000100:00100000:2.0:1790740491.916528:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790740491.916535:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84533480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+4:17181:x1877727022081408:12345-0@lo:104: 00010000:00010000:2.0:1790740491.916549:0:17149:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff98dcbfc45200/0xb25dda4f4e92ee20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92ee27 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740491.916607:0:17149:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790740491.916612:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84533480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+4:17181:x1877727022081408:12345-0@lo:104: Request processed in 78us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740491.916627:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790740491.916714:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790740491.916721:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfd46450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+3:17181:x1877727022081536:12345-0@lo:104: 00010000:00010000:2.0:1790740491.916729:0:17149:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2c00/0xb25dda4f4e92ee12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92ee19 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740491.916765:0:17149:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790740491.916769:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfd46450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+3:17181:x1877727022081536:12345-0@lo:104: Request processed in 51us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740491.916775:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1790740491.916817:0:17155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790740491.916824:0:17155:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dcbfc45200/0xb25dda4f4e92ee20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92ee27 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740491.916831:0:17155:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc45200 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:2.0:1790740491.916835:0:17155:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dcbfc45200/0xb25dda4f4e92ee20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92ee27 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740491.916843:0:17155:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dcbfc45200/0xb25dda4f4e92ee20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92ee27 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790740491.916850:0:17155:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dcbfc45200/0xb25dda4f4e92ee20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92ee27 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740491.916856:0:17155:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790740491.916885:0:17155:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dcbfc45200/0xb25dda4f4e92ee20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92ee27 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740491.916891:0:17155:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790740491.916917:0:17155:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dcbfc45200/0xb25dda4f4e92ee20 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92ee27 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740491.916923:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dcbfc45200/0xb25dda4f4e92ee20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92ee27 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740491.916938:0:17155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790740491.916941:0:17155:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2c00/0xb25dda4f4e92ee12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92ee19 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740491.916947:0:17155:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee2c00 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:2.0:1790740491.916950:0:17155:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2c00/0xb25dda4f4e92ee12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92ee19 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740491.916956:0:17155:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2c00/0xb25dda4f4e92ee12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92ee19 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790740491.916962:0:17155:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2c00/0xb25dda4f4e92ee12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92ee19 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740491.916968:0:17155:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790740491.916981:0:17155:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2c00/0xb25dda4f4e92ee12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92ee19 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740491.916987:0:17155:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790740491.916993:0:17155:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2c00/0xb25dda4f4e92ee12 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92ee19 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740491.916999:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dcaeee2c00/0xb25dda4f4e92ee12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92ee19 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740491.917023:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740491.917025:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740491.917027:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740491.917058:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740491.917069:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84650700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3638:1877727022081664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790740491.917101:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740491.917125:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790740491.917132:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84652d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3638:1877727022081792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790740491.917154:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740491.917185:0:17152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022081664 00000100:00100000:2.0:1790740491.917189:0:17152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022081664 00010000:00010000:2.0:1790740491.917220:0:17152:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dcaeee2200/0xb25dda4f4e92ee27 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92ee20 expref: 22 pid: 17161 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740491.917242:0:17152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022081792 00000100:00100000:2.0:1790740491.917246:0:17152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022081792 00010000:00010000:2.0:1790740491.917257:0:17152:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dcb5dc9a00/0xb25dda4f4e92ee19 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92ee12 expref: 23 pid: 17159 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740491.917270:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790740491.917276:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84652300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+23:3638:x1877727022081664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790740491.917286:0:17152:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740491.917291:0:17152:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dcaeee2200/0xb25dda4f4e92ee27 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92ee20 expref: 23 pid: 17161 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740491.917300:0:17152:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dcaeee2200/0xb25dda4f4e92ee27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92ee20 expref: 23 pid: 17161 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740491.917323:0:17152:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740491.917348:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84652300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+23:3638:x1877727022081664:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740491.917355:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790740491.917369:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790740491.917374:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db829b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+22:3638:x1877727022081792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790740491.917381:0:17152:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740491.917385:0:17152:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dcb5dc9a00/0xb25dda4f4e92ee19 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92ee12 expref: 22 pid: 17159 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740491.917395:0:17152:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dcb5dc9a00/0xb25dda4f4e92ee19 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92ee12 expref: 22 pid: 17159 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740491.917406:0:17152:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98dcaeee2800/0xb25dda4f4e92eecf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740491.917414:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcaeee2800/0xb25dda4f4e92eecf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790740491.917429:0:17152:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007507663s 00010000:00010000:2.0:1790740491.917433:0:17152:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98dcaeee2800/0xb25dda4f4e92eecf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740491.917441:0:17152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98dcaeee2800/0xb25dda4f4e92eecf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740491.917449:0:17152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98dcaeee2800/0xb25dda4f4e92eecf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740491.917465:0:17152:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98dcaeee2800/0xb25dda4f4e92eecf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740491.917471:0:17152:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee2800 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:2.0:1790740491.917475:0:17152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98dcaeee2800/0xb25dda4f4e92eecf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740491.917482:0:17152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98dcaeee2800/0xb25dda4f4e92eecf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740491.917491:0:17152:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98dcaeee2800/0xb25dda4f4e92eecf lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740491.917500:0:17152:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740491.917522:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db829b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+22:3638:x1877727022081792:12345-0@lo:103:ldlm_bl.0 Request processed in 148us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740491.917529:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790740491.917594:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84652d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3638:1877727022081792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790740491.917602:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84650700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3638:1877727022081664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790740491.917807:0:17160:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb6d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+21:18668:x1877727022081280:12345-0@lo:253:mount.lustre.0 Request processed in 4810us (6443us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740491.917816:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1790740491.917857:0:18668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84530a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:18668:1877727022081280:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1790740491.917869:0:18668:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1790740491.917872:0:18668:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790740491.917874:0:18668:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790740491.917875:0:18668:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790740491.917877:0:18668:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790740491.917878:0:18668:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790740491.917879:0:18668:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790740491.917881:0:18668:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790740491.917883:0:18668:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790740491.917885:0:18668:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1790740491.917895:0:18668:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1790740491.920782:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcaeee2200/0xb25dda4f4e92ee27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92ee20 expref: 20 pid: 17161 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740491.920803:0:17181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84530700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17181:1877727022081408:0@lo:104: 00010000:00010000:2.0:1790740491.920817:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcb5dc9a00/0xb25dda4f4e92ee19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92ee12 expref: 19 pid: 17159 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740491.920825:0:17181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84531c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17181:1877727022081536:0@lo:104: 00010000:00010000:2.0:1790740491.920862:0:17181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98dcaeee2800/0xb25dda4f4e92eecf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740491.920872:0:17181:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98dcaeee2800/0xb25dda4f4e92eecf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740491.920879:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98dcaeee2800/0xb25dda4f4e92eecf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740491.920885:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcaeee2800/0xb25dda4f4e92eecf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1790740491.943521:0:18668:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1790740491.947924:0:18668:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1790740491.947936:0:18668:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1790740491.947972:0:18668:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1790740491.948027:0:18668:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.103@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1790740491.948440:0:18668:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1790740491.948471:0:18668:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1790740491.949377:0:18668:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790740491.949617:0:18668:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790740492.458396:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1790740493.022610:0:18749:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790740493.022841:0:18749:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:3.0:1790740493.427185:0:17163:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790740493.427193:0:17163:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98dcae18b800 from 9 10000000:01000000:3.0:1790740493.427198:0:17163:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790740493.427249:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9a00/0xb25dda4f4e92eed6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740493.427273:0:17163:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9a00/0xb25dda4f4e92eed6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740493.427285:0:17163:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9a00/0xb25dda4f4e92eed6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740493.427326:0:17163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc884b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022081920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790740493.427405:0:17163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740493.427467:0:17163:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82c75840 going to sleep for 11 seconds 00000100:00100000:1.0:1790740493.427583:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022081920 00000100:00100000:1.0:1790740493.427591:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022081920 00000100:00100000:1.0:1790740493.427834:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1790740493.427844:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb6d1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+19:17163:x1877727022081920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790740493.427857:0:17161:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740493.427872:0:17161:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcbfc44600/0xb25dda4f4e92eedd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92eed6 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740493.427908:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcbfc44600/0xb25dda4f4e92eedd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92eed6 expref: 20 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740493.427918:0:17161:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcbfc44600/0xb25dda4f4e92eedd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92eed6 expref: 20 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740493.427927:0:17161:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcbfc44600, rc 0) 00000100:00100000:1.0:1790740493.427981:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb6d1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+20:17163:x1877727022081920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740493.427988:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1790740493.429928:0:17163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc884b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022081920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790740493.429958:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9a00/0xb25dda4f4e92eed6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92eedd expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740493.429971:0:17163:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9a00/0xb25dda4f4e92eed6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92eedd expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740493.430104:0:17163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc884b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022082048:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1790740493.430170:0:17163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740493.430221:0:17163:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82c75840 going to sleep for 11 seconds 00000100:00100000:2.0:1790740493.430302:0:17160:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022082048 00000100:00100000:2.0:1790740493.430310:0:17160:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022082048 00000100:00100000:2.0:1790740493.430365:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1790740493.430374:0:17160:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb6d1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+20:17163:x1877727022082048:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1790740493.430399:0:17160:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790740493.430420:0:17160:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790740493.430423:0:17160:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1790740493.430512:0:17160:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb6d1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+20:17163:x1877727022082048:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 139us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740493.430521:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1790740493.430574:0:17163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc884b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022082048:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1790740493.430770:0:17163:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790740493.430778:0:17163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9a00/0xb25dda4f4e92eed6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92eedd expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740493.430797:0:17163:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9a00/0xb25dda4f4e92eed6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92eedd expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740493.430818:0:17163:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790740493.430821:0:17163:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98db84771800 from 9 10000000:01000000:2.0:1790740493.430824:0:17163:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790740493.430851:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98db83f33600/0xb25dda4f4e92eee4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740493.430859:0:17163:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98db83f33600/0xb25dda4f4e92eee4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740493.430868:0:17163:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98db83f33600/0xb25dda4f4e92eee4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740493.430884:0:17163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84650700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022082176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790740493.430912:0:17163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740493.430935:0:17163:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc86fb9240 going to sleep for 11 seconds 00000100:00100000:2.0:1790740493.430949:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022082176 00000100:00100000:2.0:1790740493.430953:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022082176 00000100:00100000:2.0:1790740493.430978:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1790740493.430984:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb6d1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+20:17163:x1877727022082176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790740493.430993:0:17159:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740493.431005:0:17159:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98db83f33400/0xb25dda4f4e92eeeb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92eee4 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740493.431026:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98db83f33400/0xb25dda4f4e92eeeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92eee4 expref: 21 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740493.431063:0:17159:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98db83f33400/0xb25dda4f4e92eeeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92eee4 expref: 21 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740493.431081:0:17159:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f33400, rc 0) 00000100:00100000:2.0:1790740493.431111:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb6d1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+21:17163:x1877727022082176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740493.431118:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1790740493.431148:0:17163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84650700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022082176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790740493.431158:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98db83f33600/0xb25dda4f4e92eee4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92eeeb expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740493.431165:0:17163:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98db83f33600/0xb25dda4f4e92eee4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92eeeb expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740493.431214:0:17163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84650700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022082304:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1790740493.431241:0:17163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740493.431258:0:17163:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc86fb9240 going to sleep for 11 seconds 00000100:00100000:2.0:1790740493.431268:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022082304 00000100:00100000:2.0:1790740493.431271:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022082304 00000100:00100000:2.0:1790740493.431289:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1790740493.431294:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb6d1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+21:17163:x1877727022082304:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1790740493.431303:0:17159:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790740493.431314:0:17159:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790740493.431317:0:17159:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1790740493.431376:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb6d1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+21:17163:x1877727022082304:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 81us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740493.431382:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1790740493.431408:0:17163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84650700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022082304:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1790740493.431453:0:17163:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790740493.431459:0:17163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98db83f33600/0xb25dda4f4e92eee4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92eeeb expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740493.431466:0:17163:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98db83f33600/0xb25dda4f4e92eee4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92eeeb expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740493.488065:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740494.442956:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc884b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022082432:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790740494.443058:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740494.443166:0:17171:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022082432 00000100:00100000:3.0:1790740494.443175:0:17171:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022082432 00000100:00100000:3.0:1790740494.443234:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790740494.443246:0:17171:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022082432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790740494.443287:0:17171:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1790740494.443341:0:17171:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022082432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740494.443365:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790740494.443419:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc884b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022082432:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1790740494.519335:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740494.954775:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790740494.954999:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc884b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022082560:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790740494.956727:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740494.956812:0:17907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022082560 00000100:00100000:3.0:1790740494.956820:0:17907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022082560 00000100:00100000:3.0:1790740494.956867:0:17907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790740494.956878:0:17907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc884b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727022082560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790740494.956918:0:17907:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1790740494.956968:0:17907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc884b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727022082560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740494.956976:0:17907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790740494.957045:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc884b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022082560:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1790740495.531559:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740496.554809:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790740496.748219:0:17922:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:3.0:1790740497.002637:0:15342:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790740497.002644:0:15342:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790740497.002646:0:15342:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790740497.002650:0:15342:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790740497.002672:0:15342:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790740497.002674:0:15342:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790740497.002677:0:15342:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790740497.002685:0:15342:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790740497.002740:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc884b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022082816:0@lo:400:kworker.0 00000100:00100000:3.0:1790740497.002824:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740497.002870:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc884b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1877727022083328:0@lo:400:kworker.0 00000100:00100000:3.0:1790740497.002899:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740497.002924:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1790740497.002930:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc884b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3639:1877727022082688:0@lo:400:kworker.0 00000100:00100000:3.0:1790740497.002957:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740497.002978:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc884b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877727022083200:0@lo:400:kworker.0 00000100:00100000:3.0:1790740497.002999:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740497.003023:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc884b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877727022082944:0@lo:400:kworker.0 00000100:00100000:3.0:1790740497.003064:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740497.003082:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc884b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1877727022083456:0@lo:400:kworker.0 00000100:00100000:3.0:1790740497.003116:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740497.003128:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790740497.003133:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc884b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022083072:0@lo:400:kworker.0 00000100:00100000:3.0:1790740497.003153:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740497.003189:0:17170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022082816 00000100:00100000:3.0:1790740497.003197:0:17170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022082816 00000100:00100000:3.0:1790740497.003236:0:17170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022083072 00000100:00100000:3.0:1790740497.003239:0:17170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022083072 00000100:00100000:3.0:1790740497.003254:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790740497.003262:0:17170:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc884b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022082816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740497.003460:0:17170:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc884b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022082816:12345-0@lo:400:kworker.0 Request processed in 198us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740497.003478:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790740497.003501:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790740497.003507:0:17170:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc884b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022083072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740497.003610:0:17170:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc884b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022083072:12345-0@lo:400:kworker.0 Request processed in 103us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740497.003617:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790740497.003647:0:17167:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022083328 00000100:00100000:3.0:1790740497.003652:0:17167:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022083328 00000100:00100000:3.0:1790740497.003679:0:17167:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022083200 00000100:00100000:3.0:1790740497.003682:0:17167:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022083200 00000100:00100000:3.0:1790740497.003691:0:17167:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022082944 00000100:00100000:3.0:1790740497.003693:0:17167:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022082944 00000100:00100000:3.0:1790740497.003701:0:17167:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022083456 00000100:00100000:3.0:1790740497.003703:0:17167:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022083456 00000100:00100000:3.0:1790740497.003716:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790740497.003722:0:17167:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc884b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1877727022083328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740497.003751:0:17167:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc884b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1877727022083328:12345-0@lo:400:kworker.0 Request processed in 29us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740497.003757:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790740497.003769:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790740497.003774:0:17167:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc884b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877727022083200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740497.003799:0:17167:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc884b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877727022083200:12345-0@lo:400:kworker.0 Request processed in 25us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740497.003805:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790740497.003815:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790740497.003820:0:17167:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc884b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877727022082944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740497.003859:0:17167:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc884b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877727022082944:12345-0@lo:400:kworker.0 Request processed in 38us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740497.003865:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790740497.003879:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790740497.003884:0:17167:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc884b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877727022083456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740497.003909:0:17167:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc884b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877727022083456:12345-0@lo:400:kworker.0 Request processed in 25us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740497.003915:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790740497.003932:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022082688 00000100:00100000:3.0:1790740497.003936:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022082688 00000100:00100000:3.0:1790740497.003959:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1790740497.003964:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb6d1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+21:3639:x1877727022082688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740497.003993:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb6d1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+21:3639:x1877727022082688:12345-0@lo:400:kworker.0 Request processed in 29us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740497.004000:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:3.0:1790740497.004069:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790740497.004073:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790740497.004101:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc884b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3639:1877727022082688:0@lo:400:kworker.0 00010000:00080000:3.0:1790740497.004126:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98dc884b1180 x1877727022083200/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740497.004137:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc884b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877727022083200:0@lo:400:kworker.0 00000100:00100000:3.0:1790740497.004148:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc884b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022082816:0@lo:400:kworker.0 00010000:00080000:3.0:1790740497.004157:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98dc884b2d80 x1877727022083328/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740497.004179:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc884b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1877727022083328:0@lo:400:kworker.0 00000100:00100000:0.0:1790740497.004442:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc884b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022083072:0@lo:400:kworker.0 00010000:00080000:0.0:1790740497.004453:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98dc884b3100 x1877727022082944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740497.004460:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc884b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877727022082944:0@lo:400:kworker.0 00010000:00080000:0.0:1790740497.004474:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98dc884b0a80 x1877727022083456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740497.004482:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc884b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1877727022083456:0@lo:400:kworker.0 00010000:00010000:3.0:1790740497.582143:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740498.606803:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790740498.950677:0:19038:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg403-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1790740499.117272:0:3637:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790740484/real 1790740484] req@ffff98db84533800 x1877727022076288/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790740499 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740499.117311:0:3637:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98db84533800 x1877727022076288/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790740499 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740499.117320:0:3637:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790740484/real 1790740484] req@ffff98db84530000 x1877727022076416/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790740499 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740499.117332:0:3637:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98db84530000 x1877727022076416/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790740499 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790740499.117354:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98dcb5dda800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790740499.117383:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790740499.117387:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84533800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877727022076288:0@lo:8:kworker.0 00000100:00080000:0.0:1790740499.117393:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98dc88508000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790740499.117397:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790740499.117400:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84530000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877727022076416:0@lo:8:kworker.0 00000100:00080000:3.0:1790740499.117617:0:15342:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790740499.117623:0:15342:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790740499.117626:0:15342:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790740499.117629:0:15342:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790740499.117649:0:15342:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1790740499.117650:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc884b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3641:1877727022083584:0@lo:400:kworker.0 00000100:00080000:3.0:1790740499.117655:0:15342:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1790740499.117661:0:15342:0:(import.c:65:import_set_state_nolock()) ffff98dcb5dda800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790740499.117666:0:15342:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 556 00000100:00080000:3.0:1790740499.117671:0:15342:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1790740499.117682:0:15342:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff98dcb5dda800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:3.0:1790740499.117704:0:15342:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98dc884b1500 x1877727022084096/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790740499.117721:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790740499.117735:0:15342:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790740499.117740:0:15342:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790740499.117743:0:15342:0:(import.c:65:import_set_state_nolock()) ffff98dc88508000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790740499.117747:0:15342:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 556 00000100:00080000:3.0:1790740499.117750:0:15342:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1790740499.117756:0:15342:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff98dc88508000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:0.0:1790740499.117766:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790740499.117773:0:15342:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98dc884b0a80 x1877727022084224/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790740499.117775:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc884b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022083968:0@lo:400:kworker.0 00000100:00100000:0.0:1790740499.117802:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740499.117828:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc884b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877727022084352:0@lo:400:kworker.0 00000100:00100000:3.0:1790740499.117850:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc884b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022083712:0@lo:400:kworker.0 00000100:00100000:0.0:1790740499.117859:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740499.117906:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740499.117936:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc884b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877727022084480:0@lo:400:kworker.0 00000100:00100000:3.0:1790740499.117957:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740499.117975:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1790740499.117980:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc884b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727022083840:0@lo:400:kworker.0 00000100:00100000:3.0:1790740499.118002:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740499.118022:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1877727022084608:0@lo:400:kworker.0 00000100:00100000:3.0:1790740499.118091:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740499.118123:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022083584 00000100:00100000:3.0:1790740499.118132:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022083584 00000100:00100000:3.0:1790740499.118176:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1790740499.118185:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb6d1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+21:3641:x1877727022083584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740499.118232:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb6d1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+21:3641:x1877727022083584:12345-0@lo:400:kworker.0 Request processed in 47us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740499.118242:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1790740499.118283:0:17170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022083968 00000100:00100000:3.0:1790740499.118287:0:17170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022083968 00000100:00100000:3.0:1790740499.118314:0:17170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022083712 00000100:00100000:3.0:1790740499.118317:0:17170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022083712 00000100:00100000:3.0:1790740499.118332:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790740499.118339:0:17170:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022083968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740499.118377:0:17170:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022083968:12345-0@lo:400:kworker.0 Request processed in 38us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740499.118383:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790740499.118404:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790740499.118410:0:17170:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022083712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740499.118451:0:17170:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022083712:12345-0@lo:400:kworker.0 Request processed in 41us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740499.118456:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790740499.118475:0:17167:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022084352 00000100:00100000:3.0:1790740499.118478:0:17167:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022084352 00000100:00100000:3.0:1790740499.118495:0:17167:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022084480 00000100:00100000:3.0:1790740499.118497:0:17167:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022084480 00000100:00100000:3.0:1790740499.118516:0:17167:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022083840 00000100:00100000:3.0:1790740499.118518:0:17167:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022083840 00000100:00100000:3.0:1790740499.118527:0:17167:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022084608 00000100:00100000:3.0:1790740499.118528:0:17167:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022084608 00000100:00100000:3.0:1790740499.118541:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790740499.118546:0:17167:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877727022084352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740499.118576:0:17167:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877727022084352:12345-0@lo:400:kworker.0 Request processed in 30us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740499.118582:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790740499.118594:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790740499.118600:0:17167:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877727022084480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740499.118624:0:17167:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877727022084480:12345-0@lo:400:kworker.0 Request processed in 25us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740499.118628:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790740499.118638:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790740499.118642:0:17167:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727022083840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740499.118663:0:17167:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727022083840:12345-0@lo:400:kworker.0 Request processed in 21us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740499.118678:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790740499.118690:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790740499.118696:0:17167:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877727022084608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740499.118723:0:17167:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877727022084608:12345-0@lo:400:kworker.0 Request processed in 28us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740499.118729:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1790740499.118760:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790740499.118764:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790740499.118776:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc884b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877727022084096:0@lo:8:kworker.0 00000100:00100000:3.0:1790740499.118814:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740499.118847:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dc884b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877727022084224:0@lo:8:kworker.0 00000100:00100000:3.0:1790740499.118875:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740499.118924:0:18673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022084096 00000100:00100000:3.0:1790740499.118929:0:18673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022084096 00000100:00100000:3.0:1790740499.118948:0:18673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022084224 00000100:00100000:3.0:1790740499.118951:0:18673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022084224 00000100:00100000:3.0:1790740499.118962:0:18673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790740499.118967:0:18673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1877727022084096:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1790740499.118991:0:18673:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 570 last 0 00000020:00000080:3.0:1790740499.119018:0:18673:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb25dda4f4e92eef2 00002000:00100000:3.0:1790740499.119078:0:18673:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff98dc97c71800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b03 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1790740499.119084:0:18673:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1790740499.119088:0:18673:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1790740499.119249:0:18673:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1790740499.119272:0:18673:0:(import.c:65:import_set_state_nolock()) ffff98dc97c76800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790740499.119312:0:18673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3637:x1877727022084096:12345-0@lo:8:kworker.0 Request processed in 344us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740499.119324:0:18673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790740499.119339:0:18673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790740499.119343:0:18673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1877727022084224:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1790740499.119354:0:18673:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:0.0:1790740499.120580:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98dc884b3100 x1877727022084352/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740499.120613:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc884b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877727022084352:0@lo:400:kworker.0 00000100:00100000:0.0:1790740499.120645:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc884b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022083968:0@lo:400:kworker.0 00000100:00100000:0.0:1790740499.120657:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc884b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3641:1877727022083584:0@lo:400:kworker.0 00010000:00080000:2.0:1790740499.149501:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98dc884b1180 x1877727022083840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740499.149522:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc884b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727022083840:0@lo:400:kworker.0 00010000:00080000:2.0:1790740499.149538:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98db83cc5180 x1877727022084608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740499.149546:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1877727022084608:0@lo:400:kworker.0 00000100:00100000:2.0:1790740499.149558:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc884b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022083712:0@lo:400:kworker.0 00010000:00080000:2.0:1790740499.149568:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98dc884b3800 x1877727022084480/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740499.149575:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc884b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877727022084480:0@lo:400:kworker.0 00010000:00080000:3.0:1790740499.150803:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98dc884b1500 x1877727022084096/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790740519 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740499.150816:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790740499.150825:0:3637:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1790740499.150834:0:3637:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1790740499.150842:0:3637:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1790740499.150845:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98dcb5dda800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1790740499.150873:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1790740499.150880:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc884b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877727022084096:0@lo:8:kworker.0 00000100:00100000:3.0:1790740499.151342:0:18673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1877727022084224:12345-0@lo:8:kworker.0 Request processed in 31995us (32464us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790740499.151354:0:18673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1790740499.151394:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98dc88508000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790740499.151400:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790740499.151403:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dc884b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877727022084224:0@lo:8:kworker.0 00000004:00080000:2.0:1790740499.152051:0:17909:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1790740499.152088:0:17909:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84652d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17909:1877727022084864:0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1790740499.152147:0:17909:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740499.152172:0:17909:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5c9c240 going to sleep for 11 seconds 00000100:00100000:2.0:1790740499.152191:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790740499.152201:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84650700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022084736:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790740499.152227:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740499.152260:0:18674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022084864 00000100:00100000:2.0:1790740499.152268:0:18674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022084864 00000100:00100000:2.0:1790740499.152311:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790740499.152319:0:18674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84652300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17909:x1877727022084864:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1790740499.152545:0:18676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022084736 00000100:00100000:2.0:1790740499.152550:0:18676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022084736 00000100:00100000:2.0:1790740499.152573:0:18676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790740499.152578:0:18676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84653800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3641:x1877727022084736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790740499.152595:0:18676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1790740499.152636:0:18676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84653800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3641:x1877727022084736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740499.152642:0:18676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1790740499.152675:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98db84650700 x1877727022084736/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740515 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740499.152690:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84650700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022084736:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1790740499.154146:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1790740499.155784:0:17908:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1790740499.155905:0:17908:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 570441873218ns, next at 0ns, rc = 0 00080000:00080000:1.0:1790740499.155913:0:17908:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:3.0:1790740499.166282:0:17899:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:2.0:1790740499.166533:0:18674:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1790740499.166541:0:18674:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1790740499.166693:0:18674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84652300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17909:x1877727022084864:12345-0@lo:7:osp-pre-0-1.0 Request processed in 14369us (14540us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740499.166705:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1790740499.166788:0:17909:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98db84652d80 x1877727022084864/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790740515 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740499.166803:0:17909:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84652d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17909:1877727022084864:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1790740499.166835:0:17909:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:3.0:1790740499.166877:0:17909:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17909:1877727022084992:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1790740499.166914:0:17909:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740499.166978:0:17909:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc84ca2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740499.167012:0:18673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022084992 00000100:00100000:2.0:1790740499.167019:0:18673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022084992 00000100:00100000:3.0:1790740499.167316:0:18673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790740499.167637:0:18673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17909:x1877727022084992:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1790740499.167666:0:18673:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1790740499.167755:0:18673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17909:x1877727022084992:12345-0@lo:5:osp-pre-0-1.0 Request processed in 430us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740499.167762:0:18673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1790740499.167852:0:17909:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98db83cc4700 x1877727022084992/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790740515 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740499.167876:0:17909:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17909:1877727022084992:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1790740499.167885:0:17909:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1790740499.167915:0:17909:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84650700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17909:1877727022085120:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1790740499.167940:0:17909:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740499.167995:0:17909:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5c9c240 going to sleep for 11 seconds 00000100:00100000:3.0:1790740499.168855:0:18674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022085120 00000100:00100000:3.0:1790740499.168866:0:18674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022085120 00000100:00100000:3.0:1790740499.168950:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790740499.168960:0:18674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84652d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17909:x1877727022085120:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1790740499.168997:0:18674:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:2.0:1790740499.212642:0:18669:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1790740499.212657:0:18669:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1790740499.213000:0:18674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84652d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:17909:x1877727022085120:12345-0@lo:5:osp-pre-0-1.0 Request processed in 44037us (45053us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1790740499.213046:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1790740499.213290:0:17909:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98db84650700 x1877727022085120/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790740515 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740499.213302:0:17909:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1790740499.213309:0:17909:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84650700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17909:1877727022085120:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1790740499.213324:0:17909:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:2.0:1790740499.213377:0:17909:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84650700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17909:1877727022085248:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1790740499.213416:0:17909:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740499.213449:0:17909:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5c9c240 going to sleep for 11 seconds 00000100:00100000:0.0:1790740499.214394:0:17177:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022085248 00000100:00100000:0.0:1790740499.214404:0:17177:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022085248 00000100:00100000:0.0:1790740499.214464:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790740499.214474:0:17177:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84651880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17909:x1877727022085248:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1790740499.214547:0:17177:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84651880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17909:x1877727022085248:12345-0@lo:900:osp-pre-0-1.0 Request processed in 74us (1131us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740499.214555:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1790740499.214599:0:17909:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98db84650700 x1877727022085248/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790740515 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740499.214610:0:17909:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84650700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17909:1877727022085248:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1790740499.562393:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022085376:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790740499.562481:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740499.562620:0:17170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022085376 00000100:00100000:3.0:1790740499.562628:0:17170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022085376 00000100:00100000:3.0:1790740499.562683:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790740499.562693:0:17170:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84650a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022085376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790740499.562726:0:17170:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1790740499.562777:0:17170:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84650a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022085376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740499.562783:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790740499.563053:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022085376:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1790740499.626396:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1790740500.005986:0:19090:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790740500.006431:0:19090:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:1.0:1790740500.010754:0:17201:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790740500.076481:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790740500.076505:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84525c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022085504:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790740500.076574:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740500.076623:0:17907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022085504 00000100:00100000:1.0:1790740500.076631:0:17907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022085504 00000100:00100000:1.0:1790740500.076677:0:17907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790740500.076686:0:17907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022085504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790740500.076719:0:17907:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1790740500.076765:0:17907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022085504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740500.076773:0:17907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790740500.076819:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84525c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022085504:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1790740500.651250:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1790740500.971728:0:19141:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790740500.972462:0:19141:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1790740501.170009:0:3637:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790740481/real 1790740481] req@ffff98dcbfe2d500 x1877727022074624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790740501 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740501.170073:0:3637:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98dcbfe2d500 x1877727022074624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790740501 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740501.170088:0:3637:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790740481/real 1790740481] req@ffff98dcbfe2c000 x1877727022074496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790740501 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740501.170120:0:3637:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98dcbfe2c000 x1877727022074496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790740501 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790740501.170140:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98dcaeddd000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790740501.170160:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790740501.170165:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877727022074624:0@lo:8:kworker.0 00000100:00080000:0.0:1790740501.170171:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98dc856aa800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790740501.170177:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790740501.170180:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877727022074496:0@lo:8:kworker.0 00000100:00080000:0.0:1790740501.170271:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790740501.170276:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1790740501.170278:0:36:0:(import.c:65:import_set_state_nolock()) ffff98dc856aa800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790740501.170283:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 552 00000100:00080000:0.0:1790740501.170289:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1790740501.170299:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98dc856aa800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:0.0:1790740501.170319:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98db84533100 x1877727022085888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790740501.170330:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790740501.170333:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790740501.170335:0:36:0:(import.c:65:import_set_state_nolock()) ffff98dcaeddd000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790740501.170338:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 552 00000100:00080000:0.0:1790740501.170341:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1790740501.170345:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98dcaeddd000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:0.0:1790740501.170356:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98db84531500 x1877727022086016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790740501.170401:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790740501.170405:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790740501.170407:0:36:0:(import.c:65:import_set_state_nolock()) ffff98dc88508000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790740501.170411:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 570 00000100:00080000:0.0:1790740501.170413:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1790740501.170418:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff98dc88508000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:0.0:1790740501.170430:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98db84531880 x1877727022086528/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790740501.170477:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3639:1877727022085632:0@lo:400:kworker.0 00000100:00100000:0.0:1790740501.170541:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740501.170579:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84531f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022086400:0@lo:400:kworker.0 00000100:00100000:0.0:1790740501.170606:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740501.170629:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1790740501.170635:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84532680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022086272:0@lo:400:kworker.0 00000100:00100000:0.0:1790740501.170660:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740501.170676:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1877727022086912:0@lo:400:kworker.0 00000100:00100000:0.0:1790740501.170780:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740501.170816:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84532d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022085760:0@lo:400:kworker.0 00000100:00100000:0.0:1790740501.170842:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740501.170868:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84530380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877727022086656:0@lo:400:kworker.0 00000100:00100000:0.0:1790740501.170889:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740501.170909:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1790740501.170915:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84532a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877727022086144:0@lo:400:kworker.0 00000100:00100000:0.0:1790740501.170949:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740501.170966:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1877727022086784:0@lo:400:kworker.0 00000100:00100000:0.0:1790740501.171010:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740501.171061:0:17160:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022085632 00000100:00100000:0.0:1790740501.171069:0:17160:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022085632 00000100:00100000:0.0:1790740501.171117:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1790740501.171126:0:17160:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb6d1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+21:3639:x1877727022085632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740501.171179:0:17160:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb6d1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+21:3639:x1877727022085632:12345-0@lo:400:kworker.0 Request processed in 54us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740501.171186:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1790740501.171221:0:18675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022086400 00000100:00100000:0.0:1790740501.171224:0:18675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022086400 00000100:00100000:0.0:1790740501.171265:0:18675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790740501.171272:0:18675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022086400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740501.171306:0:18675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022086400:12345-0@lo:400:kworker.0 Request processed in 34us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740501.171311:0:18675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790740501.171329:0:17167:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022086912 00000100:00100000:0.0:1790740501.171333:0:17167:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022086912 00000100:00100000:0.0:1790740501.171351:0:17167:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022086656 00000100:00100000:0.0:1790740501.171354:0:17167:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022086656 00000100:00100000:0.0:1790740501.171364:0:17167:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022086144 00000100:00100000:0.0:1790740501.171367:0:17167:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022086144 00000100:00100000:0.0:1790740501.171375:0:17167:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022086784 00000100:00100000:0.0:1790740501.171377:0:17167:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022086784 00000100:00100000:0.0:1790740501.171390:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790740501.171396:0:17167:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc884b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877727022086912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740501.171429:0:17167:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc884b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877727022086912:12345-0@lo:400:kworker.0 Request processed in 33us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740501.171444:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790740501.171457:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790740501.171462:0:17167:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc884b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877727022086656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740501.171498:0:17167:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc884b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877727022086656:12345-0@lo:400:kworker.0 Request processed in 36us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740501.171503:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790740501.171514:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790740501.171520:0:17167:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc884b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877727022086144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740501.171546:0:17167:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc884b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877727022086144:12345-0@lo:400:kworker.0 Request processed in 27us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740501.171551:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790740501.171561:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790740501.171566:0:17167:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc884b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877727022086784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740501.171591:0:17167:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc884b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877727022086784:12345-0@lo:400:kworker.0 Request processed in 26us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740501.171597:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1790740501.171622:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790740501.171626:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790740501.171629:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790740501.171639:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84533100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877727022085888:0@lo:8:kworker.0 00000100:00100000:0.0:1790740501.171664:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740501.171681:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877727022086016:0@lo:8:kworker.0 00000100:00100000:1.0:1790740501.171928:0:17907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022086272 00000100:00100000:1.0:1790740501.171933:0:17907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022086272 00000100:00100000:1.0:1790740501.171964:0:17907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022085760 00000100:00100000:1.0:1790740501.171967:0:17907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022085760 00000100:00100000:1.0:1790740501.171981:0:17907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790740501.171987:0:17907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022086272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740501.172059:0:17907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022086272:12345-0@lo:400:kworker.0 Request processed in 71us (1397us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740501.172065:0:17907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790740501.172079:0:17907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790740501.172084:0:17907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc884b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727022085760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740501.172113:0:17907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc884b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727022085760:12345-0@lo:400:kworker.0 Request processed in 30us (1271us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740501.172118:0:17907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790740501.172774:0:18673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022085888 00000100:00100000:2.0:1790740501.172783:0:18673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022085888 00000100:00100000:2.0:1790740501.172826:0:18673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790740501.172833:0:18673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc884b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1877727022085888:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1790740501.172873:0:18673:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 572 last 0 00000020:00000080:2.0:1790740501.172905:0:18673:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb25dda4f4e92eef9 00002000:00100000:2.0:1790740501.172920:0:18673:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff98dc98835000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b03 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1790740501.172924:0:18673:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1790740501.172927:0:18673:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1790740501.173004:0:18673:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790740501.173057:0:18673:0:(import.c:65:import_set_state_nolock()) ffff98db83ce9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790740501.173108:0:18673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc884b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3637:x1877727022085888:12345-0@lo:8:kworker.0 Request processed in 274us (1442us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740501.173115:0:18673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790740501.173567:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740501.173611:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84531880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877727022086528:0@lo:8:kworker.0 00000100:00100000:0.0:1790740501.173639:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1790740501.173761:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98db84533100 x1877727022085888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790740526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740501.173773:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790740501.173780:0:3637:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1790740501.173787:0:3637:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1790740501.173792:0:3637:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1790740501.173795:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98dc856aa800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1790740501.173812:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1790740501.173818:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84533100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877727022085888:0@lo:8:kworker.0 00000100:00100000:1.0:1790740501.177221:0:18675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022086016 00000100:00100000:1.0:1790740501.177250:0:18675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022086016 00000100:00100000:1.0:1790740501.177282:0:18675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022086528 00000100:00100000:1.0:1790740501.177285:0:18675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022086528 00000100:00100000:1.0:1790740501.177300:0:18675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790740501.177308:0:18675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc884b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3637:x1877727022086016:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1790740501.177334:0:18675:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1790740501.177430:0:18675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc884b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3637:x1877727022086016:12345-0@lo:8:kworker.0 Request processed in 121us (3863us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790740501.177437:0:18675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790740501.177456:0:18675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790740501.177476:0:18675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc884b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3637:x1877727022086528:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1790740501.177486:0:18675:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1790740501.177515:0:18675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc884b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3637:x1877727022086528:12345-0@lo:8:kworker.0 Request processed in 38us (3875us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790740501.177521:0:18675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000004:00080000:1.0:1790740501.177547:0:17189:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1790740501.177639:0:17189:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 572463607377ns, next at 0ns, rc = 0 00080000:00080000:1.0:1790740501.177646:0:17189:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1790740501.182927:0:17190:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:2.0:1790740501.182962:0:17190:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17190:1877727022087168:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1790740501.183141:0:17190:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740501.183178:0:17190:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82c75600 going to sleep for 11 seconds 00000100:00100000:2.0:1790740501.183194:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790740501.183206:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84650700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022087040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790740501.183232:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740501.183259:0:18676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022087040 00000100:00100000:2.0:1790740501.183268:0:18676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022087040 00000100:00100000:2.0:1790740501.183329:0:18676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790740501.183338:0:18676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1877727022087040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790740501.183366:0:18676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1790740501.183414:0:18676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1877727022087040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740501.183420:0:18676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790740501.183460:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98db84650700 x1877727022087040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740517 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740501.183487:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84650700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022087040:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790740501.183509:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790740501.183520:0:18675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022087168 00000100:00100000:2.0:1790740501.183523:0:18675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022087168 00000100:00100000:2.0:1790740501.183545:0:18675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790740501.183551:0:18675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17190:x1877727022087168:12345-0@lo:5:osp-pre-0-0.0 00010000:00080000:0.0:1790740501.184349:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98db84532a00 x1877727022086144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740501.184362:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84532a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877727022086144:0@lo:400:kworker.0 00010000:00080000:0.0:1790740501.184377:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98db84531c00 x1877727022086784/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740501.184385:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1877727022086784:0@lo:400:kworker.0 00000100:00100000:0.0:1790740501.184399:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84532d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022085760:0@lo:400:kworker.0 00010000:00080000:0.0:1790740501.184412:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98db84530380 x1877727022086656/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740501.184420:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84530380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877727022086656:0@lo:400:kworker.0 00000100:00100000:0.0:1790740501.184464:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84532680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022086272:0@lo:400:kworker.0 00010000:00080000:0.0:1790740501.184477:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98db84530700 x1877727022086912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740501.184486:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1877727022086912:0@lo:400:kworker.0 00000100:00100000:0.0:1790740501.184510:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3639:1877727022085632:0@lo:400:kworker.0 00010000:00080000:0.0:1790740501.184538:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98db84531f80 x1877727022086400/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740501.184546:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84531f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022086400:0@lo:400:kworker.0 00000100:00080000:0.0:1790740501.184579:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98dcaeddd000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790740501.184585:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790740501.184588:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877727022086016:0@lo:8:kworker.0 00000100:00080000:0.0:1790740501.184599:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98dc88508000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790740501.184602:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790740501.184604:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84531880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877727022086528:0@lo:8:kworker.0 00000004:00080000:1.0:1790740501.184820:0:17146:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:0.0:1790740501.192380:0:18675:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1790740501.192392:0:18675:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1790740501.192398:0:18675:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00002000:00010000:0.0:1790740501.208598:0:18675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790740501.208611:0:18675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000480382f2/0xb25dda4f4e92ef00 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.208630:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=572s v=(0 0) 00010000:00010000:0.0:1790740501.208635:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740501.208643:0:18675:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000480382f2/0xb25dda4f4e92ef00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.208661:0:18675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000480382f2/0xb25dda4f4e92ef00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.208684:0:18675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000480382f2/0xb25dda4f4e92ef00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.208770:0:18675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000480382f2/0xb25dda4f4e92ef00 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.208797:0:18675:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790740501.208941:0:17154:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740501.208955:0:17154:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000480382f2/0xb25dda4f4e92ef00 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.208965:0:17154:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee3c00 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:3.0:1790740501.208970:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000480382f2/0xb25dda4f4e92ef00 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.208980:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000480382f2/0xb25dda4f4e92ef00 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.208999:0:17154:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000480382f2/0xb25dda4f4e92ef00 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.209007:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000480382f2/0xb25dda4f4e92ef00 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.209053:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740501.209055:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740501.209057:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790740501.209277:0:18675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790740501.209284:0:18675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5ea0cab/0xb25dda4f4e92ef07 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.209292:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=572s v=(0 0) 00010000:00010000:0.0:1790740501.209295:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740501.209299:0:18675:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5ea0cab/0xb25dda4f4e92ef07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.209309:0:18675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5ea0cab/0xb25dda4f4e92ef07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.209316:0:18675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5ea0cab/0xb25dda4f4e92ef07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.209323:0:18675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5ea0cab/0xb25dda4f4e92ef07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.209356:0:18675:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790740501.209847:0:18675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790740501.209853:0:18675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000745d97d7/0xb25dda4f4e92ef0e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.209862:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=572s v=(0 0) 00010000:00010000:0.0:1790740501.209866:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740501.209869:0:18675:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000745d97d7/0xb25dda4f4e92ef0e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.209878:0:18675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000745d97d7/0xb25dda4f4e92ef0e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.209886:0:18675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000745d97d7/0xb25dda4f4e92ef0e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.209893:0:18675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000745d97d7/0xb25dda4f4e92ef0e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.209920:0:18675:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1790740501.210217:0:18675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790740501.210223:0:18675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab854ae6/0xb25dda4f4e92ef15 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.210357:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=572s v=(0 0) 00010000:00010000:0.0:1790740501.210368:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740501.210372:0:18675:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab854ae6/0xb25dda4f4e92ef15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.210380:0:18675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab854ae6/0xb25dda4f4e92ef15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.210388:0:18675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab854ae6/0xb25dda4f4e92ef15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.210394:0:18675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab854ae6/0xb25dda4f4e92ef15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.210403:0:18675:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1790740501.210479:0:17155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1790740501.210487:0:17155:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5ea0cab/0xb25dda4f4e92ef07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.210496:0:17155:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee3a00 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:3.0:1790740501.210500:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5ea0cab/0xb25dda4f4e92ef07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.210519:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5ea0cab/0xb25dda4f4e92ef07 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.210534:0:17155:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5ea0cab/0xb25dda4f4e92ef07 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.210541:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5ea0cab/0xb25dda4f4e92ef07 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.210558:0:17155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790740501.210561:0:17155:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000745d97d7/0xb25dda4f4e92ef0e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.210567:0:17155:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee3400 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:3.0:1790740501.210570:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000745d97d7/0xb25dda4f4e92ef0e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.210578:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000745d97d7/0xb25dda4f4e92ef0e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.210588:0:17155:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000745d97d7/0xb25dda4f4e92ef0e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.210594:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000745d97d7/0xb25dda4f4e92ef0e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.210618:0:17155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740501.210622:0:17155:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab854ae6/0xb25dda4f4e92ef15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.210628:0:17155:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee2a00 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:3.0:1790740501.210631:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab854ae6/0xb25dda4f4e92ef15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.210638:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab854ae6/0xb25dda4f4e92ef15 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.210649:0:17155:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab854ae6/0xb25dda4f4e92ef15 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.210656:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab854ae6/0xb25dda4f4e92ef15 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.210668:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740501.210671:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740501.210673:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790740501.210791:0:18675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790740501.210798:0:18675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061cdd761/0xb25dda4f4e92ef1c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.210806:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=572s v=(0 0) 00010000:00010000:0.0:1790740501.210809:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740501.210813:0:18675:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061cdd761/0xb25dda4f4e92ef1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.210821:0:18675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061cdd761/0xb25dda4f4e92ef1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.210829:0:18675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061cdd761/0xb25dda4f4e92ef1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.210845:0:18675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061cdd761/0xb25dda4f4e92ef1c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.210866:0:18675:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790740501.210884:0:17155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740501.210889:0:17155:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061cdd761/0xb25dda4f4e92ef1c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.210897:0:17155:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee3200 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:3.0:1790740501.210905:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061cdd761/0xb25dda4f4e92ef1c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.210914:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061cdd761/0xb25dda4f4e92ef1c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.210925:0:17155:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061cdd761/0xb25dda4f4e92ef1c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.210931:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061cdd761/0xb25dda4f4e92ef1c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.210945:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740501.210947:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740501.210948:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740501.211138:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790740501.211359:0:18675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790740501.211366:0:18675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007168e057/0xb25dda4f4e92ef23 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.211374:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=572s v=(0 0) 00010000:00010000:0.0:1790740501.211378:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740501.211382:0:18675:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007168e057/0xb25dda4f4e92ef23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.211391:0:18675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007168e057/0xb25dda4f4e92ef23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.211399:0:18675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007168e057/0xb25dda4f4e92ef23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.211406:0:18675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007168e057/0xb25dda4f4e92ef23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.211425:0:18675:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790740501.211954:0:17155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740501.211960:0:17155:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007168e057/0xb25dda4f4e92ef23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.211968:0:17155:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee3e00 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:3.0:1790740501.211971:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007168e057/0xb25dda4f4e92ef23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.211979:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007168e057/0xb25dda4f4e92ef23 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.211991:0:17155:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007168e057/0xb25dda4f4e92ef23 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.212005:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007168e057/0xb25dda4f4e92ef23 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.212024:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740501.212053:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740501.212055:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790740501.212137:0:18675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790740501.212144:0:18675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ca0b9ab/0xb25dda4f4e92ef2a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.212157:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=572s v=(0 0) 00010000:00010000:0.0:1790740501.212160:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740501.212165:0:18675:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ca0b9ab/0xb25dda4f4e92ef2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.212175:0:18675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ca0b9ab/0xb25dda4f4e92ef2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.212183:0:18675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ca0b9ab/0xb25dda4f4e92ef2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.212191:0:18675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ca0b9ab/0xb25dda4f4e92ef2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.212207:0:18675:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790740501.212863:0:17154:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790740501.212871:0:17154:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ca0b9ab/0xb25dda4f4e92ef2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740501.212882:0:17154:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee2800 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:1.0:1790740501.212887:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ca0b9ab/0xb25dda4f4e92ef2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740501.212897:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ca0b9ab/0xb25dda4f4e92ef2a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740501.212915:0:17154:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ca0b9ab/0xb25dda4f4e92ef2a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740501.212923:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ca0b9ab/0xb25dda4f4e92ef2a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740501.212957:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740501.212959:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740501.212960:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790740501.213292:0:18675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790740501.213300:0:18675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fccda41/0xb25dda4f4e92ef31 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.213309:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=572s v=(0 0) 00010000:00010000:0.0:1790740501.213313:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740501.213317:0:18675:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007fccda41/0xb25dda4f4e92ef31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.213327:0:18675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007fccda41/0xb25dda4f4e92ef31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.213346:0:18675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fccda41/0xb25dda4f4e92ef31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.213353:0:18675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007fccda41/0xb25dda4f4e92ef31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.213376:0:18675:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790740501.213435:0:17155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740501.213443:0:17155:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007fccda41/0xb25dda4f4e92ef31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.213451:0:17155:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee2200 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:3.0:1790740501.213455:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007fccda41/0xb25dda4f4e92ef31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.213463:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007fccda41/0xb25dda4f4e92ef31 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.213475:0:17155:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007fccda41/0xb25dda4f4e92ef31 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.213483:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007fccda41/0xb25dda4f4e92ef31 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.213498:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740501.213501:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740501.213503:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790740501.213817:0:18675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790740501.213823:0:18675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000918517f7/0xb25dda4f4e92ef38 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.213832:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=572s v=(0 0) 00010000:00010000:0.0:1790740501.213835:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740501.213839:0:18675:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000918517f7/0xb25dda4f4e92ef38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.213849:0:18675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000918517f7/0xb25dda4f4e92ef38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.213857:0:18675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000918517f7/0xb25dda4f4e92ef38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.213864:0:18675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000918517f7/0xb25dda4f4e92ef38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.213895:0:18675:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790740501.214011:0:17154:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790740501.214017:0:17154:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000918517f7/0xb25dda4f4e92ef38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740501.214349:0:17154:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee2c00 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:1.0:1790740501.214354:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000918517f7/0xb25dda4f4e92ef38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740501.214364:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000918517f7/0xb25dda4f4e92ef38 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740501.214377:0:17154:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000918517f7/0xb25dda4f4e92ef38 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740501.214385:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000918517f7/0xb25dda4f4e92ef38 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740501.214399:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740501.214401:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740501.214403:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790740501.214961:0:18675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790740501.214970:0:18675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003731b4fa/0xb25dda4f4e92ef3f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.214980:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=572s v=(0 0) 00010000:00010000:0.0:1790740501.214984:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740501.214988:0:18675:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003731b4fa/0xb25dda4f4e92ef3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.214999:0:18675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003731b4fa/0xb25dda4f4e92ef3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.215007:0:18675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003731b4fa/0xb25dda4f4e92ef3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.215014:0:18675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003731b4fa/0xb25dda4f4e92ef3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.215060:0:18675:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790740501.215090:0:17155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740501.215097:0:17155:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003731b4fa/0xb25dda4f4e92ef3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.215106:0:17155:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee2600 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:3.0:1790740501.215110:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003731b4fa/0xb25dda4f4e92ef3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.215119:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003731b4fa/0xb25dda4f4e92ef3f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.215134:0:17155:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003731b4fa/0xb25dda4f4e92ef3f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.215143:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003731b4fa/0xb25dda4f4e92ef3f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.215162:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740501.215163:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740501.215165:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790740501.215629:0:18675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790740501.215637:0:18675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d300584b/0xb25dda4f4e92ef46 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.215645:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=572s v=(0 0) 00010000:00010000:0.0:1790740501.215656:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740501.215661:0:18675:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d300584b/0xb25dda4f4e92ef46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.215672:0:18675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d300584b/0xb25dda4f4e92ef46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.215681:0:18675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d300584b/0xb25dda4f4e92ef46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.215688:0:18675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d300584b/0xb25dda4f4e92ef46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.215796:0:18675:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790740501.216118:0:17154:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790740501.216126:0:17154:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d300584b/0xb25dda4f4e92ef46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740501.216146:0:17154:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf061e00 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:1.0:1790740501.216150:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d300584b/0xb25dda4f4e92ef46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740501.216159:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d300584b/0xb25dda4f4e92ef46 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740501.216172:0:17154:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d300584b/0xb25dda4f4e92ef46 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740501.216179:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d300584b/0xb25dda4f4e92ef46 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740501.216196:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740501.216198:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740501.216200:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790740501.216353:0:18675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790740501.216359:0:18675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060e2108b/0xb25dda4f4e92ef4d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.216367:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=572s v=(0 0) 00010000:00010000:0.0:1790740501.216370:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740501.216374:0:18675:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060e2108b/0xb25dda4f4e92ef4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.216384:0:18675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060e2108b/0xb25dda4f4e92ef4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.216391:0:18675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060e2108b/0xb25dda4f4e92ef4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.216405:0:18675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060e2108b/0xb25dda4f4e92ef4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.216421:0:18675:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790740501.218393:0:18675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790740501.218408:0:18675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c51d349a/0xb25dda4f4e92ef54 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.218422:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=572s v=(0 0) 00010000:00010000:0.0:1790740501.218426:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740501.218431:0:18675:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c51d349a/0xb25dda4f4e92ef54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.218445:0:18675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c51d349a/0xb25dda4f4e92ef54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.218467:0:18675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c51d349a/0xb25dda4f4e92ef54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.218476:0:18675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c51d349a/0xb25dda4f4e92ef54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.218495:0:18675:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790740501.218513:0:17155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790740501.218522:0:17155:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060e2108b/0xb25dda4f4e92ef4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.218532:0:17155:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf060600 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:3.0:1790740501.218537:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060e2108b/0xb25dda4f4e92ef4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.218568:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060e2108b/0xb25dda4f4e92ef4d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.218586:0:17155:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060e2108b/0xb25dda4f4e92ef4d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.218594:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060e2108b/0xb25dda4f4e92ef4d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.218613:0:17155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740501.218616:0:17155:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c51d349a/0xb25dda4f4e92ef54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.218623:0:17155:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf060000 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:3.0:1790740501.218626:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c51d349a/0xb25dda4f4e92ef54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.218633:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c51d349a/0xb25dda4f4e92ef54 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.218644:0:17155:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c51d349a/0xb25dda4f4e92ef54 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.218652:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c51d349a/0xb25dda4f4e92ef54 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.218681:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740501.218683:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740501.218684:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740501.218893:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790740501.219415:0:18675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790740501.219423:0:18675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d771b3df/0xb25dda4f4e92ef5b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.219440:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=572s v=(0 0) 00010000:00010000:0.0:1790740501.219443:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740501.219448:0:18675:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d771b3df/0xb25dda4f4e92ef5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.219458:0:18675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d771b3df/0xb25dda4f4e92ef5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.219477:0:18675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d771b3df/0xb25dda4f4e92ef5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.219485:0:18675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d771b3df/0xb25dda4f4e92ef5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.219501:0:18675:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790740501.219892:0:18675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790740501.219900:0:18675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a308dd9/0xb25dda4f4e92ef62 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.219909:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=572s v=(0 0) 00010000:00010000:0.0:1790740501.219912:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740501.219916:0:18675:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a308dd9/0xb25dda4f4e92ef62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.219925:0:18675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a308dd9/0xb25dda4f4e92ef62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.219946:0:18675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a308dd9/0xb25dda4f4e92ef62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.219953:0:18675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a308dd9/0xb25dda4f4e92ef62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.219977:0:18675:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1790740501.220171:0:17154:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790740501.220178:0:17154:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d771b3df/0xb25dda4f4e92ef5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740501.220186:0:17154:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf060e00 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:1.0:1790740501.220190:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d771b3df/0xb25dda4f4e92ef5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740501.220211:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d771b3df/0xb25dda4f4e92ef5b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740501.220244:0:17154:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d771b3df/0xb25dda4f4e92ef5b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740501.220253:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d771b3df/0xb25dda4f4e92ef5b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740501.220270:0:17154:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790740501.220273:0:17154:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a308dd9/0xb25dda4f4e92ef62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740501.220280:0:17154:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf060400 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:1.0:1790740501.220283:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a308dd9/0xb25dda4f4e92ef62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740501.220291:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a308dd9/0xb25dda4f4e92ef62 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740501.220301:0:17154:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a308dd9/0xb25dda4f4e92ef62 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740501.220309:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a308dd9/0xb25dda4f4e92ef62 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740501.220333:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740501.220335:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740501.220336:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790740501.220680:0:18675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790740501.220686:0:18675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a4c826e/0xb25dda4f4e92ef69 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.220776:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=572s v=(0 0) 00010000:00010000:0.0:1790740501.220780:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740501.220785:0:18675:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a4c826e/0xb25dda4f4e92ef69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.220796:0:18675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a4c826e/0xb25dda4f4e92ef69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.220804:0:18675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a4c826e/0xb25dda4f4e92ef69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.220813:0:18675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a4c826e/0xb25dda4f4e92ef69 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.220847:0:18675:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790740501.220858:0:17155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740501.220866:0:17155:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a4c826e/0xb25dda4f4e92ef69 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.220875:0:17155:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf060800 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:3.0:1790740501.220879:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a4c826e/0xb25dda4f4e92ef69 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.220886:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a4c826e/0xb25dda4f4e92ef69 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.220899:0:17155:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a4c826e/0xb25dda4f4e92ef69 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.220906:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a4c826e/0xb25dda4f4e92ef69 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.220922:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740501.220924:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740501.220925:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740501.221337:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790740501.222989:0:18675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790740501.223000:0:18675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020892b28/0xb25dda4f4e92ef70 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.223017:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=572s v=(0 0) 00010000:00010000:0.0:1790740501.223021:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740501.223051:0:18675:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020892b28/0xb25dda4f4e92ef70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.223066:0:18675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020892b28/0xb25dda4f4e92ef70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.223074:0:18675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020892b28/0xb25dda4f4e92ef70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.223081:0:18675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020892b28/0xb25dda4f4e92ef70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.223108:0:18675:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790740501.223782:0:18675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790740501.223790:0:18675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e492c4eb/0xb25dda4f4e92ef77 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.223800:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=572s v=(0 0) 00010000:00010000:0.0:1790740501.223809:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740501.223815:0:18675:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e492c4eb/0xb25dda4f4e92ef77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.223821:0:17155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790740501.223826:0:18675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e492c4eb/0xb25dda4f4e92ef77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.223835:0:18675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e492c4eb/0xb25dda4f4e92ef77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.223848:0:17155:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020892b28/0xb25dda4f4e92ef70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.223848:0:18675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e492c4eb/0xb25dda4f4e92ef77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.223879:0:18675:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790740501.223883:0:17155:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf061000 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:3.0:1790740501.223888:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020892b28/0xb25dda4f4e92ef70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.223898:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020892b28/0xb25dda4f4e92ef70 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.223916:0:17155:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020892b28/0xb25dda4f4e92ef70 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.223922:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020892b28/0xb25dda4f4e92ef70 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.223944:0:17155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740501.223947:0:17155:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e492c4eb/0xb25dda4f4e92ef77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.223953:0:17155:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf060c00 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:3.0:1790740501.223956:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e492c4eb/0xb25dda4f4e92ef77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.223963:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e492c4eb/0xb25dda4f4e92ef77 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.223972:0:17155:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e492c4eb/0xb25dda4f4e92ef77 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.223985:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e492c4eb/0xb25dda4f4e92ef77 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.223998:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740501.224000:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740501.224002:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740501.224236:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790740501.225427:0:18675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790740501.225440:0:18675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a265b05/0xb25dda4f4e92ef7e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.228608:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=572s v=(0 0) 00010000:00010000:0.0:1790740501.228622:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740501.228632:0:18675:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a265b05/0xb25dda4f4e92ef7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.228653:0:18675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a265b05/0xb25dda4f4e92ef7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.228666:0:18675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a265b05/0xb25dda4f4e92ef7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.229905:0:18675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a265b05/0xb25dda4f4e92ef7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.229940:0:18675:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790740501.230251:0:17155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740501.230260:0:17155:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a265b05/0xb25dda4f4e92ef7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.230270:0:17155:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf061400 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:3.0:1790740501.230275:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a265b05/0xb25dda4f4e92ef7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.230288:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a265b05/0xb25dda4f4e92ef7e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.230308:0:17155:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a265b05/0xb25dda4f4e92ef7e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.230314:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a265b05/0xb25dda4f4e92ef7e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.230341:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740501.230343:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740501.230345:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790740501.230688:0:18675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790740501.230874:0:18675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d1f5400/0xb25dda4f4e92ef85 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.230886:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=572s v=(0 0) 00010000:00010000:0.0:1790740501.230890:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740501.230897:0:18675:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d1f5400/0xb25dda4f4e92ef85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.230908:0:18675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d1f5400/0xb25dda4f4e92ef85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.230917:0:18675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d1f5400/0xb25dda4f4e92ef85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.230924:0:18675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d1f5400/0xb25dda4f4e92ef85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.230950:0:18675:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790740501.231262:0:17154:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790740501.231268:0:17154:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d1f5400/0xb25dda4f4e92ef85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740501.231275:0:17154:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf060200 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:1.0:1790740501.231279:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d1f5400/0xb25dda4f4e92ef85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740501.231287:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d1f5400/0xb25dda4f4e92ef85 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740501.231299:0:17154:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d1f5400/0xb25dda4f4e92ef85 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740501.231306:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d1f5400/0xb25dda4f4e92ef85 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740501.231318:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740501.231320:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740501.231322:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790740501.232401:0:18675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790740501.232412:0:18675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b05a8d6/0xb25dda4f4e92ef8c lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.232434:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=572s v=(0 0) 00010000:00010000:0.0:1790740501.232438:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740501.232443:0:18675:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b05a8d6/0xb25dda4f4e92ef8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.232521:0:18675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b05a8d6/0xb25dda4f4e92ef8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.232533:0:18675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b05a8d6/0xb25dda4f4e92ef8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.232540:0:18675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b05a8d6/0xb25dda4f4e92ef8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.232564:0:18675:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790740501.232620:0:17155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740501.232628:0:17155:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b05a8d6/0xb25dda4f4e92ef8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.232639:0:17155:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf061200 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:3.0:1790740501.232642:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b05a8d6/0xb25dda4f4e92ef8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.232651:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b05a8d6/0xb25dda4f4e92ef8c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.232665:0:17155:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b05a8d6/0xb25dda4f4e92ef8c lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.232672:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b05a8d6/0xb25dda4f4e92ef8c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.232692:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740501.232693:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740501.232695:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790740501.237838:0:18675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790740501.237867:0:18675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084e63716/0xb25dda4f4e92ef93 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740501.237887:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=572s v=(0 0) 00010000:00010000:1.0:1790740501.237892:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790740501.237900:0:18675:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084e63716/0xb25dda4f4e92ef93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740501.237915:0:18675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084e63716/0xb25dda4f4e92ef93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740501.237926:0:18675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084e63716/0xb25dda4f4e92ef93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740501.237935:0:18675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084e63716/0xb25dda4f4e92ef93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740501.237961:0:18675:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790740501.238282:0:17154:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740501.238291:0:17154:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084e63716/0xb25dda4f4e92ef93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.238302:0:17154:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc44800 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:3.0:1790740501.238307:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084e63716/0xb25dda4f4e92ef93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.238330:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084e63716/0xb25dda4f4e92ef93 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.238349:0:17154:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084e63716/0xb25dda4f4e92ef93 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.238357:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084e63716/0xb25dda4f4e92ef93 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.238379:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740501.238381:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740501.238383:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790740501.239607:0:18675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790740501.239617:0:18675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d2500ca/0xb25dda4f4e92ef9a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740501.239630:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=572s v=(0 0) 00010000:00010000:1.0:1790740501.239634:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790740501.239639:0:18675:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d2500ca/0xb25dda4f4e92ef9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740501.239650:0:18675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d2500ca/0xb25dda4f4e92ef9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740501.239666:0:18675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d2500ca/0xb25dda4f4e92ef9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740501.239673:0:18675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d2500ca/0xb25dda4f4e92ef9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740501.240336:0:18675:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790740501.240821:0:18675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790740501.240828:0:18675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1ea0d28/0xb25dda4f4e92efa1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740501.240838:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=572s v=(0 0) 00010000:00010000:1.0:1790740501.240841:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790740501.240846:0:18675:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1ea0d28/0xb25dda4f4e92efa1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740501.240855:0:18675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1ea0d28/0xb25dda4f4e92efa1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740501.240863:0:18675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1ea0d28/0xb25dda4f4e92efa1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740501.240869:0:18675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a1ea0d28/0xb25dda4f4e92efa1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.241582:0:17155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790740501.241592:0:17155:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d2500ca/0xb25dda4f4e92ef9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.241602:0:17155:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc45600 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:3.0:1790740501.241606:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d2500ca/0xb25dda4f4e92ef9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.241616:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d2500ca/0xb25dda4f4e92ef9a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.241632:0:17155:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d2500ca/0xb25dda4f4e92ef9a lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.241652:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d2500ca/0xb25dda4f4e92ef9a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.241675:0:17155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740501.241678:0:17155:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a1ea0d28/0xb25dda4f4e92efa1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.241684:0:17155:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc45200 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:3.0:1790740501.241687:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1ea0d28/0xb25dda4f4e92efa1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.241694:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1ea0d28/0xb25dda4f4e92efa1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.241704:0:17155:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a1ea0d28/0xb25dda4f4e92efa1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.241710:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740501.241712:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740501.241713:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740501.243894:0:18675:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1790740501.243911:0:18675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1ea0d28/0xb25dda4f4e92efa1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790740501.246978:0:18675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790740501.246994:0:18675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054f02507/0xb25dda4f4e92efa8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740501.247012:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=572s v=(0 0) 00010000:00010000:1.0:1790740501.247018:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790740501.247073:0:18675:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054f02507/0xb25dda4f4e92efa8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740501.247091:0:18675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054f02507/0xb25dda4f4e92efa8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740501.247102:0:18675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054f02507/0xb25dda4f4e92efa8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740501.247111:0:18675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054f02507/0xb25dda4f4e92efa8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.249292:0:17154:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740501.249308:0:17154:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054f02507/0xb25dda4f4e92efa8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.249322:0:17154:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc44a00 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:3.0:1790740501.249349:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054f02507/0xb25dda4f4e92efa8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.249361:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054f02507/0xb25dda4f4e92efa8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.249387:0:17154:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054f02507/0xb25dda4f4e92efa8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740501.249573:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740501.249577:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740501.249579:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740501.249954:0:18675:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1790740501.249963:0:18675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054f02507/0xb25dda4f4e92efa8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.250136:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790740501.250917:0:18675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790740501.250928:0:18675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042e35c37/0xb25dda4f4e92efaf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.250944:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=572s v=(0 0) 00010000:00010000:0.0:1790740501.250948:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740501.250954:0:18675:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042e35c37/0xb25dda4f4e92efaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.250967:0:18675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042e35c37/0xb25dda4f4e92efaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.250987:0:18675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042e35c37/0xb25dda4f4e92efaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.250994:0:18675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042e35c37/0xb25dda4f4e92efaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.251019:0:18675:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790740501.251192:0:17154:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790740501.251200:0:17154:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042e35c37/0xb25dda4f4e92efaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740501.251209:0:17154:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf061600 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:2.0:1790740501.251214:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042e35c37/0xb25dda4f4e92efaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740501.251223:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042e35c37/0xb25dda4f4e92efaf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740501.251258:0:17154:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042e35c37/0xb25dda4f4e92efaf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740501.251265:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042e35c37/0xb25dda4f4e92efaf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740501.251294:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740501.251296:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740501.251298:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790740501.251566:0:18675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790740501.251572:0:18675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b248f99/0xb25dda4f4e92efb6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.251582:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=572s v=(0 0) 00010000:00010000:0.0:1790740501.251585:0:18675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740501.251589:0:18675:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b248f99/0xb25dda4f4e92efb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.251597:0:18675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b248f99/0xb25dda4f4e92efb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.251605:0:18675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b248f99/0xb25dda4f4e92efb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.251612:0:18675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b248f99/0xb25dda4f4e92efb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740501.251644:0:18675:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1790740501.251682:0:18675:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00010000:00010000:3.0:1790740501.251685:0:17155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740501.251704:0:17155:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b248f99/0xb25dda4f4e92efb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.251713:0:17155:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf061800 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:3.0:1790740501.251717:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b248f99/0xb25dda4f4e92efb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.251725:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b248f99/0xb25dda4f4e92efb6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.251738:0:17155:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b248f99/0xb25dda4f4e92efb6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.251745:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b248f99/0xb25dda4f4e92efb6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740501.251778:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740501.251780:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740501.251782:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740501.251812:0:18675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17190:x1877727022087168:12345-0@lo:5:osp-pre-0-0.0 Request processed in 68256us (68667us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740501.251822:0:18675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790740501.251913:0:17190:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17190:1877727022087168:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1790740501.251931:0:17190:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:2.0:1790740501.251985:0:17190:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17190:1877727022087296:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1790740501.252021:0:17190:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740501.252084:0:17190:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82c75600 going to sleep for 11 seconds 00000100:00100000:0.0:1790740501.252122:0:18674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022087296 00000100:00100000:0.0:1790740501.252131:0:18674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022087296 00000100:00100000:0.0:1790740501.252179:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790740501.252190:0:18674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17190:x1877727022087296:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1790740501.252227:0:18674:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:2.0:1790740501.263667:0:18669:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:2.0:1790740501.263737:0:18669:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1790740501.263988:0:18674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17190:x1877727022087296:12345-0@lo:5:osp-pre-0-0.0 Request processed in 11795us (11960us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1790740501.264001:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790740501.264172:0:17190:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1790740501.264181:0:17190:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17190:1877727022087296:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1790740501.264196:0:17190:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:2.0:1790740501.676264:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740502.699421:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740503.724199:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740504.172517:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84531880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022087424:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790740504.172596:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740504.172668:0:18676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022087424 00000100:00100000:0.0:1790740504.172675:0:18676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022087424 00000100:00100000:0.0:1790740504.172731:0:18676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790740504.172741:0:18676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022087424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790740504.172770:0:18676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1790740504.172820:0:18676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022087424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740504.172827:0:18676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1790740504.172851:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790740504.172894:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84531880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022087424:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790740504.683272:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022087552:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790740504.683368:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740504.683559:0:17907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022087552 00000100:00100000:2.0:1790740504.683569:0:17907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022087552 00000100:00100000:2.0:1790740504.683631:0:17907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790740504.683641:0:17907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022087552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790740504.683680:0:17907:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1790740504.684303:0:17907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022087552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 662us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740504.684312:0:17907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790740504.684910:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022087552:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1790740504.746675:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740505.199651:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790740505.199680:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84525c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022087680:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790740505.199756:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740505.200017:0:17171:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022087680 00000100:00100000:1.0:1790740505.200026:0:17171:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022087680 00000100:00100000:1.0:1790740505.200111:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790740505.200120:0:17171:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022087680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790740505.200154:0:17171:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1790740505.200205:0:17171:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022087680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740505.200212:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790740505.200614:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84525c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022087680:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1790740505.774511:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740506.218246:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022087808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790740506.218323:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740506.218410:0:18676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022087808 00000100:00080000:2.0:1790740506.218574:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790740506.218586:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790740506.218589:0:36:0:(import.c:65:import_set_state_nolock()) ffff98dcaeddd000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790740506.218594:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 572 00000100:00080000:2.0:1790740506.218598:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1790740506.218608:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98dcaeddd000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:2.0:1790740506.218632:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98dcbfe2c380 x1877727022088192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790740506.218688:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790740506.218691:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790740506.218693:0:36:0:(import.c:65:import_set_state_nolock()) ffff98dc88508000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790740506.218697:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 572 00000100:00080000:2.0:1790740506.218700:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1790740506.218706:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff98dc88508000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:2.0:1790740506.218718:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98db83e1df80 x1877727022088704/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790740506.219097:0:18676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022087808 00000100:00100000:0.0:1790740506.219161:0:18676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790740506.219169:0:18676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84533b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022087808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790740506.219198:0:18676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1790740506.219246:0:18676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84533b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022087808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740506.219253:0:18676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790740506.219280:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3640:1877727022087936:0@lo:400:kworker.0 00000100:00100000:0.0:1790740506.219312:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740506.219345:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022088576:0@lo:400:kworker.0 00000100:00100000:0.0:1790740506.219382:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740506.219403:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1790740506.219409:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022088064:0@lo:400:kworker.0 00000100:00100000:0.0:1790740506.219505:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740506.219536:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877727022088832:0@lo:400:kworker.0 00000100:00100000:0.0:1790740506.219563:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740506.219596:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877727022088192:0@lo:8:kworker.0 00000100:00100000:0.0:1790740506.219620:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740506.219639:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877727022088704:0@lo:8:kworker.0 00000100:00100000:0.0:1790740506.219658:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740506.219690:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022087936 00000100:00100000:0.0:1790740506.219694:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022087936 00000100:00100000:0.0:1790740506.219722:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1790740506.219729:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb6d1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+21:3640:x1877727022087936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740506.219765:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb6d1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+21:3640:x1877727022087936:12345-0@lo:400:kworker.0 Request processed in 37us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740506.219772:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1790740506.219979:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727022088320:0@lo:400:kworker.0 00000100:00100000:1.0:1790740506.220010:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740506.220050:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877727022088960:0@lo:400:kworker.0 00000100:00100000:1.0:1790740506.220075:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740506.220092:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1790740506.220098:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84650700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022088448:0@lo:400:kworker.0 00000100:00100000:1.0:1790740506.220119:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740506.220136:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1877727022089088:0@lo:400:kworker.0 00000100:00100000:1.0:1790740506.220158:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740506.220203:0:17171:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022088064 00000100:00100000:1.0:1790740506.220208:0:17171:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022088064 00000100:00100000:1.0:1790740506.220230:0:17171:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022088448 00000100:00100000:1.0:1790740506.220233:0:17171:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022088448 00000100:00100000:1.0:1790740506.220245:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790740506.220250:0:17171:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84532680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727022088064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740506.220280:0:17171:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84532680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727022088064:12345-0@lo:400:kworker.0 Request processed in 30us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740506.220294:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790740506.220308:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790740506.220313:0:17171:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022088448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740506.220350:0:17171:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022088448:12345-0@lo:400:kworker.0 Request processed in 36us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740506.220355:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790740506.220386:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84650700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022088448:0@lo:400:kworker.0 00000100:00100000:0.0:1790740506.220561:0:18675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022088576 00000100:00100000:0.0:1790740506.220567:0:18675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022088576 00000100:00100000:0.0:1790740506.220588:0:18675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022088192 00000100:00100000:0.0:1790740506.220591:0:18675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022088192 00000100:00100000:0.0:1790740506.220600:0:18675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022088704 00000100:00100000:0.0:1790740506.220602:0:18675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022088704 00000100:00100000:0.0:1790740506.220611:0:18675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790740506.220617:0:18675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84530700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022088576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740506.220650:0:18675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84530700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022088576:12345-0@lo:400:kworker.0 Request processed in 34us (1268us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740506.220655:0:18675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790740506.220666:0:18675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790740506.220669:0:18675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3637:x1877727022088192:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1790740506.220687:0:18675:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1790740506.220738:0:18675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3637:x1877727022088192:12345-0@lo:8:kworker.0 Request processed in 66us (1115us total) trans 0 rc -19/-19 00000100:00100000:0.0:1790740506.220744:0:18675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790740506.220755:0:18675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790740506.220758:0:18675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84531c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3637:x1877727022088704:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1790740506.220768:0:18675:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1790740506.220901:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790740506.220960:0:18675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84531c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3637:x1877727022088704:12345-0@lo:8:kworker.0 Request processed in 200us (1301us total) trans 0 rc -19/-19 00000100:00100000:0.0:1790740506.220967:0:18675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790740506.220993:0:17167:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022088832 00000100:00100000:0.0:1790740506.220997:0:17167:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022088832 00000100:00100000:0.0:1790740506.221014:0:17167:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022088320 00000100:00100000:0.0:1790740506.221016:0:17167:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022088320 00000100:00100000:0.0:1790740506.221025:0:17167:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022088960 00000100:00100000:0.0:1790740506.221027:0:17167:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022088960 00000100:00100000:0.0:1790740506.221240:0:17167:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022089088 00000100:00100000:0.0:1790740506.221244:0:17167:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022089088 00000100:00080000:1.0:1790740506.221959:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98dcaeddd000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790740506.221967:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790740506.221971:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877727022088192:0@lo:8:kworker.0 00000100:00080000:1.0:1790740506.221989:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98dc88508000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790740506.221992:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790740506.221995:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877727022088704:0@lo:8:kworker.0 00000100:00080000:2.0:1790740506.224252:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790740506.224261:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790740506.229104:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790740506.229119:0:17167:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877727022088832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740506.229213:0:17167:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877727022088832:12345-0@lo:400:kworker.0 Request processed in 98us (9649us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740506.229221:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790740506.229240:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790740506.229246:0:17167:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727022088320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740506.229286:0:17167:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727022088320:12345-0@lo:400:kworker.0 Request processed in 40us (9275us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740506.229291:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790740506.229316:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790740506.229321:0:17167:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84527100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877727022088960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740506.229351:0:17167:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84527100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877727022088960:12345-0@lo:400:kworker.0 Request processed in 29us (9274us total) trans 0 rc 0/0 00010000:00080000:1.0:1790740506.229530:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98dcbfe2f800 x1877727022088320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740506.229547:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727022088320:0@lo:400:kworker.0 00010000:00080000:1.0:1790740506.229559:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98db83e1f480 x1877727022088960/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740506.229567:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877727022088960:0@lo:400:kworker.0 00000100:00100000:0.0:1790740506.229669:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790740506.229687:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790740506.229694:0:17167:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877727022089088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740506.229739:0:17167:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877727022089088:12345-0@lo:400:kworker.0 Request processed in 45us (9579us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740506.229745:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790740506.229809:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022087808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790740506.229842:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022088064:0@lo:400:kworker.0 00010000:00080000:0.0:1790740506.229854:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98db83e1e680 x1877727022088832/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740506.229862:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877727022088832:0@lo:400:kworker.0 00000100:00100000:0.0:1790740506.229871:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3640:1877727022087936:0@lo:400:kworker.0 00000100:00100000:0.0:1790740506.229882:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022088576:0@lo:400:kworker.0 00010000:00080000:1.0:1790740506.229958:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98db83e1ed80 x1877727022089088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740506.229967:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1877727022089088:0@lo:400:kworker.0 00010000:00010000:3.0:1790740506.794279:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790740506.996485:0:17922:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790740507.820611:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790740508.227737:0:19486:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790740508.227742:0:19486:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1790740508.227743:0:19486:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1790740508.227873:0:19486:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98dcb6c3a800 00000020:01000004:2.0:1790740508.227974:0:19486:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1790740508.227992:0:19486:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1790740508.228007:0:19486:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff98dc99248000) 00000020:00000080:2.0:1790740508.228025:0:19486:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1790740508.272308:0:19486:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1790740508.275678:0:19486:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1790740508.276243:0:19486:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1790740508.276947:0:19486:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1790740508.277355:0:19486:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1790740508.277742:0:19486:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1790740508.278054:0:19486:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:2.0:1790740508.279784:0:19486:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1790740508.280143:0:19486:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1790740508.280162:0:19486:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790740508.280178:0:19486:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb25dda4f4e92efc4 00000020:01000004:2.0:1790740508.280187:0:19486:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1790740508.280213:0:19486:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.103@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790740508.280218:0:19486:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790740508.280225:0:19486:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1790740508.280257:0:19486:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1790740508.280261:0:19486:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.103@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1790740508.289726:0:19486:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.103@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790740508.289773:0:19486:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.103@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1790740508.289777:0:19486:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790740508.289779:0:19486:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790740508.289781:0:19486:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790740508.289782:0:19486:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790740508.289784:0:19486:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790740508.289785:0:19486:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790740508.289787:0:19486:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790740508.289788:0:19486:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790740508.289790:0:19486:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790740508.289793:0:19486:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1790740508.289796:0:19486:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790740508.289797:0:19486:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790740508.289798:0:19486:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790740508.289799:0:19486:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790740508.289801:0:19486:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790740508.289802:0:19486:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790740508.289807:0:19486:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790740508.289808:0:19486:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790740508.289809:0:19486:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790740508.289836:0:19486:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1790740508.289855:0:19486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:19486:1877727022089216:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790740508.290003:0:19486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740508.290151:0:19486:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83ff4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790740508.290236:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022089216 00000100:00100000:0.0:1790740508.290245:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022089216 00000100:00100000:0.0:1790740508.290365:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1790740508.290377:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb6d1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+21:19486:x1877727022089216:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790740508.290410:0:17161:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1790740508.290420:0:17161:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1790740508.290436:0:17161:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1790740508.290805:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb6d1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+21:19486:x1877727022089216:12345-0@lo:253:mount.lustre.0 Request processed in 431us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740508.290814:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1790740508.290885:0:19486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:19486:1877727022089216:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790740508.290908:0:19486:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1790740508.290910:0:19486:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790740508.290911:0:19486:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790740508.290912:0:19486:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790740508.290913:0:19486:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790740508.290914:0:19486:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790740508.290915:0:19486:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790740508.290916:0:19486:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790740508.290917:0:19486:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790740508.290918:0:19486:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790740508.290934:0:19486:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98dcb6c3a800 from lustre-OST0001 10000000:01000000:2.0:1790740508.290956:0:19486:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1790740508.290959:0:19486:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1790740508.290968:0:19486:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98dcbc23b380 local copy 00010000:00010000:2.0:1790740508.290979:0:19486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98db83f32800/0xb25dda4f4e92ec1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ec21 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740508.291107:0:19486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:19486:1877727022089344:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790740508.291136:0:19486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740508.291649:0:19486:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83ff4780 going to sleep for 11 seconds 00000100:00100000:3.0:1790740508.291681:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022089344 00000100:00100000:3.0:1790740508.291686:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022089344 00000100:00100000:0.0:1790740508.291719:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1790740508.291732:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb6d1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+21:19486:x1877727022089344:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790740508.291845:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb6d1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+21:19486:x1877727022089344:12345-0@lo:501:mount.lustre.0 Request processed in 115us (707us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790740508.291852:0:19486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:19486:1877727022089344:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790740508.291852:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 10000000:01000000:2.0:1790740508.291864:0:19486:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1790740508.291883:0:19486:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1790740508.291910:0:19486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98db83f32800/0xb25dda4f4e92ec1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ec21 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740508.291919:0:19486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98db83f32800/0xb25dda4f4e92ec1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92ec21 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740508.291945:0:19486:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98dcb6c3a800 10000000:01000000:2.0:1790740508.291950:0:19486:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1790740508.291956:0:19486:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1790740508.291959:0:19486:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790740508.291964:0:19486:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1790740508.291967:0:19486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1790740508.291989:0:19486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98db83f33e00/0xb25dda4f4e92efcb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740508.291998:0:19486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98db83f33e00/0xb25dda4f4e92efcb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740508.292007:0:19486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98db83f33e00/0xb25dda4f4e92efcb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740508.292022:0:19486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:19486:1877727022089472:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790740508.292080:0:19486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740508.292198:0:19486:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83ff4780 going to sleep for 11 seconds 00000100:00100000:1.0:1790740508.292224:0:17160:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022089472 00000100:00100000:1.0:1790740508.292228:0:17160:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022089472 00000100:00100000:1.0:1790740508.292258:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1790740508.292265:0:17160:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb6d1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+21:19486:x1877727022089472:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790740508.292273:0:17160:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740508.292286:0:17160:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcbfc45e00/0xb25dda4f4e92efd2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92efcb expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740508.292305:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcbfc45e00/0xb25dda4f4e92efd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92efcb expref: 22 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740508.292315:0:17160:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcbfc45e00/0xb25dda4f4e92efd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92efcb expref: 22 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740508.292324:0:17160:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcbfc45e00, rc 0) 00000100:00100000:1.0:1790740508.292439:0:17160:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb6d1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+22:19486:x1877727022089472:12345-0@lo:101:mount.lustre.0 Request processed in 173us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740508.292445:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790740508.292505:0:19486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:19486:1877727022089472:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790740508.292518:0:19486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98db83f33e00/0xb25dda4f4e92efcb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92efd2 expref: -99 pid: 19486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740508.292526:0:19486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98db83f33e00/0xb25dda4f4e92efcb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92efd2 expref: -99 pid: 19486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790740508.293656:0:19486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1790740508.298242:0:19486:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790740508.300086:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1790740508.300375:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1790740508.300391:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1790740508.300404:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1790740508.300418:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1790740508.300430:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1790740508.300456:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1790740508.300462:0:19486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1790740508.300572:0:19486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:19486:1877727022089600:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790740508.300646:0:19486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740508.300686:0:19486:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83ff46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790740508.300793:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022089600 00000100:00100000:0.0:1790740508.300802:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022089600 00000100:00100000:0.0:1790740508.300865:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1790740508.300874:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83b40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+22:19486:x1877727022089600:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790740508.301082:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83b40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+22:19486:x1877727022089600:12345-0@lo:501:mount.lustre.0 Request processed in 208us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740508.301201:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790740508.301463:0:19486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:19486:1877727022089600:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790740508.301503:0:19486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:19486:1877727022089728:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790740508.301549:0:19486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740508.301645:0:19486:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83ff46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790740508.305290:0:17160:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022089728 00000100:00100000:1.0:1790740508.305310:0:17160:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022089728 00000100:00100000:1.0:1790740508.305485:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1790740508.305496:0:17160:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83b43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+22:19486:x1877727022089728:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790740508.306405:0:17160:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83b43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+22:19486:x1877727022089728:12345-0@lo:503:mount.lustre.0 Request processed in 908us (4852us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740508.306416:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1790740508.306536:0:19486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:19486:1877727022089728:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790740508.306976:0:19486:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790740508.307085:0:19486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:19486:1877727022089856:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790740508.307302:0:19486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740508.307537:0:19486:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83ff4780 going to sleep for 11 seconds 00000100:00100000:0.0:1790740508.307615:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022089856 00000100:00100000:0.0:1790740508.307622:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022089856 00000100:00100000:0.0:1790740508.307656:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1790740508.307665:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83b42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+22:19486:x1877727022089856:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790740508.308086:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83b42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+22:19486:x1877727022089856:12345-0@lo:502:mount.lustre.0 Request processed in 421us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740508.308105:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1790740508.308276:0:19486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:19486:1877727022089856:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790740508.308478:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1790740508.308507:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1790740508.308533:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1790740508.308547:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1790740508.308561:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1790740508.308574:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1790740508.308588:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1790740508.308618:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1790740508.308633:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1790740508.308659:0:19486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:19486:1877727022089984:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790740508.308700:0:19486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740508.308724:0:19486:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83ff4780 going to sleep for 11 seconds 00000100:00100000:0.0:1790740508.308832:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022089984 00000100:00100000:0.0:1790740508.308838:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022089984 00000100:00100000:0.0:1790740508.308863:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1790740508.308877:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83b43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+22:19486:x1877727022089984:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790740508.308971:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83b43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+22:19486:x1877727022089984:12345-0@lo:502:mount.lustre.0 Request processed in 95us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740508.308978:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1790740508.309083:0:19486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:19486:1877727022089984:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790740508.309225:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1790740508.309233:0:19486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:0.0:1790740508.310212:0:19490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790740508.310221:0:19490:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1790740508.310229:0:19490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740508.310231:0:19490:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1790740508.310238:0:19490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790740508.310266:0:19490:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff98db83e999c0) 00000020:00000080:0.0:1790740508.310290:0:19490:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:0.0:1790740508.310298:0:19490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1790740508.310445:0:19490:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98dcb6c3a800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1790740508.310455:0:19490:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:0.0:1790740508.310462:0:19490:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb25dda4f4e92efe0 00010000:00010000:0.0:1790740508.317758:0:19490:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:0.0:1790740508.318485:0:19490:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:0.0:1790740508.320174:0:19490:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1790740508.326913:0:19490:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1790740508.326928:0:19490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790740508.326935:0:19490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740508.326937:0:19490:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1790740508.326940:0:19490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790740508.326945:0:19490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740508.326946:0:19490:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790740508.326949:0:19490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790740508.326951:0:19490:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1790740508.326954:0:19490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790740508.326956:0:19490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740508.326957:0:19490:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:0.0:1790740508.326960:0:19490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790740508.326969:0:19490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740508.326971:0:19490:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1790740508.326974:0:19490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1790740508.327007:0:19490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790740508.327010:0:19490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740508.327012:0:19490:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1790740508.327015:0:19490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1790740508.327481:0:19486:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1790740508.327512:0:19486:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1790740508.327531:0:19486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98db83f33e00/0xb25dda4f4e92efcb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92efd2 expref: -99 pid: 19486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740508.327545:0:19486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98db83f33e00/0xb25dda4f4e92efcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92efd2 expref: -99 pid: 19486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740508.327554:0:19486:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98dcb6c3a800 from 1 10000000:01000000:2.0:1790740508.327558:0:19486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790740508.327601:0:19486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98db83f33800/0xb25dda4f4e92efe7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740508.327611:0:19486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98db83f33800/0xb25dda4f4e92efe7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740508.327622:0:19486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98db83f33800/0xb25dda4f4e92efe7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740508.327650:0:19486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:19486:1877727022090112:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790740508.327718:0:19486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740508.327763:0:19486:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83ff4780 going to sleep for 11 seconds 00000100:00100000:0.0:1790740508.330222:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022090112 00000100:00100000:0.0:1790740508.330237:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022090112 00000100:00100000:0.0:1790740508.330303:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1790740508.330313:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83b40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+22:19486:x1877727022090112:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790740508.330341:0:17161:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740508.330360:0:17161:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcaf060400/0xb25dda4f4e92efee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92efe7 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740508.330391:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcaf060400/0xb25dda4f4e92efee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92efe7 expref: 23 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740508.330402:0:17161:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcaf060400/0xb25dda4f4e92efee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92efe7 expref: 23 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740508.330411:0:17161:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaf060400, rc 0) 00000100:00100000:0.0:1790740508.330492:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83b40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+23:19486:x1877727022090112:12345-0@lo:101:mount.lustre.0 Request processed in 180us (2773us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740508.330499:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1790740508.330663:0:19486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:19486:1877727022090112:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790740508.330682:0:19486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98db83f33800/0xb25dda4f4e92efe7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92efee expref: -99 pid: 19486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740508.330692:0:19486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98db83f33800/0xb25dda4f4e92efe7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92efee expref: -99 pid: 19486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790740508.333596:0:19486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1790740508.333927:0:19486:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790740508.335552:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1790740508.335608:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1790740508.335634:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1790740508.335640:0:19486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1790740508.337220:0:19486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:19486:1877727022090240:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790740508.337305:0:19486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740508.337374:0:19486:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82de2f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790740508.338543:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022090240 00000100:00100000:1.0:1790740508.338553:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022090240 00000100:00100000:1.0:1790740508.338613:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1790740508.338631:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83b42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+23:19486:x1877727022090240:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790740508.338784:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83b42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+23:19486:x1877727022090240:12345-0@lo:501:mount.lustre.0 Request processed in 154us (1478us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740508.338793:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1790740508.338934:0:19486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:19486:1877727022090240:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790740508.338987:0:19486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:19486:1877727022090368:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790740508.339297:0:19486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740508.341648:0:19486:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82de2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790740508.348236:0:17160:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022090368 00000100:00100000:2.0:1790740508.348249:0:17160:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022090368 00000100:00100000:2.0:1790740508.348309:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1790740508.348330:0:17160:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83b41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+23:19486:x1877727022090368:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790740508.348493:0:17160:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83b41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+23:19486:x1877727022090368:12345-0@lo:503:mount.lustre.0 Request processed in 176us (9196us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740508.348501:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1790740508.348724:0:19486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:19486:1877727022090368:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790740508.349196:0:19486:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790740508.349271:0:19486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:19486:1877727022090496:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790740508.349336:0:19486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740508.349366:0:19486:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82de2000 going to sleep for 11 seconds 00000100:00100000:1.0:1790740508.349563:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022090496 00000100:00100000:1.0:1790740508.349569:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022090496 00000100:00100000:1.0:1790740508.349607:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790740508.349615:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83b43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+23:19486:x1877727022090496:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790740508.349709:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83b43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+23:19486:x1877727022090496:12345-0@lo:502:mount.lustre.0 Request processed in 95us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740508.349716:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790740508.349759:0:19486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:19486:1877727022090496:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790740508.349970:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1790740508.349995:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1790740508.350009:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1790740508.350022:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1790740508.350063:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1790740508.350079:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1790740508.350228:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1790740508.350245:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1790740508.350256:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1790740508.350268:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1790740508.350281:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1790740508.350304:0:19486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84526d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:19486:1877727022090624:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790740508.350582:0:19486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740508.350607:0:19486:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc909bfe40 going to sleep for 11 seconds 00000100:00100000:2.0:1790740508.350657:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022090624 00000100:00100000:2.0:1790740508.350663:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022090624 00000100:00100000:2.0:1790740508.350699:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1790740508.350706:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83b41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+23:19486:x1877727022090624:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790740508.350795:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83b41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+23:19486:x1877727022090624:12345-0@lo:502:mount.lustre.0 Request processed in 89us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740508.350802:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1790740508.351730:0:19486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84526d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:19486:1877727022090624:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790740508.351816:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1790740508.351827:0:19486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1790740508.355398:0:19494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790740508.355414:0:19494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790740508.355416:0:19494:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1790740508.355424:0:19494:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98dcb6c3a800 00000020:00000080:3.0:1790740508.355427:0:19494:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790740508.355440:0:19494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790740508.355443:0:19494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790740508.355444:0:19494:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1790740508.355446:0:19494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790740508.355449:0:19494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790740508.355450:0:19494:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1790740508.355453:0:19494:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98dcb6c3a800 00000020:00000080:3.0:1790740508.355455:0:19494:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790740508.355520:0:19494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790740508.355524:0:19494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790740508.355525:0:19494:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1790740508.355528:0:19494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790740508.355530:0:19494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790740508.355532:0:19494:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790740508.355535:0:19494:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98dcb6c3a800 00000020:00000080:3.0:1790740508.355537:0:19494:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790740508.355558:0:19494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790740508.355568:0:19494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790740508.355569:0:19494:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790740508.355572:0:19494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790740508.355575:0:19494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790740508.355576:0:19494:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1790740508.355580:0:19494:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98dcb6c3a800 00000020:00000080:3.0:1790740508.355582:0:19494:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790740508.355609:0:19494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790740508.355613:0:19494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790740508.355614:0:19494:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1790740508.355617:0:19494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1790740508.355848:0:19486:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1790740508.355883:0:19486:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790740508.355915:0:19486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98db83f33800/0xb25dda4f4e92efe7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92efee expref: -99 pid: 19486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740508.355927:0:19486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98db83f33800/0xb25dda4f4e92efe7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92efee expref: -99 pid: 19486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740508.355979:0:19486:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1790740508.355987:0:19486:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98dcb6c3a800 10000000:01000000:2.0:1790740508.355990:0:19486:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98dcb6c3a800 10000000:01000000:2.0:1790740508.355994:0:19486:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790740508.356000:0:19486:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98dcb6c3a800 from 1 10000000:01000000:2.0:1790740508.356003:0:19486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790740508.356064:0:19486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92eff5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740508.356074:0:19486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92eff5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740508.356085:0:19486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92eff5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740508.356121:0:19486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:19486:1877727022090752:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790740508.356186:0:19486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740508.356224:0:19486:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83ff43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790740508.361130:0:17160:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022090752 00000100:00100000:0.0:1790740508.361145:0:17160:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022090752 00000100:00100000:0.0:1790740508.361209:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1790740508.361219:0:17160:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83b42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+23:19486:x1877727022090752:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790740508.361239:0:17160:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740508.361272:0:17160:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcaf060e00/0xb25dda4f4e92effc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92eff5 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740508.361303:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcaf060e00/0xb25dda4f4e92effc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92eff5 expref: 24 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740508.361327:0:17160:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcaf060e00/0xb25dda4f4e92effc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92eff5 expref: 24 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740508.361338:0:17160:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaf060e00, rc 0) 00000100:00100000:0.0:1790740508.361422:0:17160:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83b42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+24:19486:x1877727022090752:12345-0@lo:101:mount.lustre.0 Request processed in 205us (5236us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740508.361430:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1790740508.361617:0:19486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:19486:1877727022090752:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790740508.361637:0:19486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92eff5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92effc expref: -99 pid: 19486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740508.361647:0:19486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92eff5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92effc expref: -99 pid: 19486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790740508.374790:0:19486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:2.0:1790740508.376642:0:19486:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790740508.376908:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1790740508.376937:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1790740508.376952:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1790740508.376966:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1790740508.376992:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1790740508.377006:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1790740508.377017:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1790740508.377048:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1790740508.377065:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1790740508.377077:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1790740508.378511:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1790740508.378542:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1790740508.378556:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1790740508.378569:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1790740508.378583:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1790740508.378597:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1790740508.378609:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1790740508.378621:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1790740508.378632:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1790740508.378644:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1790740508.378657:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1790740508.378669:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1790740508.378682:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1790740508.378696:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1790740508.378708:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1790740508.378720:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1790740508.378751:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1790740508.378766:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1790740508.378778:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1790740508.378791:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1790740508.378804:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1790740508.378817:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1790740508.378831:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1790740508.378843:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1790740508.378855:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1790740508.378873:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1790740508.378885:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1790740508.378923:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1790740508.378936:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:2.0:1790740508.378949:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:2.0:1790740508.378962:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:2.0:1790740508.378976:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:2.0:1790740508.379003:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:2.0:1790740508.379019:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:2.0:1790740508.379053:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:2.0:1790740508.379068:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:2.0:1790740508.382658:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:2.0:1790740508.382680:0:19486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:2.0:1790740508.382790:0:19486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:19486:1877727022090880:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790740508.382860:0:19486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740508.382925:0:19486:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83ff4780 going to sleep for 11 seconds 00000100:00100000:0.0:1790740508.384079:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022090880 00000100:00100000:0.0:1790740508.384095:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022090880 00000100:00100000:0.0:1790740508.384153:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1790740508.384162:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83b43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+24:19486:x1877727022090880:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790740508.384596:0:19486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:19486:1877727022090880:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790740508.384651:0:19486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:19486:1877727022091008:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790740508.384707:0:19486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740508.384776:0:19486:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83ff4780 going to sleep for 11 seconds 00000100:00100000:0.0:1790740508.384810:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83b43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+24:19486:x1877727022090880:12345-0@lo:501:mount.lustre.0 Request processed in 649us (1950us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740508.384819:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1790740508.384849:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022091008 00000100:00100000:0.0:1790740508.384853:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022091008 00000100:00100000:1.0:1790740508.389511:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1790740508.389532:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83b41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+24:19486:x1877727022091008:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790740508.389720:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83b41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+24:19486:x1877727022091008:12345-0@lo:503:mount.lustre.0 Request processed in 197us (5012us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740508.389728:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1790740508.389969:0:19486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:19486:1877727022091008:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790740508.390569:0:19486:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790740508.390665:0:19486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:19486:1877727022091136:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790740508.390723:0:19486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740508.390763:0:19486:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82de2300 going to sleep for 11 seconds 00000100:00100000:1.0:1790740508.390899:0:17160:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022091136 00000100:00100000:1.0:1790740508.390906:0:17160:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022091136 00000100:00100000:1.0:1790740508.390951:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1790740508.390959:0:17160:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83b42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+24:19486:x1877727022091136:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790740508.391083:0:17160:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83b42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+24:19486:x1877727022091136:12345-0@lo:502:mount.lustre.0 Request processed in 125us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740508.391183:0:19486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:19486:1877727022091136:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790740508.391409:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1790740508.391438:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1790740508.391453:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1790740508.391467:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1790740508.391481:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1790740508.391494:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1790740508.391505:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1790740508.391517:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1790740508.391530:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1790740508.391544:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1790740508.391570:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1790740508.391585:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1790740508.391598:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1790740508.391611:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1790740508.391623:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1790740508.391634:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1790740508.391647:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1790740508.391661:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1790740508.391673:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1790740508.391702:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1790740508.391717:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1790740508.391728:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1790740508.391740:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1790740508.391753:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1790740508.391765:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1790740508.391776:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1790740508.391789:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1790740508.391801:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1790740508.391814:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1790740508.391828:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1790740508.391841:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1790740508.391854:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1790740508.391868:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1790740508.391880:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1790740508.391908:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1790740508.391935:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1790740508.391950:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1790740508.391965:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1790740508.391979:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1790740508.391992:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1790740508.392004:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1790740508.392017:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1790740508.392054:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1790740508.392081:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000100:00100000:1.0:1790740508.392273:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000040:00080000:2.0:1790740508.393282:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1790740508.393303:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1790740508.394185:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1790740508.394227:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1790740508.394289:0:19486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:19486:1877727022091264:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790740508.394457:0:19486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740508.394502:0:19486:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc99069540 going to sleep for 11 seconds 00000100:00100000:0.0:1790740508.394995:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022091264 00000100:00100000:0.0:1790740508.395005:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022091264 00000100:00100000:0.0:1790740508.395078:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1790740508.395562:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+24:19486:x1877727022091264:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790740508.395713:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+24:19486:x1877727022091264:12345-0@lo:502:mount.lustre.0 Request processed in 626us (1255us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740508.395722:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1790740508.395812:0:19486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:19486:1877727022091264:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790740508.396006:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1790740508.396071:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1790740508.398239:0:19486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:19486:1877727022091392:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790740508.399191:0:19486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740508.399239:0:19486:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc99069540 going to sleep for 11 seconds 00000100:00100000:1.0:1790740508.400231:0:17160:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022091392 00000100:00100000:1.0:1790740508.400243:0:17160:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022091392 00000100:00100000:1.0:1790740508.400303:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1790740508.400313:0:17160:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+24:19486:x1877727022091392:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790740508.400773:0:17160:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+24:19486:x1877727022091392:12345-0@lo:502:mount.lustre.0 Request processed in 461us (1584us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740508.400781:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1790740508.400857:0:19486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:19486:1877727022091392:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790740508.400958:0:19486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1790740508.400972:0:19486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1790740508.414481:0:19499:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1790740508.414500:0:19499:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff98db83e9cd40) 00000020:00000080:0.0:1790740508.414527:0:19499:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:0.0:1790740508.414609:0:19499:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98dcb6c3a800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1790740508.414613:0:19499:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98dcb6c3a800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1790740508.414615:0:19499:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98dcb6c3a800 3 00010000:00080000:0.0:1790740508.414647:0:19499:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98db83e43000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.103@tcp at head 00010000:00010000:0.0:1790740508.416362:0:19499:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:0.0:1790740508.416611:0:19499:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1790740508.416748:0:19499:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790740508.416762:0:19499:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xb25dda4f4e92f00a 00000100:00080000:0.0:1790740508.416775:0:19499:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790740508.416787:0:19499:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98db83e43000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:0.0:1790740508.416842:0:19499:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98db84532a00 x1877727022091520/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790740508.416867:0:19499:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1790740508.416940:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790740508.416944:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790740508.416946:0:37:0:(import.c:65:import_set_state_nolock()) ffff98dcaeddd000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790740508.416951:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 577 00000100:00080000:0.0:1790740508.416954:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1790740508.416959:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98dcaeddd000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:0.0:1790740508.416971:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98dcb5df1c00 x1877727022091904/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790740508.417004:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790740508.417007:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790740508.417009:0:37:0:(import.c:65:import_set_state_nolock()) ffff98dc88508000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790740508.417020:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 577 00000100:00080000:0.0:1790740508.417023:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1790740508.417028:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff98dc88508000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:0.0:1790740508.417066:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98dcb5df2d80 x1877727022092416/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790740508.417115:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84533100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022091648:0@lo:400:kworker.0 00000100:00100000:1.0:1790740508.417495:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84532a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1877727022091520:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790740508.417546:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740508.417591:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5df1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877727022091904:0@lo:8:kworker.0 00000100:00100000:1.0:1790740508.417615:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740508.417634:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5df2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877727022092416:0@lo:8:kworker.0 00000100:00100000:1.0:1790740508.417653:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740508.417680:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5df1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727022092032:0@lo:400:kworker.0 00000100:00100000:1.0:1790740508.417713:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740508.417730:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5df2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877727022092672:0@lo:400:kworker.0 00000100:00100000:1.0:1790740508.417748:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740508.417770:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1790740508.417775:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5df0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022092160:0@lo:400:kworker.0 00000100:00100000:1.0:1790740508.417811:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740508.417827:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5df1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1877727022092800:0@lo:400:kworker.0 00000100:00100000:1.0:1790740508.417844:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740508.417865:0:17167:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022091520 00000100:00100000:1.0:1790740508.417871:0:17167:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022091520 00000100:00100000:1.0:1790740508.417904:0:17167:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022092032 00000100:00100000:1.0:1790740508.417907:0:17167:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022092032 00000100:00100000:1.0:1790740508.417926:0:17167:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022092672 00000100:00100000:1.0:1790740508.417928:0:17167:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022092672 00000100:00100000:1.0:1790740508.417951:0:17167:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022092800 00000100:00100000:1.0:1790740508.417954:0:17167:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022092800 00000100:00100000:1.0:1790740508.417971:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790740508.417978:0:17167:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727022092032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740508.418027:0:17167:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877727022092032:12345-0@lo:400:kworker.0 Request processed in 49us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740508.418052:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790740508.418074:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790740508.418080:0:17167:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877727022092672:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1790740508.423235:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790740508.423246:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790740508.423266:0:17171:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022092160 00000100:00100000:2.0:1790740508.423276:0:17171:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022092160 00000100:00100000:2.0:1790740508.423347:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790740508.423358:0:17171:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022092160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740508.423454:0:17171:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022092160:12345-0@lo:400:kworker.0 Request processed in 98us (5641us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740508.423461:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790740508.423488:0:17165:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1790740508.423496:0:17165:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1790740508.423513:0:17166:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1790740508.423521:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790740508.423527:0:17166:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1877727022091520:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1790740508.423564:0:17166:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 579 last 0 00000020:00000080:2.0:1790740508.423600:0:17166:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xb25dda4f4e92f011 00000004:00100000:2.0:1790740508.423619:0:17166:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790740508.423656:0:17166:0:(import.c:65:import_set_state_nolock()) ffff98db82ff7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790740508.423703:0:17166:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1877727022091520:12345-0@lo:38:llog_process_th.0 Request processed in 174us (6157us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740508.423710:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790740508.423848:0:17166:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1790740508.423857:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790740508.423865:0:17166:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877727022092800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740508.423912:0:17166:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877727022092800:12345-0@lo:400:kworker.0 Request processed in 48us (6067us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740508.423920:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790740508.423942:0:18673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022091904 00000100:00100000:2.0:1790740508.423947:0:18673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022091904 00000100:00100000:2.0:1790740508.423967:0:18673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022092416 00000100:00100000:2.0:1790740508.423971:0:18673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022092416 00000100:00100000:2.0:1790740508.423981:0:18673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790740508.423986:0:18673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84524e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1877727022091904:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1790740508.424051:0:18673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84524e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1877727022091904:12345-0@lo:8:kworker.0 Request processed in 41us (6412us total) trans 0 rc -11/-11 00000100:00100000:2.0:1790740508.424058:0:18673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790740508.424070:0:18673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790740508.424074:0:18673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84525c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1877727022092416:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1790740508.424918:0:17167:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877727022092672:12345-0@lo:400:kworker.0 Request processed in 6833us (7163us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740508.424927:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790740508.424981:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5df0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022092160:0@lo:400:kworker.0 00010000:00080000:1.0:1790740508.424997:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98dcb5df1180 x1877727022092800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740508.425007:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5df1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1877727022092800:0@lo:400:kworker.0 00010000:00080000:1.0:1790740508.425017:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98dcb5df1f80 x1877727022092032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740508.425026:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5df1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877727022092032:0@lo:400:kworker.0 00010000:00080000:1.0:1790740508.425054:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98dcb5df2a00 x1877727022092672/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740508.425063:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5df2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877727022092672:0@lo:400:kworker.0 00000100:00100000:2.0:1790740508.425259:0:18673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84525c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1877727022092416:12345-0@lo:8:kworker.0 Request processed in 1182us (7604us total) trans 0 rc -11/-11 00000100:00100000:2.0:1790740508.425266:0:18673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790740508.425445:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740508.425488:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5df3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022092288:0@lo:400:kworker.0 00000100:00100000:0.0:1790740508.425525:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740508.425547:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1790740508.425554:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5df3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022091776:0@lo:400:kworker.0 00000100:00100000:0.0:1790740508.425576:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740508.425592:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5df0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877727022092544:0@lo:400:kworker.0 00000100:00100000:0.0:1790740508.425614:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740508.425654:0:17907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022091648 00000100:00100000:0.0:1790740508.425660:0:17907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022091648 00000100:00100000:0.0:1790740508.425696:0:17907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790740508.425702:0:17907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727022091648:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1790740508.425939:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98db84532a00 x1877727022091520/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790740518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740508.425950:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790740508.425958:0:3637:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1790740508.425966:0:3637:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1790740508.425971:0:3637:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790740508.425974:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98db83e43000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790740508.425981:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84532a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1877727022091520:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790740508.425996:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790740508.426000:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98dcaeddd000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790740508.426003:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1790740508.426006:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5df1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877727022091904:0@lo:8:kworker.0 00000100:00100000:2.0:1790740508.426018:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790740508.426021:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98dc88508000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790740508.426024:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1790740508.426027:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5df2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877727022092416:0@lo:8:kworker.0 00000100:00100000:2.0:1790740508.426077:0:18674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022092288 00000100:00100000:2.0:1790740508.426081:0:18674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022092288 00000100:00100000:0.0:1790740508.427254:0:17907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727022091648:12345-0@lo:400:kworker.0 Request processed in 1547us (1805us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740508.427267:0:17907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790740508.427465:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84533100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022091648:0@lo:400:kworker.0 00000100:00100000:2.0:1790740508.431676:0:18674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022091776 00000100:00100000:2.0:1790740508.431691:0:18674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022091776 00000100:00100000:3.0:1790740508.432077:0:17166:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022092544 00000100:00100000:3.0:1790740508.432082:0:17166:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022092544 00000100:00100000:3.0:1790740508.432130:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790740508.432140:0:17166:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877727022092544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740508.432233:0:17166:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877727022092544:12345-0@lo:400:kworker.0 Request processed in 94us (6617us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740508.432240:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790740508.432274:0:18675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790740508.432281:0:18675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022092288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740508.432310:0:18675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022092288:12345-0@lo:400:kworker.0 Request processed in 30us (6784us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740508.432331:0:18675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1790740508.433355:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98dcb5df0e00 x1877727022092544/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740508.433373:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5df0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877727022092544:0@lo:400:kworker.0 00000100:00100000:1.0:1790740508.433393:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5df3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022092288:0@lo:400:kworker.0 00000100:00080000:0.0:1790740508.437137:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790740508.437377:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790740508.437390:0:18674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727022091776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740508.437499:0:18674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727022091776:12345-0@lo:400:kworker.0 Request processed in 113us (11920us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740508.437506:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790740508.437578:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5df3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022091776:0@lo:400:kworker.0 00000020:01000004:2.0:1790740508.441992:0:19499:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1790740508.442011:0:19499:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff98dcae17b380) 00000020:00000080:2.0:1790740508.442060:0:19499:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1790740508.442291:0:19499:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98dcb6c3a800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1790740508.442296:0:19499:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98dcb6c3a800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1790740508.442299:0:19499:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98dcb6c3a800 3 00010000:00080000:2.0:1790740508.442400:0:19499:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98db83e40800@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.103@tcp at head 00010000:00010000:2.0:1790740508.445603:0:19499:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:2.0:1790740508.447837:0:19499:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1790740508.447997:0:19499:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790740508.448012:0:19499:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xb25dda4f4e92f01f 00000100:00080000:2.0:1790740508.448023:0:19499:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790740508.448064:0:19499:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff98db83e40800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:2.0:1790740508.448116:0:19499:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98db83e1f100 x1877727022092928/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790740508.448152:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1877727022092928:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790740508.448228:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790740508.448294:0:19499:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1790740508.448873:0:17166:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022092928 00000100:00100000:0.0:1790740508.448882:0:17166:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022092928 00000100:00100000:0.0:1790740508.448936:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790740508.448945:0:17166:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1877727022092928:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1790740508.448981:0:17166:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 579 last 0 00000020:00000080:0.0:1790740508.449047:0:17166:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xb25dda4f4e92f026 00000004:00100000:0.0:1790740508.449066:0:17166:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790740508.449287:0:17166:0:(import.c:65:import_set_state_nolock()) ffff98db8295c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790740508.449523:0:17166:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1877727022092928:12345-0@lo:38:llog_process_th.0 Request processed in 577us (1294us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740508.449532:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:3.0:1790740508.449715:0:19499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1790740508.450079:0:19486:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1790740508.450127:0:19486:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790740508.450155:0:19486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92eff5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92effc expref: -99 pid: 19486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740508.450167:0:19486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98db83f33a00/0xb25dda4f4e92eff5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92effc expref: -99 pid: 19486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1790740508.450214:0:19486:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1790740508.450217:0:19486:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790740508.450218:0:19486:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790740508.450220:0:19486:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790740508.450221:0:19486:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790740508.450222:0:19486:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790740508.450223:0:19486:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790740508.450225:0:19486:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790740508.450226:0:19486:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790740508.450232:0:19486:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1790740508.450235:0:19486:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790740508.450236:0:19486:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790740508.450237:0:19486:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790740508.450238:0:19486:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790740508.450239:0:19486:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790740508.450240:0:19486:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790740508.450241:0:19486:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790740508.450242:0:19486:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790740508.450243:0:19486:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790740508.450266:0:19486:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1790740508.450284:0:19486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:19486:1877727022093056:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1790740508.450520:0:19486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740508.450560:0:19486:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83ce46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790740508.450713:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022093056 00000100:00100000:0.0:1790740508.450720:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022093056 00000100:00100000:0.0:1790740508.450761:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1790740508.450769:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+24:19486:x1877727022093056:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790740508.450794:0:17161:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1790740508.450809:0:17161:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:2.0:1790740508.454275:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98db83e1f100 x1877727022092928/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790740518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740508.454291:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790740508.454302:0:3637:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1790740508.454311:0:3637:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1790740508.454706:0:3637:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1790740508.454711:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98db83e40800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790740508.454720:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1877727022092928:0@lo:38:llog_process_th.0 20000000:01000000:1.0:1790740508.466165:0:17161:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790740508.466184:0:17161:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1790740508.466439:0:17181:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790740508.466444:0:17181:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790740508.466468:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98db83f32000/0xb25dda4f4e92f02d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740508.466488:0:17181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dcbfc44600/0xb25dda4f4e92eedd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92eed6 expref: 24 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740508.466497:0:17181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98db83f33400/0xb25dda4f4e92eeeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92eee4 expref: 24 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740508.466506:0:17181:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98db83f32000/0xb25dda4f4e92f02d lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740508.466553:0:17181:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98db83f33400/0xb25dda4f4e92eeeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92eee4 expref: 24 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740508.466569:0:17181:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98db83f33400/0xb25dda4f4e92eeeb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92eee4 expref: 24 pid: 17159 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740508.466583:0:17181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1f100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17181:1877727022093184:0@lo:104: 00000100:00100000:2.0:1790740508.466728:0:17181:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790740508.466779:0:17181:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dcbfc44600/0xb25dda4f4e92eedd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92eed6 expref: 24 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740508.466787:0:17181:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98dcbfc44600/0xb25dda4f4e92eedd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92eed6 expref: 24 pid: 17161 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740508.466795:0:17181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17181:1877727022093312:0@lo:104: 00000100:00100000:2.0:1790740508.466816:0:17181:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740508.466849:0:17181:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc86ae3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740508.466881:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022093184 00000100:00100000:2.0:1790740508.466899:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022093184 00000100:00100000:2.0:1790740508.466935:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022093312 00000100:00100000:2.0:1790740508.466938:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022093312 00000100:00100000:2.0:1790740508.466951:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790740508.466960:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+4:17181:x1877727022093184:12345-0@lo:104: 00010000:00010000:2.0:1790740508.466974:0:17149:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff98db83f33600/0xb25dda4f4e92eee4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92eeeb expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740508.467051:0:17149:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790740508.467057:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+4:17181:x1877727022093184:12345-0@lo:104: Request processed in 99us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740508.467065:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790740508.467081:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790740508.467488:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+24:19486:x1877727022093056:12345-0@lo:253:mount.lustre.0 Request processed in 16719us (16967us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740508.467498:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1790740508.467563:0:19486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0847d467-2c8f-428f-ab2a-50e9cfba84d8:19486:1877727022093056:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790740508.467582:0:19486:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1790740508.467586:0:19486:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790740508.467588:0:19486:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790740508.467589:0:19486:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790740508.467591:0:19486:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790740508.467592:0:19486:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790740508.467593:0:19486:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790740508.467595:0:19486:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790740508.467596:0:19486:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790740508.467598:0:19486:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1790740508.467613:0:19486:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1790740508.467900:0:17155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740508.467907:0:17155:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98db83f33600/0xb25dda4f4e92eee4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92eeeb expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740508.467916:0:17155:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f33600 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:3.0:1790740508.467920:0:17155:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98db83f33600/0xb25dda4f4e92eee4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92eeeb expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740508.467928:0:17155:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98db83f33600/0xb25dda4f4e92eee4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92eeeb expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790740508.467935:0:17155:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98db83f33600/0xb25dda4f4e92eee4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92eeeb expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740508.467941:0:17155:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790740508.467974:0:17155:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98db83f33600/0xb25dda4f4e92eee4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92eeeb expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740508.467981:0:17155:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790740508.468002:0:17155:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98db83f33600/0xb25dda4f4e92eee4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92eeeb expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740508.468009:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98db83f33600/0xb25dda4f4e92eee4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92eeeb expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740508.468019:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740508.468021:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740508.468023:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740508.468427:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+3:17181:x1877727022093312:12345-0@lo:104: 00010000:00010000:2.0:1790740508.468439:0:17149:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9a00/0xb25dda4f4e92eed6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92eedd expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740508.468498:0:17149:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790740508.468503:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+3:17181:x1877727022093312:12345-0@lo:104: Request processed in 1418us (1687us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740508.468511:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1790740508.468534:0:17154:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790740508.468539:0:17154:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9a00/0xb25dda4f4e92eed6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92eedd expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740508.468546:0:17154:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc9a00 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:2.0:1790740508.468550:0:17154:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9a00/0xb25dda4f4e92eed6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92eedd expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740508.468567:0:17154:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9a00/0xb25dda4f4e92eed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92eedd expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790740508.468573:0:17154:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9a00/0xb25dda4f4e92eed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92eedd expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740508.468579:0:17154:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790740508.468601:0:17154:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9a00/0xb25dda4f4e92eed6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92eedd expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740508.468607:0:17154:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790740508.468615:0:17154:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9a00/0xb25dda4f4e92eed6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92eedd expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740508.468622:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc9a00/0xb25dda4f4e92eed6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92eedd expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740508.469309:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3640:1877727022093440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790740508.469434:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740508.469484:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790740508.469491:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3640:1877727022093568:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790740508.469514:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740508.469551:0:17153:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022093440 00000100:00100000:3.0:1790740508.469558:0:17153:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022093440 00010000:00010000:3.0:1790740508.469583:0:17153:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98db83f33400/0xb25dda4f4e92eeeb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92eee4 expref: 24 pid: 17159 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740508.469604:0:17153:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022093568 00000100:00100000:3.0:1790740508.469607:0:17153:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022093568 00010000:00010000:3.0:1790740508.469617:0:17153:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dcbfc44600/0xb25dda4f4e92eedd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92eed6 expref: 25 pid: 17161 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740508.470205:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740508.470208:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740508.470210:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740508.470241:0:17181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1f100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17181:1877727022093184:0@lo:104: 00000100:00100000:2.0:1790740508.470251:0:17181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17181:1877727022093312:0@lo:104: 00010000:00010000:2.0:1790740508.470273:0:17181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98db83f32000/0xb25dda4f4e92f02d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740508.470799:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790740508.470811:0:17153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+25:3640:x1877727022093440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790740508.470828:0:17153:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740508.470835:0:17153:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98db83f33400/0xb25dda4f4e92eeeb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92eee4 expref: 25 pid: 17159 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740508.470846:0:17153:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98db83f33400/0xb25dda4f4e92eeeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92eee4 expref: 25 pid: 17159 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740508.470861:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98db83f33400/0xb25dda4f4e92eeeb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92eee4 expref: 25 pid: 17159 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740508.470874:0:17153:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740508.470943:0:17153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+24:3640:x1877727022093440:12345-0@lo:103:ldlm_bl.0 Request processed in 136us (1508us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740508.470951:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790740508.470979:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790740508.470994:0:17153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+23:3640:x1877727022093568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790740508.471001:0:17153:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740508.471005:0:17153:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dcbfc44600/0xb25dda4f4e92eedd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92eed6 expref: 23 pid: 17161 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740508.471014:0:17153:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dcbfc44600/0xb25dda4f4e92eedd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92eed6 expref: 23 pid: 17161 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740508.471023:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcbfc44600/0xb25dda4f4e92eedd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92eed6 expref: 23 pid: 17161 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740508.471050:0:17153:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98db83f32000/0xb25dda4f4e92f02d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740508.471058:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98db83f32000/0xb25dda4f4e92f02d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790740508.471071:0:17153:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007507663s 00010000:00010000:3.0:1790740508.471075:0:17153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98db83f32000/0xb25dda4f4e92f02d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740508.471082:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98db83f32000/0xb25dda4f4e92f02d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740508.471860:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3640:1877727022093440:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790740508.472510:0:17153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98db83f32000/0xb25dda4f4e92f02d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740508.472518:0:17153:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98db83f32000/0xb25dda4f4e92f02d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740508.472524:0:17153:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f32000 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:3.0:1790740508.472541:0:17153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98db83f32000/0xb25dda4f4e92f02d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740508.472551:0:17153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98db83f32000/0xb25dda4f4e92f02d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740508.472573:0:17153:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98db83f32000/0xb25dda4f4e92f02d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740508.472586:0:17153:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790740508.472822:0:17181:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98db83f32000/0xb25dda4f4e92f02d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740508.472839:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98db83f32000/0xb25dda4f4e92f02d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740508.472846:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98db83f32000/0xb25dda4f4e92f02d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740508.473454:0:17153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+22:3640:x1877727022093568:12345-0@lo:103:ldlm_bl.0 Request processed in 2456us (3934us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740508.473466:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790740508.473761:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3640:1877727022093568:0@lo:103:ldlm_bl.0 00000001:00000004:1.0:1790740508.491590:0:19486:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1790740508.495406:0:19486:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1790740508.495417:0:19486:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1790740508.495469:0:19486:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790740508.495515:0:19486:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.103@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790740508.495535:0:19486:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1790740508.495571:0:19486:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1790740508.497004:0:19486:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790740508.497508:0:19486:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790740508.843261:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740509.293530:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5df0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022093696:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790740509.293617:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740509.294105:0:18676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022093696 00000100:00100000:0.0:1790740509.294115:0:18676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022093696 00000100:00100000:0.0:1790740509.294175:0:18676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790740509.294184:0:18676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022093696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790740509.294214:0:18676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1790740509.294269:0:18676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022093696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740509.294278:0:18676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790740509.294329:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5df0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022093696:0@lo:13:osp-pre-0-1.0 00000020:00000004:0.0:1790740509.533356:0:19553:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790740509.533673:0:19553:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1790740509.803410:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022093824:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790740509.803507:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740509.803590:0:17170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022093824 00000100:00100000:2.0:1790740509.803599:0:17170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022093824 00000100:00100000:2.0:1790740509.803654:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790740509.803664:0:17170:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022093824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790740509.803717:0:17170:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1790740509.804153:0:17170:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022093824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 489us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740509.804161:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790740509.804567:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022093824:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1790740509.867947:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790740510.252534:0:17201:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1790740510.314932:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790740510.315018:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022093952:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790740510.317771:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740510.317841:0:17171:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022093952 00000100:00100000:2.0:1790740510.317850:0:17171:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022093952 00000100:00100000:2.0:1790740510.317928:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790740510.317938:0:17171:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022093952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790740510.317994:0:17171:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790740510.318103:0:17171:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022093952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 166us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740510.318110:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790740510.318246:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022093952:0@lo:41:osp-pre-1-0.0 10000000:01000000:2.0:1790740510.525544:0:17163:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790740510.525553:0:17163:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98dcae18b800 from 10 10000000:01000000:2.0:1790740510.525559:0:17163:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790740510.525607:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98db83f32000/0xb25dda4f4e92f034 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740510.525620:0:17163:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98db83f32000/0xb25dda4f4e92f034 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740510.525632:0:17163:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98db83f32000/0xb25dda4f4e92f034 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740510.525665:0:17163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022094080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790740510.525734:0:17163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740510.527738:0:17163:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc99069540 going to sleep for 11 seconds 00000100:00100000:0.0:1790740510.533413:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022094080 00000100:00100000:0.0:1790740510.533429:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022094080 00000100:00100000:0.0:1790740510.534478:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1790740510.534490:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+22:17163:x1877727022094080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790740510.534509:0:17159:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740510.534530:0:17159:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcaf060000/0xb25dda4f4e92f03b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92f034 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740510.534560:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcaf060000/0xb25dda4f4e92f03b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92f034 expref: 23 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740510.534573:0:17159:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcaf060000/0xb25dda4f4e92f03b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92f034 expref: 23 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740510.534582:0:17159:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaf060000, rc 0) 00000100:00100000:0.0:1790740510.534665:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+23:17163:x1877727022094080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (8930us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740510.534672:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1790740510.535926:0:17163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022094080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790740510.535953:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98db83f32000/0xb25dda4f4e92f034 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92f03b expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740510.535965:0:17163:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98db83f32000/0xb25dda4f4e92f034 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92f03b expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740510.536071:0:17163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022094208:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1790740510.536127:0:17163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740510.536174:0:17163:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc99069540 going to sleep for 11 seconds 00000100:00100000:0.0:1790740510.536261:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022094208 00000100:00100000:0.0:1790740510.536268:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022094208 00000100:00100000:0.0:1790740510.536324:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1790740510.536333:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+23:17163:x1877727022094208:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1790740510.536352:0:17161:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790740510.536370:0:17161:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790740510.536373:0:17161:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1790740510.536458:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+23:17163:x1877727022094208:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 127us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740510.536473:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1790740510.536666:0:17163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022094208:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1790740510.536730:0:17163:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790740510.536738:0:17163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98db83f32000/0xb25dda4f4e92f034 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92f03b expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740510.536748:0:17163:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98db83f32000/0xb25dda4f4e92f034 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92f03b expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740510.536758:0:17163:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790740510.536761:0:17163:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98db84771800 from 10 10000000:01000000:3.0:1790740510.536764:0:17163:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790740510.536800:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8000/0xb25dda4f4e92f042 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740510.536809:0:17163:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8000/0xb25dda4f4e92f042 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740510.536828:0:17163:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8000/0xb25dda4f4e92f042 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740510.536842:0:17163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022094336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790740510.536883:0:17163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740510.536910:0:17163:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc993306c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740510.537011:0:17160:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022094336 00000100:00100000:2.0:1790740510.537016:0:17160:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022094336 00000100:00100000:2.0:1790740510.537098:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1790740510.537106:0:17160:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+23:17163:x1877727022094336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790740510.537116:0:17160:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740510.537127:0:17160:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98db83f32c00/0xb25dda4f4e92f049 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92f042 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740510.537146:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98db83f32c00/0xb25dda4f4e92f049 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92f042 expref: 24 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740510.537156:0:17160:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98db83f32c00/0xb25dda4f4e92f049 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92f042 expref: 24 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740510.537164:0:17160:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f32c00, rc 0) 00000100:00100000:2.0:1790740510.537196:0:17160:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+24:17163:x1877727022094336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740510.537203:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1790740510.537926:0:17163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022094336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790740510.537942:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8000/0xb25dda4f4e92f042 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92f049 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740510.537951:0:17163:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8000/0xb25dda4f4e92f042 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92f049 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740510.538003:0:17163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022094464:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1790740510.538054:0:17163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740510.538082:0:17163:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc993306c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790740510.538143:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022094464 00000100:00100000:0.0:1790740510.538149:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022094464 00000100:00100000:0.0:1790740510.538188:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1790740510.538197:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+24:17163:x1877727022094464:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1790740510.538212:0:17159:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790740510.538227:0:17159:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790740510.538231:0:17159:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1790740510.538319:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+24:17163:x1877727022094464:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 124us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740510.538328:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1790740510.538642:0:17163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022094464:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1790740510.538695:0:17163:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790740510.538702:0:17163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8000/0xb25dda4f4e92f042 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92f049 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740510.538710:0:17163:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8000/0xb25dda4f4e92f042 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92f049 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740510.890278:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740511.338191:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5df0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022094592:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790740511.338272:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740511.338329:0:18676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022094592 00000100:00100000:0.0:1790740511.338337:0:18676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022094592 00000100:00100000:0.0:1790740511.338391:0:18676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790740511.338400:0:18676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022094592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790740511.338430:0:18676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1790740511.338473:0:18676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022094592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740511.338493:0:18676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1790740511.338516:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790740511.338552:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5df0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022094592:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790740511.914462:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740512.938584:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790740513.898553:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790740513.898561:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1790740513.898566:0:37:0:(import.c:65:import_set_state_nolock()) ffff98dcaeddd000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790740513.898589:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98dcaeddd000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:1.0:1790740513.898618:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98db844c2a00 x1877727022095104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790740513.898659:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790740513.898662:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1790740513.898681:0:37:0:(import.c:65:import_set_state_nolock()) ffff98dc88508000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790740513.898690:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff98dc88508000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:1.0:1790740513.898704:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98db844c3800 x1877727022095616/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790740513.898781:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022094976:0@lo:400:kworker.0 00000100:00100000:0.0:1790740513.899451:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3638:1877727022094720:0@lo:400:kworker.0 00000100:00100000:0.0:1790740513.899539:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740513.899617:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022095360:0@lo:400:kworker.0 00000100:00100000:0.0:1790740513.899655:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740513.899685:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1877727022096000:0@lo:400:kworker.0 00000100:00100000:0.0:1790740513.899713:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740513.899742:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1790740513.899749:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022094848:0@lo:400:kworker.0 00000100:00100000:0.0:1790740513.899772:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740513.899806:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022095488:0@lo:400:kworker.0 00000100:00100000:0.0:1790740513.899831:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740513.899849:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1877727022096128:0@lo:400:kworker.0 00000100:00100000:0.0:1790740513.899878:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740513.899932:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022094720 00000100:00100000:0.0:1790740513.899942:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022094720 00000100:00100000:0.0:1790740513.899994:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1790740513.900002:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+24:3638:x1877727022094720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740513.900084:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+24:3638:x1877727022094720:12345-0@lo:400:kworker.0 Request processed in 82us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740513.900092:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1790740513.900128:0:17907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022095360 00000100:00100000:0.0:1790740513.900132:0:17907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022095360 00000100:00100000:0.0:1790740513.900155:0:17907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022094848 00000100:00100000:0.0:1790740513.900158:0:17907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022094848 00000100:00100000:0.0:1790740513.900172:0:17907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790740513.900178:0:17907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022095360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740513.900678:0:17907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022095360:12345-0@lo:400:kworker.0 Request processed in 498us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740513.900702:0:17907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790740513.900720:0:17907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790740513.900727:0:17907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022094848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740513.900763:0:17907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022094848:12345-0@lo:400:kworker.0 Request processed in 37us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740513.900769:0:17907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790740513.900802:0:17165:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022096000 00000100:00100000:0.0:1790740513.900807:0:17165:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022096000 00000100:00100000:0.0:1790740513.900846:0:17165:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022096128 00000100:00100000:0.0:1790740513.900849:0:17165:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022096128 00000100:00100000:0.0:1790740513.900868:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790740513.900874:0:17165:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877727022096000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740513.900909:0:17165:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877727022096000:12345-0@lo:400:kworker.0 Request processed in 34us (1195us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740513.900916:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790740513.901150:0:18673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022095488 00000100:00100000:3.0:1790740513.901156:0:18673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022095488 00000100:00100000:3.0:1790740513.901209:0:18673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790740513.901232:0:18673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022095488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740513.901276:0:18673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022095488:12345-0@lo:400:kworker.0 Request processed in 47us (1443us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740513.901283:0:18673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790740513.901322:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790740513.901330:0:17167:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877727022096128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740513.901363:0:17167:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877727022096128:12345-0@lo:400:kworker.0 Request processed in 35us (1485us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740513.901369:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1790740513.901562:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790740513.901567:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790740513.901569:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790740513.901613:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022094848:0@lo:400:kworker.0 00000100:00100000:0.0:1790740513.901627:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022095488:0@lo:400:kworker.0 00010000:00080000:0.0:1790740513.901645:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db844c0a80 x1877727022096128/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740513.901654:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1877727022096128:0@lo:400:kworker.0 00000100:00100000:0.0:1790740513.901664:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3638:1877727022094720:0@lo:400:kworker.0 00000100:00100000:0.0:1790740513.901674:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022095360:0@lo:400:kworker.0 00010000:00080000:0.0:1790740513.901696:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db844c3480 x1877727022096000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740513.901704:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1877727022096000:0@lo:400:kworker.0 00000100:00100000:1.0:1790740513.901917:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740513.901956:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877727022095744:0@lo:400:kworker.0 00000100:00100000:1.0:1790740513.901981:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740513.902014:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1877727022096256:0@lo:400:kworker.0 00000100:00100000:1.0:1790740513.902061:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740513.902085:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790740513.902091:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877727022095232:0@lo:400:kworker.0 00000100:00100000:1.0:1790740513.902112:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740513.902128:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1877727022095872:0@lo:400:kworker.0 00000100:00100000:1.0:1790740513.902149:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740513.902178:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877727022095104:0@lo:8:kworker.0 00000100:00100000:1.0:1790740513.902205:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740513.902349:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877727022095616:0@lo:8:kworker.0 00000100:00100000:1.0:1790740513.902373:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740513.902400:0:17166:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022095744 00000100:00100000:1.0:1790740513.902405:0:17166:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022095744 00000100:00100000:1.0:1790740513.902428:0:17166:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022096256 00000100:00100000:1.0:1790740513.902430:0:17166:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022096256 00000100:00100000:1.0:1790740513.902449:0:17166:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022095232 00000100:00100000:1.0:1790740513.902452:0:17166:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022095232 00000100:00100000:1.0:1790740513.902463:0:17166:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022095872 00000100:00100000:1.0:1790740513.902473:0:17166:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022095872 00000100:00100000:1.0:1790740513.902491:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790740513.902497:0:17166:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877727022095744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740513.902548:0:17166:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877727022095744:12345-0@lo:400:kworker.0 Request processed in 51us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740513.902557:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790740513.902573:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790740513.902579:0:17166:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877727022096256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740513.902608:0:17166:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877727022096256:12345-0@lo:400:kworker.0 Request processed in 30us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740513.902614:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790740513.902624:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790740513.902629:0:17166:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877727022095232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740513.902656:0:17166:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877727022095232:12345-0@lo:400:kworker.0 Request processed in 27us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740513.902662:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790740513.902674:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790740513.902681:0:17166:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877727022095872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740513.902707:0:17166:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877727022095872:12345-0@lo:400:kworker.0 Request processed in 27us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740513.902712:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790740513.902728:0:18674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022094976 00000100:00100000:1.0:1790740513.902731:0:18674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022094976 00000100:00100000:1.0:1790740513.902748:0:18674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022095104 00000100:00100000:1.0:1790740513.902751:0:18674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022095104 00000100:00100000:1.0:1790740513.902758:0:18674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022095616 00000100:00100000:1.0:1790740513.902760:0:18674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022095616 00000100:00100000:1.0:1790740513.902780:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790740513.902798:0:18674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727022094976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740513.902829:0:18674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727022094976:12345-0@lo:400:kworker.0 Request processed in 45us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740513.902834:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790740513.902846:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790740513.902849:0:18674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1877727022095104:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1790740513.902878:0:18674:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 585 last 0 00000020:00000080:1.0:1790740513.902905:0:18674:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb25dda4f4e92f050 00002000:00100000:1.0:1790740513.903149:0:18674:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff98db829b7800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b03 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1790740513.903155:0:18674:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1790740513.903159:0:18674:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1790740513.903503:0:18674:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1790740513.903530:0:18674:0:(import.c:65:import_set_state_nolock()) ffff98db829b3000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790740513.904505:0:18674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3637:x1877727022095104:12345-0@lo:8:kworker.0 Request processed in 1650us (2295us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740513.904514:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790740513.904541:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790740513.904546:0:18674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1877727022095616:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1790740513.904572:0:18674:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 585 last 0 00000020:00000080:1.0:1790740513.904595:0:18674:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb25dda4f4e92f057 00002000:00100000:1.0:1790740513.904609:0:18674:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff98db829b6800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b03 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1790740513.904613:0:18674:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1790740513.904615:0:18674:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1790740513.904658:0:18674:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1790740513.904686:0:18674:0:(import.c:65:import_set_state_nolock()) ffff98dcb5ddc000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790740513.904734:0:18674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3637:x1877727022095616:12345-0@lo:8:kworker.0 Request processed in 186us (2359us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740513.904740:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1790740513.904764:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790740513.904769:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790740513.904771:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1790740513.904820:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db844c2300 x1877727022095232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740513.904837:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877727022095232:0@lo:400:kworker.0 00010000:00080000:1.0:1790740513.904852:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db844c1f80 x1877727022095872/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740513.904861:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1877727022095872:0@lo:400:kworker.0 00000100:00100000:1.0:1790740513.904873:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022094976:0@lo:400:kworker.0 00010000:00080000:1.0:1790740513.904885:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db844c3b80 x1877727022095744/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740513.904892:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877727022095744:0@lo:400:kworker.0 00010000:00080000:1.0:1790740513.904903:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db844c2680 x1877727022096256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740513.904911:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1877727022096256:0@lo:400:kworker.0 00010000:00080000:0.0:1790740513.905060:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db844c2a00 x1877727022095104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790740538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790740513.905073:0:3637:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1790740513.905080:0:3637:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1790740513.905086:0:3637:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1790740513.905088:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98dcaeddd000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1790740513.905100:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1790740513.905104:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877727022095104:0@lo:8:kworker.0 00010000:00080000:0.0:1790740513.905117:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db844c3800 x1877727022095616/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790740538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790740513.905126:0:3637:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1790740513.905130:0:3637:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1790740513.905133:0:3637:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1790740513.905135:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98dc88508000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1790740513.905147:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1790740513.905151:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877727022095616:0@lo:8:kworker.0 00000004:00080000:0.0:1790740513.905199:0:17911:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1790740513.905232:0:17911:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5df2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17911:1877727022096512:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1790740513.905268:0:17911:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740513.905292:0:17911:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcad2ad780 going to sleep for 11 seconds 00000004:00080000:0.0:1790740513.905308:0:17910:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1790740513.905385:0:17910:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 585191353275ns, next at 0ns, rc = 0 00080000:00080000:0.0:1790740513.905392:0:17910:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1790740513.905419:0:18673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022096512 00000100:00100000:0.0:1790740513.905425:0:18673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022096512 00000100:00100000:0.0:1790740513.905459:0:18673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790740513.905466:0:18673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17911:x1877727022096512:12345-0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1790740513.905884:0:17191:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1790740513.905937:0:17191:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 585191904925ns, next at 0ns, rc = 0 00080000:00080000:3.0:1790740513.905943:0:17191:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1790740513.908405:0:17192:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:1.0:1790740513.908439:0:17192:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17192:1877727022096768:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1790740513.908519:0:17192:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740513.908555:0:17192:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc8968d240 going to sleep for 11 seconds 00000100:00100000:1.0:1790740513.908588:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5df0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022096384:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790740513.908619:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740513.908671:0:18676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022096384 00000100:00100000:1.0:1790740513.908678:0:18676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022096384 00000100:00100000:1.0:1790740513.908731:0:18676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790740513.908739:0:18676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3641:x1877727022096384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790740513.908772:0:18676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1790740513.908949:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790740513.908960:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022096640:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790740513.908991:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1790740513.909244:0:17899:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00080000:2.0:1790740513.912320:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790740513.912354:0:18677:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1790740513.912365:0:18677:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:2.0:1790740513.912382:0:18674:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1790740513.912386:0:18674:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00080000:2.0:1790740513.912436:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcb5df0e00 x1877727022096384/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740529 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740513.912458:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5df0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022096384:0@lo:13:osp-pre-1-1.0 00002000:00080000:3.0:1790740513.913760:0:18673:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1790740513.913770:0:18673:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1790740513.913864:0:18673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+7:17911:x1877727022096512:12345-0@lo:7:osp-pre-1-1.0 Request processed in 8395us (8592us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740513.913874:0:18673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790740513.913902:0:18673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022096768 00000100:00100000:3.0:1790740513.913908:0:18673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022096768 00000100:00100000:3.0:1790740513.913948:0:18673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790740513.913955:0:18673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17192:x1877727022096768:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1790740513.914418:0:18676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1877727022096384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740513.914428:0:18676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790740513.914529:0:18676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022096640 00000100:00100000:1.0:1790740513.914534:0:18676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022096640 00000100:00100000:1.0:1790740513.914554:0:18676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790740513.914560:0:18676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3639:x1877727022096640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790740513.914581:0:18676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1790740513.914636:0:18676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3639:x1877727022096640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (5643us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740513.914642:0:18676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1790740513.914678:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db844c2680 x1877727022096640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740529 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740513.914697:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022096640:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1790740513.915002:0:17911:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcb5df2d80 x1877727022096512/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790740529 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740513.915012:0:17911:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5df2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17911:1877727022096512:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1790740513.915077:0:17911:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1790740513.915113:0:17911:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5df2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17911:1877727022096896:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1790740513.915148:0:17911:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740513.915171:0:17911:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcad2ad780 going to sleep for 11 seconds 00000100:00100000:0.0:1790740513.915185:0:18675:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1790740513.915192:0:18675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022096896 00000100:00100000:0.0:1790740513.915195:0:18675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022096896 00000004:00080000:0.0:1790740513.915235:0:17146:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1790740513.915363:0:19778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790740513.915372:0:19778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17911:x1877727022096896:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1790740513.915388:0:19778:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1790740513.915422:0:19778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17911:x1877727022096896:12345-0@lo:5:osp-pre-1-1.0 Request processed in 51us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740513.915428:0:19778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1790740513.915451:0:17911:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcb5df2d80 x1877727022096896/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790740529 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740513.915460:0:17911:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5df2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17911:1877727022096896:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1790740513.915481:0:17911:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1790740513.915505:0:17911:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5df2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17911:1877727022097024:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1790740513.915528:0:17911:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740513.915542:0:17911:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcad2ad780 going to sleep for 11 seconds 00000100:00100000:0.0:1790740513.915552:0:18675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022097024 00000100:00100000:0.0:1790740513.915556:0:18675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022097024 00000100:00100000:0.0:1790740513.915576:0:18675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790740513.915582:0:18675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17911:x1877727022097024:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1790740513.915605:0:18675:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00000100:00080000:2.0:1790740513.917700:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:1.0:1790740513.921449:0:18673:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1790740513.921464:0:18673:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1790740513.921471:0:18673:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00000001:00080000:3.0:1790740513.940437:0:19487:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:3.0:1790740513.940467:0:19487:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1790740513.940475:0:19487:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1790740513.940673:0:18675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17911:x1877727022097024:12345-0@lo:5:osp-pre-1-1.0 Request processed in 25085us (25138us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1790740513.940687:0:18675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1790740513.940749:0:17911:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcb5df2d80 x1877727022097024/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790740529 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740513.940762:0:17911:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1790740513.940769:0:17911:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5df2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17911:1877727022097024:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1790740513.940808:0:17911:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1790740513.940872:0:17911:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17911:1877727022097152:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1790740513.940914:0:17911:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740513.940942:0:17911:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc857796c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790740513.940973:0:17176:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022097152 00000100:00100000:3.0:1790740513.940980:0:17176:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022097152 00000100:00100000:3.0:1790740513.941054:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790740513.941064:0:17176:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17911:x1877727022097152:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1790740513.941111:0:17176:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17911:x1877727022097152:12345-0@lo:900:osp-pre-1-1.0 Request processed in 49us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740513.941118:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1790740513.941153:0:17911:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83cc4e00 x1877727022097152/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790740529 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740513.941163:0:17911:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17911:1877727022097152:0@lo:900:osp-pre-1-1.0 00002000:00010000:1.0:1790740513.943621:0:18673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790740513.943639:0:18673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2602993/0xb25dda4f4e92f05e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740513.943668:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=585s v=(0 0) 00010000:00010000:1.0:1790740513.943673:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790740513.943680:0:18673:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2602993/0xb25dda4f4e92f05e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740513.943701:0:18673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2602993/0xb25dda4f4e92f05e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740513.943711:0:18673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2602993/0xb25dda4f4e92f05e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740513.943719:0:18673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2602993/0xb25dda4f4e92f05e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740513.943740:0:18673:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790740513.944969:0:17154:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790740513.944979:0:17154:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2602993/0xb25dda4f4e92f05e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740513.944989:0:17154:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc45400 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:2.0:1790740513.944994:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2602993/0xb25dda4f4e92f05e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740513.945003:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2602993/0xb25dda4f4e92f05e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740513.945025:0:17154:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2602993/0xb25dda4f4e92f05e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740513.945068:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2602993/0xb25dda4f4e92f05e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740513.945094:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740513.945096:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740513.945098:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790740513.945356:0:18673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790740513.945363:0:18673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ff747f9/0xb25dda4f4e92f065 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740513.945372:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=585s v=(0 0) 00010000:00010000:1.0:1790740513.945376:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790740513.945380:0:18673:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ff747f9/0xb25dda4f4e92f065 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740513.945389:0:18673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ff747f9/0xb25dda4f4e92f065 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740513.945411:0:18673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ff747f9/0xb25dda4f4e92f065 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740513.945417:0:18673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ff747f9/0xb25dda4f4e92f065 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740513.945436:0:18673:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790740513.946217:0:17155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790740513.946225:0:17155:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ff747f9/0xb25dda4f4e92f065 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740513.946233:0:17155:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc44600 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:2.0:1790740513.946237:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ff747f9/0xb25dda4f4e92f065 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740513.946253:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ff747f9/0xb25dda4f4e92f065 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740513.946267:0:17155:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ff747f9/0xb25dda4f4e92f065 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740513.946273:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ff747f9/0xb25dda4f4e92f065 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740513.946288:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740513.946290:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740513.946291:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790740513.946716:0:18673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790740513.946724:0:18673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ea21cfa/0xb25dda4f4e92f06c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740513.946734:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=585s v=(0 0) 00010000:00010000:1.0:1790740513.946737:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790740513.946742:0:18673:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ea21cfa/0xb25dda4f4e92f06c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740513.946751:0:18673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ea21cfa/0xb25dda4f4e92f06c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740513.946758:0:18673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ea21cfa/0xb25dda4f4e92f06c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740513.946765:0:18673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ea21cfa/0xb25dda4f4e92f06c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740513.946809:0:18673:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790740513.949381:0:17154:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790740513.949399:0:17154:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ea21cfa/0xb25dda4f4e92f06c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740513.949417:0:17154:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc45800 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:2.0:1790740513.949423:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ea21cfa/0xb25dda4f4e92f06c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740513.949435:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ea21cfa/0xb25dda4f4e92f06c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740513.949458:0:17154:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ea21cfa/0xb25dda4f4e92f06c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740513.949482:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ea21cfa/0xb25dda4f4e92f06c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740513.949519:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740513.949521:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740513.949523:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790740513.955505:0:18673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790740513.955521:0:18673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e492c4eb/0xb25dda4f4e92f073 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.955540:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=585s v=(0 0) 00010000:00010000:0.0:1790740513.955545:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740513.955552:0:18673:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e492c4eb/0xb25dda4f4e92f073 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.955568:0:18673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e492c4eb/0xb25dda4f4e92f073 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.955579:0:18673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e492c4eb/0xb25dda4f4e92f073 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.955588:0:18673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e492c4eb/0xb25dda4f4e92f073 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.955626:0:18673:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790740513.956292:0:18673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790740513.956300:0:18673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d1f5400/0xb25dda4f4e92f07a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.956309:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=585s v=(0 0) 00010000:00010000:0.0:1790740513.956313:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740513.956318:0:18673:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d1f5400/0xb25dda4f4e92f07a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.956329:0:18673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d1f5400/0xb25dda4f4e92f07a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.956338:0:18673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d1f5400/0xb25dda4f4e92f07a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.956345:0:18673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d1f5400/0xb25dda4f4e92f07a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.959822:0:18673:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1790740513.960489:0:18673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790740513.960500:0:18673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a265b05/0xb25dda4f4e92f081 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.960519:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=585s v=(0 0) 00010000:00010000:0.0:1790740513.960530:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740513.960537:0:18673:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a265b05/0xb25dda4f4e92f081 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.960553:0:18673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a265b05/0xb25dda4f4e92f081 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.960563:0:18673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a265b05/0xb25dda4f4e92f081 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.960570:0:18673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a265b05/0xb25dda4f4e92f081 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.960708:0:17155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1790740513.960717:0:17155:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e492c4eb/0xb25dda4f4e92f073 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.960732:0:17155:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf060c00 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:3.0:1790740513.960737:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e492c4eb/0xb25dda4f4e92f073 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.960746:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e492c4eb/0xb25dda4f4e92f073 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.960765:0:17155:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e492c4eb/0xb25dda4f4e92f073 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.960773:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e492c4eb/0xb25dda4f4e92f073 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.960804:0:17155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790740513.960808:0:17155:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d1f5400/0xb25dda4f4e92f07a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.960815:0:17155:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf060200 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:3.0:1790740513.960818:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d1f5400/0xb25dda4f4e92f07a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.960825:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d1f5400/0xb25dda4f4e92f07a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.960834:0:17155:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d1f5400/0xb25dda4f4e92f07a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.960847:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d1f5400/0xb25dda4f4e92f07a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.960862:0:17155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740513.960866:0:17155:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a265b05/0xb25dda4f4e92f081 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.960872:0:17155:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf061400 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:3.0:1790740513.960874:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a265b05/0xb25dda4f4e92f081 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.960882:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a265b05/0xb25dda4f4e92f081 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.960892:0:17155:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a265b05/0xb25dda4f4e92f081 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.960899:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740513.960900:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740513.960902:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740513.960987:0:18673:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790740513.960992:0:18673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a265b05/0xb25dda4f4e92f081 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790740513.964418:0:18673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790740513.964435:0:18673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b05a8d6/0xb25dda4f4e92f088 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.964453:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=585s v=(0 0) 00010000:00010000:0.0:1790740513.964458:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740513.964464:0:18673:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b05a8d6/0xb25dda4f4e92f088 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.964479:0:18673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b05a8d6/0xb25dda4f4e92f088 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.964501:0:18673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b05a8d6/0xb25dda4f4e92f088 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.964508:0:18673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b05a8d6/0xb25dda4f4e92f088 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.964581:0:17155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740513.964590:0:17155:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b05a8d6/0xb25dda4f4e92f088 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.964597:0:17155:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf061200 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:3.0:1790740513.964608:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b05a8d6/0xb25dda4f4e92f088 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.964617:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b05a8d6/0xb25dda4f4e92f088 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.964632:0:17155:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b05a8d6/0xb25dda4f4e92f088 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.964642:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740513.964643:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740513.964644:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740513.964883:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740513.968375:0:18673:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790740513.968394:0:18673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b05a8d6/0xb25dda4f4e92f088 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790740513.968945:0:18673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790740513.968953:0:18673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b248f99/0xb25dda4f4e92f08f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.968968:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=585s v=(0 0) 00010000:00010000:0.0:1790740513.968973:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740513.968979:0:18673:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b248f99/0xb25dda4f4e92f08f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.968993:0:18673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b248f99/0xb25dda4f4e92f08f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.969002:0:18673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b248f99/0xb25dda4f4e92f08f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.969021:0:18673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b248f99/0xb25dda4f4e92f08f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.969057:0:18673:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790740513.969332:0:18673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790740513.969339:0:18673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042e35c37/0xb25dda4f4e92f096 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.969347:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=585s v=(0 0) 00010000:00010000:0.0:1790740513.969350:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740513.969355:0:18673:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042e35c37/0xb25dda4f4e92f096 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.969364:0:18673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042e35c37/0xb25dda4f4e92f096 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.969372:0:18673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042e35c37/0xb25dda4f4e92f096 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.969380:0:18673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042e35c37/0xb25dda4f4e92f096 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.969388:0:18673:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1790740513.969607:0:18673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790740513.969613:0:18673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000939dd544/0xb25dda4f4e92f09d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.969626:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=585s v=(0 0) 00010000:00010000:0.0:1790740513.969630:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740513.969634:0:18673:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000939dd544/0xb25dda4f4e92f09d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.969643:0:18673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000939dd544/0xb25dda4f4e92f09d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.969650:0:18673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000939dd544/0xb25dda4f4e92f09d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.969659:0:18673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000939dd544/0xb25dda4f4e92f09d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.969666:0:18673:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1790740513.969916:0:18673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790740513.969922:0:18673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000341a98d4/0xb25dda4f4e92f0a4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.969929:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=585s v=(0 0) 00010000:00010000:0.0:1790740513.969932:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740513.969936:0:18673:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000341a98d4/0xb25dda4f4e92f0a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.969944:0:18673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000341a98d4/0xb25dda4f4e92f0a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.969963:0:18673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000341a98d4/0xb25dda4f4e92f0a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.969970:0:18673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000341a98d4/0xb25dda4f4e92f0a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.969978:0:18673:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1790740513.970276:0:18673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790740513.970282:0:18673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ceb0c497/0xb25dda4f4e92f0ab lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.970291:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=585s v=(0 0) 00010000:00010000:0.0:1790740513.970294:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740513.970298:0:18673:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ceb0c497/0xb25dda4f4e92f0ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.970307:0:18673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ceb0c497/0xb25dda4f4e92f0ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.970315:0:18673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ceb0c497/0xb25dda4f4e92f0ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.970323:0:18673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ceb0c497/0xb25dda4f4e92f0ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.970342:0:18673:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1790740513.970545:0:18673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790740513.970551:0:18673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020892b28/0xb25dda4f4e92f0b2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.970559:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=585s v=(0 0) 00010000:00010000:0.0:1790740513.970562:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740513.970566:0:18673:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020892b28/0xb25dda4f4e92f0b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.970574:0:18673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020892b28/0xb25dda4f4e92f0b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.970582:0:18673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020892b28/0xb25dda4f4e92f0b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.970590:0:18673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000020892b28/0xb25dda4f4e92f0b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.970598:0:18673:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:2.0:1790740513.970835:0:17154:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1790740513.970842:0:17154:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b248f99/0xb25dda4f4e92f08f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740513.970851:0:17154:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf061800 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:2.0:1790740513.970856:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b248f99/0xb25dda4f4e92f08f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740513.970866:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b248f99/0xb25dda4f4e92f08f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740513.970883:0:17154:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b248f99/0xb25dda4f4e92f08f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740513.970890:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b248f99/0xb25dda4f4e92f08f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740513.970909:0:17154:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1790740513.970912:0:17154:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042e35c37/0xb25dda4f4e92f096 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740513.970926:0:17154:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf061600 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:2.0:1790740513.970929:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042e35c37/0xb25dda4f4e92f096 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740513.970936:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042e35c37/0xb25dda4f4e92f096 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740513.970945:0:17154:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042e35c37/0xb25dda4f4e92f096 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740513.970952:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042e35c37/0xb25dda4f4e92f096 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740513.970964:0:17154:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1790740513.970968:0:17154:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000939dd544/0xb25dda4f4e92f09d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740513.970974:0:17154:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf061a00 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:2.0:1790740513.970977:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000939dd544/0xb25dda4f4e92f09d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740513.970984:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000939dd544/0xb25dda4f4e92f09d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740513.970992:0:17154:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000939dd544/0xb25dda4f4e92f09d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740513.971003:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000939dd544/0xb25dda4f4e92f09d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740513.971014:0:17154:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790740513.971018:0:17154:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000341a98d4/0xb25dda4f4e92f0a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740513.971024:0:17154:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf060a00 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:2.0:1790740513.971027:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000341a98d4/0xb25dda4f4e92f0a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740513.971049:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000341a98d4/0xb25dda4f4e92f0a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740513.971059:0:17154:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000341a98d4/0xb25dda4f4e92f0a4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740513.971066:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000341a98d4/0xb25dda4f4e92f0a4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740513.971081:0:17154:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790740513.971084:0:17154:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ceb0c497/0xb25dda4f4e92f0ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740513.971090:0:17154:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf061c00 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:2.0:1790740513.971099:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ceb0c497/0xb25dda4f4e92f0ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740513.971107:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ceb0c497/0xb25dda4f4e92f0ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740513.971116:0:17154:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ceb0c497/0xb25dda4f4e92f0ab lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740513.971122:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ceb0c497/0xb25dda4f4e92f0ab lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740513.971134:0:17154:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790740513.971137:0:17154:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000020892b28/0xb25dda4f4e92f0b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740513.971142:0:17154:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf061000 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:2.0:1790740513.971145:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000020892b28/0xb25dda4f4e92f0b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740513.971151:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000020892b28/0xb25dda4f4e92f0b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740513.971158:0:17154:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000020892b28/0xb25dda4f4e92f0b2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740513.971164:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020892b28/0xb25dda4f4e92f0b2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740513.971181:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740513.971182:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740513.971184:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790740513.971405:0:18673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790740513.971412:0:18673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a4c826e/0xb25dda4f4e92f0b9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.971420:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=585s v=(0 0) 00010000:00010000:0.0:1790740513.971429:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740513.971434:0:18673:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a4c826e/0xb25dda4f4e92f0b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.971445:0:18673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a4c826e/0xb25dda4f4e92f0b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.971452:0:18673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a4c826e/0xb25dda4f4e92f0b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.971458:0:18673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a4c826e/0xb25dda4f4e92f0b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.971479:0:18673:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790740513.971733:0:17154:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790740513.971739:0:17154:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a4c826e/0xb25dda4f4e92f0b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740513.971746:0:17154:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf060800 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:2.0:1790740513.971749:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a4c826e/0xb25dda4f4e92f0b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740513.971756:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a4c826e/0xb25dda4f4e92f0b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740513.971767:0:17154:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a4c826e/0xb25dda4f4e92f0b9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740513.971773:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a4c826e/0xb25dda4f4e92f0b9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740513.971798:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740513.971800:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740513.971802:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790740513.972416:0:18673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790740513.972424:0:18673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d300584b/0xb25dda4f4e92f0c0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.972434:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=585s v=(0 0) 00010000:00010000:0.0:1790740513.972437:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740513.972442:0:18673:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d300584b/0xb25dda4f4e92f0c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.972451:0:18673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d300584b/0xb25dda4f4e92f0c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.972460:0:18673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d300584b/0xb25dda4f4e92f0c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.972474:0:18673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d300584b/0xb25dda4f4e92f0c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.972498:0:18673:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790740513.972793:0:17155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740513.972801:0:17155:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d300584b/0xb25dda4f4e92f0c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.972809:0:17155:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf061e00 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:3.0:1790740513.972813:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d300584b/0xb25dda4f4e92f0c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.972822:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d300584b/0xb25dda4f4e92f0c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.972835:0:17155:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d300584b/0xb25dda4f4e92f0c0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.972842:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d300584b/0xb25dda4f4e92f0c0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.972868:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740513.972870:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740513.972872:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740513.972927:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790740513.973356:0:18673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790740513.973364:0:18673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060e2108b/0xb25dda4f4e92f0c7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.973374:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=585s v=(0 0) 00010000:00010000:0.0:1790740513.973377:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740513.973380:0:18673:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060e2108b/0xb25dda4f4e92f0c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.973390:0:18673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060e2108b/0xb25dda4f4e92f0c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.973396:0:18673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060e2108b/0xb25dda4f4e92f0c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.973402:0:18673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060e2108b/0xb25dda4f4e92f0c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.973420:0:18673:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790740513.973769:0:17155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740513.973776:0:17155:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060e2108b/0xb25dda4f4e92f0c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.973801:0:17155:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf060600 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:3.0:1790740513.973805:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060e2108b/0xb25dda4f4e92f0c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.973813:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060e2108b/0xb25dda4f4e92f0c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.973826:0:17155:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060e2108b/0xb25dda4f4e92f0c7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.973832:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060e2108b/0xb25dda4f4e92f0c7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.973851:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740513.973853:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740513.973854:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790740513.973968:0:18673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790740513.973975:0:18673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000581c6557/0xb25dda4f4e92f0ce lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.973989:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=585s v=(0 0) 00010000:00010000:0.0:1790740513.973992:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740513.973996:0:18673:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000581c6557/0xb25dda4f4e92f0ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.974005:0:18673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000581c6557/0xb25dda4f4e92f0ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.974013:0:18673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000581c6557/0xb25dda4f4e92f0ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.974021:0:18673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000581c6557/0xb25dda4f4e92f0ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.974071:0:18673:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790740513.974420:0:17154:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740513.974426:0:17154:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000581c6557/0xb25dda4f4e92f0ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.974447:0:17154:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db82343800 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:3.0:1790740513.974451:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000581c6557/0xb25dda4f4e92f0ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.974458:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000581c6557/0xb25dda4f4e92f0ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.974471:0:17154:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000581c6557/0xb25dda4f4e92f0ce lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.974479:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000581c6557/0xb25dda4f4e92f0ce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.974496:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740513.974498:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740513.974500:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790740513.974570:0:18673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790740513.974575:0:18673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd17e9f3/0xb25dda4f4e92f0d5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.974583:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=585s v=(0 0) 00010000:00010000:0.0:1790740513.974586:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740513.974590:0:18673:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd17e9f3/0xb25dda4f4e92f0d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.974599:0:18673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd17e9f3/0xb25dda4f4e92f0d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.974616:0:18673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd17e9f3/0xb25dda4f4e92f0d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.974623:0:18673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd17e9f3/0xb25dda4f4e92f0d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.974643:0:18673:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790740513.974885:0:17155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740513.974891:0:17155:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd17e9f3/0xb25dda4f4e92f0d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.974900:0:17155:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db82343600 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:3.0:1790740513.974902:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd17e9f3/0xb25dda4f4e92f0d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.974910:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd17e9f3/0xb25dda4f4e92f0d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.974928:0:17155:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd17e9f3/0xb25dda4f4e92f0d5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.974936:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd17e9f3/0xb25dda4f4e92f0d5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.974951:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740513.974953:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740513.974955:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790740513.975027:0:18673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790740513.975103:0:18673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e39dabe3/0xb25dda4f4e92f0dc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.975112:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=585s v=(0 0) 00010000:00010000:0.0:1790740513.975115:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740513.975118:0:18673:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e39dabe3/0xb25dda4f4e92f0dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.975127:0:18673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e39dabe3/0xb25dda4f4e92f0dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.975137:0:18673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e39dabe3/0xb25dda4f4e92f0dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.975145:0:18673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e39dabe3/0xb25dda4f4e92f0dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.975205:0:18673:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790740513.975517:0:18673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790740513.975523:0:18673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f2df906/0xb25dda4f4e92f0e3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.975530:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=585s v=(0 0) 00010000:00010000:0.0:1790740513.975533:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740513.975537:0:18673:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f2df906/0xb25dda4f4e92f0e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.975546:0:18673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f2df906/0xb25dda4f4e92f0e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.975553:0:18673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f2df906/0xb25dda4f4e92f0e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.975561:0:18673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f2df906/0xb25dda4f4e92f0e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.975589:0:17154:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790740513.975594:0:17154:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e39dabe3/0xb25dda4f4e92f0dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.975602:0:17154:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db82342a00 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:3.0:1790740513.975606:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e39dabe3/0xb25dda4f4e92f0dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.975615:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e39dabe3/0xb25dda4f4e92f0dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.975627:0:17154:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e39dabe3/0xb25dda4f4e92f0dc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.975633:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e39dabe3/0xb25dda4f4e92f0dc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.975657:0:17154:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740513.975661:0:17154:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f2df906/0xb25dda4f4e92f0e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.975667:0:17154:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db82342c00 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:3.0:1790740513.975670:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f2df906/0xb25dda4f4e92f0e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.975678:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f2df906/0xb25dda4f4e92f0e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.975688:0:17154:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f2df906/0xb25dda4f4e92f0e3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.975695:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740513.975697:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740513.975698:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740513.975757:0:18673:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790740513.975762:0:18673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f2df906/0xb25dda4f4e92f0e3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790740513.976117:0:18673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790740513.976123:0:18673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b602b2ef/0xb25dda4f4e92f0ea lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.976136:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=585s v=(0 0) 00010000:00010000:0.0:1790740513.976140:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740513.976145:0:18673:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b602b2ef/0xb25dda4f4e92f0ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.976153:0:18673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b602b2ef/0xb25dda4f4e92f0ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.976162:0:18673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b602b2ef/0xb25dda4f4e92f0ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.976168:0:18673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b602b2ef/0xb25dda4f4e92f0ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.976276:0:17155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740513.976282:0:17155:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b602b2ef/0xb25dda4f4e92f0ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.976290:0:17155:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db82342200 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:3.0:1790740513.976294:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b602b2ef/0xb25dda4f4e92f0ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.976316:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b602b2ef/0xb25dda4f4e92f0ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.976330:0:17155:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b602b2ef/0xb25dda4f4e92f0ea lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.976339:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740513.976341:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740513.976343:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740513.976402:0:18673:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790740513.976407:0:18673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b602b2ef/0xb25dda4f4e92f0ea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790740513.976735:0:18673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790740513.976742:0:18673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c49c27fa/0xb25dda4f4e92f0f1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.976750:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=585s v=(0 0) 00010000:00010000:0.0:1790740513.976753:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740513.976757:0:18673:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c49c27fa/0xb25dda4f4e92f0f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.976776:0:18673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c49c27fa/0xb25dda4f4e92f0f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.976797:0:18673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c49c27fa/0xb25dda4f4e92f0f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.976804:0:18673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c49c27fa/0xb25dda4f4e92f0f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.976830:0:17154:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740513.976835:0:17154:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c49c27fa/0xb25dda4f4e92f0f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.976842:0:17154:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db82343000 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:3.0:1790740513.976845:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c49c27fa/0xb25dda4f4e92f0f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.976853:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c49c27fa/0xb25dda4f4e92f0f1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.976864:0:17154:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c49c27fa/0xb25dda4f4e92f0f1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.976871:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740513.976873:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740513.976875:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740513.976941:0:18673:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790740513.976947:0:18673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c49c27fa/0xb25dda4f4e92f0f1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790740513.977262:0:18673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790740513.977267:0:18673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050fa15fb/0xb25dda4f4e92f0f8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.977276:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=585s v=(0 0) 00010000:00010000:0.0:1790740513.977280:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740513.977283:0:18673:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050fa15fb/0xb25dda4f4e92f0f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.977291:0:18673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050fa15fb/0xb25dda4f4e92f0f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.977309:0:18673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050fa15fb/0xb25dda4f4e92f0f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.977316:0:18673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050fa15fb/0xb25dda4f4e92f0f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.977420:0:17155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740513.977426:0:17155:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050fa15fb/0xb25dda4f4e92f0f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.977434:0:17155:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db82342600 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:3.0:1790740513.977439:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050fa15fb/0xb25dda4f4e92f0f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.977447:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050fa15fb/0xb25dda4f4e92f0f8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.977459:0:17155:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050fa15fb/0xb25dda4f4e92f0f8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.977467:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740513.977469:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740513.977471:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740513.977533:0:18673:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790740513.977538:0:18673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050fa15fb/0xb25dda4f4e92f0f8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790740513.977854:0:18673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790740513.977860:0:18673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5e8bd8b/0xb25dda4f4e92f0ff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.977868:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=585s v=(0 0) 00010000:00010000:0.0:1790740513.977871:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740513.977875:0:18673:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5e8bd8b/0xb25dda4f4e92f0ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.977883:0:18673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5e8bd8b/0xb25dda4f4e92f0ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.977890:0:18673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5e8bd8b/0xb25dda4f4e92f0ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.977908:0:18673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5e8bd8b/0xb25dda4f4e92f0ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.977934:0:17154:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740513.977939:0:17154:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5e8bd8b/0xb25dda4f4e92f0ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.977947:0:17154:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db82343e00 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:3.0:1790740513.977950:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5e8bd8b/0xb25dda4f4e92f0ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.977958:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5e8bd8b/0xb25dda4f4e92f0ff lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.977981:0:17154:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5e8bd8b/0xb25dda4f4e92f0ff lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.977989:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740513.977991:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740513.977993:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740513.978079:0:18673:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790740513.978085:0:18673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5e8bd8b/0xb25dda4f4e92f0ff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790740513.978388:0:18673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790740513.978394:0:18673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e75722d/0xb25dda4f4e92f106 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.978402:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=585s v=(0 0) 00010000:00010000:0.0:1790740513.978405:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740513.978409:0:18673:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e75722d/0xb25dda4f4e92f106 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.978418:0:18673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e75722d/0xb25dda4f4e92f106 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.978425:0:18673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e75722d/0xb25dda4f4e92f106 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.978432:0:18673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e75722d/0xb25dda4f4e92f106 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.978478:0:17155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740513.978484:0:17155:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e75722d/0xb25dda4f4e92f106 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.978491:0:17155:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db82342400 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:3.0:1790740513.978494:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e75722d/0xb25dda4f4e92f106 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.978503:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e75722d/0xb25dda4f4e92f106 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.978515:0:17155:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e75722d/0xb25dda4f4e92f106 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.978523:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740513.978525:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740513.978526:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740513.978577:0:18673:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790740513.978582:0:18673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e75722d/0xb25dda4f4e92f106 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790740513.978905:0:18673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790740513.978911:0:18673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a03d0007/0xb25dda4f4e92f10d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.978920:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=585s v=(0 0) 00010000:00010000:0.0:1790740513.978923:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740513.978927:0:18673:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a03d0007/0xb25dda4f4e92f10d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.978936:0:18673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a03d0007/0xb25dda4f4e92f10d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.978944:0:18673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a03d0007/0xb25dda4f4e92f10d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.978951:0:18673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a03d0007/0xb25dda4f4e92f10d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.978982:0:17154:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740513.978988:0:17154:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a03d0007/0xb25dda4f4e92f10d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.979009:0:17154:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db82342000 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:3.0:1790740513.979013:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a03d0007/0xb25dda4f4e92f10d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.979021:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a03d0007/0xb25dda4f4e92f10d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.979055:0:17154:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a03d0007/0xb25dda4f4e92f10d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.979064:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740513.979066:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740513.979068:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740513.979150:0:18673:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790740513.979155:0:18673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a03d0007/0xb25dda4f4e92f10d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790740513.979490:0:18673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790740513.979496:0:18673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4607d27/0xb25dda4f4e92f114 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.979504:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=585s v=(0 0) 00010000:00010000:0.0:1790740513.979507:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740513.979511:0:18673:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4607d27/0xb25dda4f4e92f114 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.979520:0:18673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4607d27/0xb25dda4f4e92f114 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.979528:0:18673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4607d27/0xb25dda4f4e92f114 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.979536:0:18673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a4607d27/0xb25dda4f4e92f114 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.979564:0:17155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740513.979569:0:17155:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a4607d27/0xb25dda4f4e92f114 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.979576:0:17155:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db82343400 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:3.0:1790740513.979579:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4607d27/0xb25dda4f4e92f114 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.979589:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4607d27/0xb25dda4f4e92f114 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.979600:0:17155:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a4607d27/0xb25dda4f4e92f114 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.979616:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740513.979618:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740513.979619:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740513.979676:0:18673:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790740513.979682:0:18673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4607d27/0xb25dda4f4e92f114 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790740513.979965:0:18673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790740513.979972:0:18673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6789016/0xb25dda4f4e92f11b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.979990:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=585s v=(0 0) 00010000:00010000:0.0:1790740513.979993:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740513.979997:0:18673:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6789016/0xb25dda4f4e92f11b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.980007:0:18673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6789016/0xb25dda4f4e92f11b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.980020:0:18673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6789016/0xb25dda4f4e92f11b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740513.980060:0:18673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b6789016/0xb25dda4f4e92f11b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.980106:0:17154:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740513.980112:0:17154:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b6789016/0xb25dda4f4e92f11b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.980120:0:17154:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db82343c00 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:3.0:1790740513.980124:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6789016/0xb25dda4f4e92f11b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.980132:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6789016/0xb25dda4f4e92f11b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.980143:0:17154:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b6789016/0xb25dda4f4e92f11b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740513.980152:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740513.980153:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740513.980155:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740513.980218:0:18673:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790740513.980224:0:18673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6789016/0xb25dda4f4e92f11b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1790740513.980271:0:18673:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:0.0:1790740513.980383:0:18673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17192:x1877727022096768:12345-0@lo:5:osp-pre-1-0.0 Request processed in 66423us (71859us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740513.980393:0:18673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:3.0:1790740513.980499:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740513.980658:0:17192:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17192:1877727022096768:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1790740513.980678:0:17192:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:1.0:1790740513.980732:0:17192:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17192:1877727022097280:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1790740513.980768:0:17192:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740513.980814:0:17192:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc99123000 going to sleep for 11 seconds 00000100:00100000:0.0:1790740513.981187:0:18674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022097280 00000100:00100000:0.0:1790740513.981194:0:18674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022097280 00000100:00100000:0.0:1790740513.981301:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790740513.981310:0:18674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17192:x1877727022097280:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1790740513.981360:0:18674:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:1.0:1790740513.984964:0:18674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17192:x1877727022097280:12345-0@lo:5:osp-pre-1-0.0 Request processed in 3644us (4184us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1790740513.984982:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790740513.987364:0:17192:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17192:1877727022097280:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1790740513.987385:0:17192:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000100:00100000:2.0:1790740514.410672:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022097408:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790740514.410762:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740514.410851:0:18676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022097408 00000100:00100000:2.0:1790740514.410860:0:18676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022097408 00000100:00100000:2.0:1790740514.410907:0:18676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790740514.410916:0:18676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022097408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790740514.410960:0:18676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1790740514.411004:0:18676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022097408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740514.411012:0:18676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790740514.411081:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022097408:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790740514.929065:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790740514.929097:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5df1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022097536:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790740514.929184:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740514.929250:0:17907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022097536 00000100:00100000:2.0:1790740514.929260:0:17907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022097536 00000100:00100000:2.0:1790740514.929332:0:17907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790740514.929344:0:17907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022097536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790740514.929417:0:17907:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1790740514.929480:0:17907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022097536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 128us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740514.929487:0:17907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790740514.929537:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5df1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022097536:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1790740514.988637:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790740515.106686:0:19845:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg403-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1790740515.436570:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022097664:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790740515.436638:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740515.436692:0:17170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022097664 00000100:00100000:2.0:1790740515.436701:0:17170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022097664 00000100:00100000:2.0:1790740515.436746:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790740515.436765:0:17170:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022097664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790740515.436807:0:17170:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790740515.436856:0:17170:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022097664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740515.436864:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790740515.440318:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022097664:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1790740516.013896:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790740516.204007:0:17922:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:0.0:1790740516.206175:0:19897:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790740516.206482:0:19897:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1790740516.459151:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790740516.459179:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcb5df0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022097792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790740516.459256:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740516.459384:0:19777:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022097792 00000100:00100000:0.0:1790740516.459460:0:19777:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022097792 00000100:00100000:0.0:1790740516.459521:0:19777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790740516.459532:0:19777:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022097792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790740516.459577:0:19777:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1790740516.459622:0:19777:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022097792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740516.459629:0:19777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790740516.460020:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcb5df0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022097792:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790740516.468067:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790740517.042430:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1790740517.335885:0:19947:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790740517.336285:0:19947:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1790740517.581543:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740517.581935:0:17160:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001037312 00000100:00100000:0.0:1790740517.581949:0:17160:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001037312 00000100:00100000:0.0:1790740517.583945:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 117 00000100:00100000:0.0:1790740517.583963:0:17160:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2401:x1877727001037312:12345-192.168.204.3@tcp:250:mount.lustre.0 00010000:00080000:0.0:1790740517.584011:0:17160:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 2b6742f8-8cda-45db-8c52-3634e9260d75@192.168.204.3@tcp t0 exp 0000000000000000 cur 588 last 0 00000020:00000080:0.0:1790740517.584066:0:17160:0:(genops.c:1384:class_connect()) connect: client 2b6742f8-8cda-45db-8c52-3634e9260d75, cookie 0xb25dda4f4e92f122 00000100:00080000:0.0:1790740517.584269:0:17160:0:(import.c:65:import_set_state_nolock()) ffff98dcbd339000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790740517.584514:0:17160:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b6742f8-8cda-45db-8c52-3634e9260d75+5:2401:x1877727001037312:12345-192.168.204.3@tcp:250:mount.lustre.0 Request processed in 551us (2983us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740517.584524:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 117 00000100:00100000:1.0:1790740517.598470:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740517.598566:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001037440 00000100:00100000:2.0:1790740517.598581:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001037440 00000100:00100000:2.0:1790740517.598654:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 118 00000100:00100000:2.0:1790740517.598666:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b6742f8-8cda-45db-8c52-3634e9260d75+5:14891:x1877727001037440:12345-192.168.204.3@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790740517.598690:0:17159:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740517.598727:0:17159:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98db83f33400/0xb25dda4f4e92f129 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae24020 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740517.598788:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98db83f33400/0xb25dda4f4e92f129 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24020 expref: 6 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740517.598804:0:17159:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98db83f33400/0xb25dda4f4e92f129 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24020 expref: 6 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740517.598814:0:17159:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f33400, rc 0) 00000100:00100000:2.0:1790740517.599162:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b6742f8-8cda-45db-8c52-3634e9260d75+6:14891:x1877727001037440:12345-192.168.204.3@tcp:101:mount.lustre.0 Request processed in 497us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740517.599171:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 118 00000100:00100000:3.0:1790740517.603801:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740517.606152:0:17160:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001037568 00000100:00100000:1.0:1790740517.606175:0:17160:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001037568 00000100:00100000:1.0:1790740517.606268:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 119 00000100:00100000:1.0:1790740517.606282:0:17160:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b6742f8-8cda-45db-8c52-3634e9260d75+6:14891:x1877727001037568:12345-192.168.204.3@tcp:501:mount.lustre.0 00000100:00100000:1.0:1790740517.606490:0:17160:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b6742f8-8cda-45db-8c52-3634e9260d75+6:14891:x1877727001037568:12345-192.168.204.3@tcp:501:mount.lustre.0 Request processed in 210us (2701us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790740517.606500:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 119 00000100:00100000:3.0:1790740517.615552:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740517.615787:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001037696 00000100:00100000:2.0:1790740517.615820:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001037696 00000100:00100000:2.0:1790740517.615900:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 120 00000100:00100000:2.0:1790740517.615912:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b6742f8-8cda-45db-8c52-3634e9260d75+6:14891:x1877727001037696:12345-192.168.204.3@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790740517.615936:0:17161:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740517.615964:0:17161:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98db83f33600/0xb25dda4f4e92f130 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae24027 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740517.616004:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98db83f33600/0xb25dda4f4e92f130 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24027 expref: 7 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740517.616017:0:17161:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98db83f33600/0xb25dda4f4e92f130 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24027 expref: 7 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740517.616028:0:17161:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f33600, rc 0) 00000100:00100000:2.0:1790740517.616129:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b6742f8-8cda-45db-8c52-3634e9260d75+7:14891:x1877727001037696:12345-192.168.204.3@tcp:101:mount.lustre.0 Request processed in 218us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740517.616138:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 120 00000100:00100000:1.0:1790740517.639280:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740517.639416:0:17160:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001037824 00000100:00100000:2.0:1790740517.639435:0:17160:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001037824 00000100:00100000:2.0:1790740517.639527:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 121 00000100:00100000:2.0:1790740517.639541:0:17160:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b6742f8-8cda-45db-8c52-3634e9260d75+7:14891:x1877727001037824:12345-192.168.204.3@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790740517.639916:0:17160:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b6742f8-8cda-45db-8c52-3634e9260d75+8:14891:x1877727001037824:12345-192.168.204.3@tcp:501:mount.lustre.0 Request processed in 376us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740517.639926:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 121 00000100:00100000:1.0:1790740517.644655:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740517.649411:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001037952 00000100:00100000:2.0:1790740517.649434:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001037952 00000100:00100000:2.0:1790740517.649520:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 122 00000100:00100000:2.0:1790740517.649535:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b6742f8-8cda-45db-8c52-3634e9260d75+8:14891:x1877727001037952:12345-192.168.204.3@tcp:503:mount.lustre.0 00000100:00100000:2.0:1790740517.649788:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b6742f8-8cda-45db-8c52-3634e9260d75+8:14891:x1877727001037952:12345-192.168.204.3@tcp:503:mount.lustre.0 Request processed in 256us (5147us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740517.649798:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 122 00000100:00100000:2.0:1790740517.659073:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740517.659309:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001038080 00000100:00100000:1.0:1790740517.659323:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001038080 00000100:00100000:1.0:1790740517.659494:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 123 00000100:00100000:1.0:1790740517.659509:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc889c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b6742f8-8cda-45db-8c52-3634e9260d75+8:14909:x1877727001038080:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790740517.659953:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc889c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b6742f8-8cda-45db-8c52-3634e9260d75+8:14909:x1877727001038080:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 445us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740517.659964:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 123 00000100:00100000:1.0:1790740517.720019:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740517.721093:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001038208 00000100:00100000:2.0:1790740517.721111:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001038208 00000100:00100000:3.0:1790740517.721269:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 124 00000100:00100000:3.0:1790740517.721284:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc889c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b6742f8-8cda-45db-8c52-3634e9260d75+8:14909:x1877727001038208:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790740517.721680:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc889c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b6742f8-8cda-45db-8c52-3634e9260d75+8:14909:x1877727001038208:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 397us (1675us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740517.721692:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 124 00000100:00100000:0.0:1790740517.727702:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740517.727798:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001038336 00000100:00100000:1.0:1790740517.727813:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001038336 00000100:00100000:1.0:1790740517.727894:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 125 00000100:00100000:1.0:1790740517.727911:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc889c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b6742f8-8cda-45db-8c52-3634e9260d75+8:14909:x1877727001038336:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790740517.728450:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc889c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b6742f8-8cda-45db-8c52-3634e9260d75+8:14909:x1877727001038336:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 470us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740517.728462:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 125 00000100:00100000:0.0:1790740517.732234:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740517.732327:0:17160:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001038464 00000100:00100000:2.0:1790740517.732342:0:17160:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001038464 00000100:00100000:2.0:1790740517.732421:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 126 00000100:00100000:2.0:1790740517.732434:0:17160:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc889c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b6742f8-8cda-45db-8c52-3634e9260d75+8:14891:x1877727001038464:12345-192.168.204.3@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790740517.732460:0:17160:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740517.732489:0:17160:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98db83f32e00/0xb25dda4f4e92f137 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae24058 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740517.732531:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98db83f32e00/0xb25dda4f4e92f137 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24058 expref: 9 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740517.732557:0:17160:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98db83f32e00/0xb25dda4f4e92f137 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24058 expref: 9 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740517.732568:0:17160:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f32e00, rc 0) 00000100:00100000:2.0:1790740517.732839:0:17160:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc889c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b6742f8-8cda-45db-8c52-3634e9260d75+9:14891:x1877727001038464:12345-192.168.204.3@tcp:101:mount.lustre.0 Request processed in 405us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740517.732848:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 126 00000100:00100000:1.0:1790740517.739504:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740517.739723:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001038592 00000100:00100000:3.0:1790740517.739740:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001038592 00000100:00100000:3.0:1790740517.739824:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 127 00000100:00100000:3.0:1790740517.739835:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc889c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b6742f8-8cda-45db-8c52-3634e9260d75+9:14891:x1877727001038592:12345-192.168.204.3@tcp:256:mount.lustre.0 20000000:01000000:3.0:1790740517.739869:0:17161:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1790740517.739902:0:17161:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1790740517.739907:0:17161:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1790740517.739911:0:17161:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1790740517.739914:0:17161:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1790740517.739917:0:17161:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:3.0:1790740517.741609:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc889c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b6742f8-8cda-45db-8c52-3634e9260d75+9:14891:x1877727001038592:12345-192.168.204.3@tcp:256:mount.lustre.0 Request processed in 1762us (2109us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740517.741626:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 127 00000100:00100000:0.0:1790740517.748286:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740517.748413:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001038720 00000100:00100000:3.0:1790740517.748429:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001038720 00000100:00100000:3.0:1790740517.748616:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 128 00000100:00100000:3.0:1790740517.748630:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc217450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b6742f8-8cda-45db-8c52-3634e9260d75+9:14891:x1877727001038720:12345-192.168.204.3@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790740517.748656:0:17159:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740517.748681:0:17159:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcb5dc8200/0xb25dda4f4e92f13e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae2405f expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740517.748756:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcb5dc8200/0xb25dda4f4e92f13e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae2405f expref: 10 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740517.748780:0:17159:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcb5dc8200/0xb25dda4f4e92f13e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae2405f expref: 10 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740517.748800:0:17159:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc8200, rc 0) 00000100:00100000:3.0:1790740517.748886:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc217450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b6742f8-8cda-45db-8c52-3634e9260d75+10:14891:x1877727001038720:12345-192.168.204.3@tcp:101:mount.lustre.0 Request processed in 259us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740517.748893:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 128 00000100:00100000:0.0:1790740517.755491:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740517.755610:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001038848 00000100:00100000:3.0:1790740517.755697:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001038848 00000100:00100000:3.0:1790740517.755902:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 129 00000100:00100000:3.0:1790740517.755916:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b6742f8-8cda-45db-8c52-3634e9260d75+10:14891:x1877727001038848:12345-192.168.204.3@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790740517.756180:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b6742f8-8cda-45db-8c52-3634e9260d75+10:14891:x1877727001038848:12345-192.168.204.3@tcp:501:mount.lustre.0 Request processed in 266us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740517.756191:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 129 00000100:00100000:1.0:1790740517.758570:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740517.758951:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001038976 00000100:00100000:3.0:1790740517.758965:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001038976 00000100:00100000:3.0:1790740517.759068:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 130 00000100:00100000:3.0:1790740517.759080:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b6742f8-8cda-45db-8c52-3634e9260d75+10:14891:x1877727001038976:12345-192.168.204.3@tcp:503:mount.lustre.0 00000100:00100000:3.0:1790740517.759411:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b6742f8-8cda-45db-8c52-3634e9260d75+10:14891:x1877727001038976:12345-192.168.204.3@tcp:503:mount.lustre.0 Request processed in 332us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740517.759420:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 130 00000100:00100000:0.0:1790740517.763174:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740517.763396:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001039104 00000100:00100000:3.0:1790740517.763425:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001039104 00000100:00100000:3.0:1790740517.763501:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 131 00000100:00100000:3.0:1790740517.763519:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc216450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b6742f8-8cda-45db-8c52-3634e9260d75+10:14914:x1877727001039104:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790740517.763741:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc216450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b6742f8-8cda-45db-8c52-3634e9260d75+10:14914:x1877727001039104:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 229us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740517.763752:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 131 00000100:00100000:0.0:1790740517.768876:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740517.769080:0:17160:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001039232 00000100:00100000:2.0:1790740517.769095:0:17160:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001039232 00000100:00100000:2.0:1790740517.769173:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 132 00000100:00100000:2.0:1790740517.769187:0:17160:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc217850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b6742f8-8cda-45db-8c52-3634e9260d75+10:14914:x1877727001039232:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790740517.769426:0:17160:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc217850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b6742f8-8cda-45db-8c52-3634e9260d75+10:14914:x1877727001039232:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 242us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740517.769436:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 132 00000100:00100000:1.0:1790740517.782455:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740517.782594:0:17166:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001039360 00000100:00100000:0.0:1790740517.782609:0:17166:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001039360 00000100:00100000:0.0:1790740517.782676:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 7 00000100:00100000:0.0:1790740517.782686:0:17166:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1877727001039360:12345-192.168.204.3@tcp:38:mount.lustre.0 00010000:00080000:0.0:1790740517.782735:0:17166:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 8e31bfdb-0682-4acb-9750-d1df4d991489@192.168.204.3@tcp t0 exp 0000000000000000 cur 589 last 0 00000020:00000080:0.0:1790740517.782811:0:17166:0:(genops.c:1384:class_connect()) connect: client 8e31bfdb-0682-4acb-9750-d1df4d991489, cookie 0xb25dda4f4e92f145 00000004:00100000:0.0:1790740517.782850:0:17166:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1790740517.783487:0:17166:0:(import.c:65:import_set_state_nolock()) ffff98dcbd338000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790740517.783593:0:17166:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e31bfdb-0682-4acb-9750-d1df4d991489+6:2401:x1877727001039360:12345-192.168.204.3@tcp:38:mount.lustre.0 Request processed in 906us (1153us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740517.783604:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 7 00000100:00100000:2.0:1790740517.789120:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740517.792186:0:17165:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001039616 00000100:00100000:0.0:1790740517.792210:0:17165:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001039616 00000100:00100000:0.0:1790740517.792291:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 8 00000100:00100000:0.0:1790740517.792301:0:17165:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1877727001039616:12345-192.168.204.3@tcp:38:mount.lustre.0 00010000:00080000:0.0:1790740517.792383:0:17165:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 8e31bfdb-0682-4acb-9750-d1df4d991489@192.168.204.3@tcp t0 exp 0000000000000000 cur 589 last 0 00000020:00000080:0.0:1790740517.792459:0:17165:0:(genops.c:1384:class_connect()) connect: client 8e31bfdb-0682-4acb-9750-d1df4d991489, cookie 0xb25dda4f4e92f14c 00000004:00100000:0.0:1790740517.792496:0:17165:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1790740517.792971:0:17165:0:(import.c:65:import_set_state_nolock()) ffff98db8295f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790740517.796240:0:17165:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e31bfdb-0682-4acb-9750-d1df4d991489+6:2401:x1877727001039616:12345-192.168.204.3@tcp:38:mount.lustre.0 Request processed in 3919us (7117us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740517.796267:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 8 00000100:00100000:0.0:1790740517.797582:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740517.797886:0:17166:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001039488 00000100:00100000:2.0:1790740517.797899:0:17166:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001039488 00000100:00100000:2.0:1790740517.797998:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 9 00000100:00100000:2.0:1790740517.798012:0:17166:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e31bfdb-0682-4acb-9750-d1df4d991489+6:0:x1877727001039488:12345-192.168.204.3@tcp:41:mount.lustre.0 00000004:00000024:2.0:1790740517.798098:0:17166:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1790740517.798239:0:17166:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e31bfdb-0682-4acb-9750-d1df4d991489+6:0:x1877727001039488:12345-192.168.204.3@tcp:41:mount.lustre.0 Request processed in 230us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740517.798248:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 9 00000100:00100000:0.0:1790740517.798913:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740517.799008:0:19500:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001039872 00000100:00100000:2.0:1790740517.799016:0:19500:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001039872 00000100:00100000:2.0:1790740517.799080:0:19500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 10 00000100:00100000:2.0:1790740517.799089:0:19500:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e31bfdb-0682-4acb-9750-d1df4d991489+6:14891:x1877727001039872:12345-192.168.204.3@tcp:41:mount.lustre.0 00000004:00000024:2.0:1790740517.799113:0:19500:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1790740517.799158:0:19500:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e31bfdb-0682-4acb-9750-d1df4d991489+6:14891:x1877727001039872:12345-192.168.204.3@tcp:41:mount.lustre.0 Request processed in 71us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740517.799166:0:19500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 10 00000100:00080000:3.0:1790740517.799325:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790740517.802175:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740517.802392:0:17166:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001039744 00000100:00100000:0.0:1790740517.802405:0:17166:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001039744 00000100:00100000:0.0:1790740517.802496:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 11 00000100:00100000:0.0:1790740517.802507:0:17166:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e31bfdb-0682-4acb-9750-d1df4d991489+6:0:x1877727001039744:12345-192.168.204.3@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790740517.802559:0:17166:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00080000:3.0:1790740517.802903:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790740517.803914:0:17166:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e31bfdb-0682-4acb-9750-d1df4d991489+6:0:x1877727001039744:12345-192.168.204.3@tcp:41:mount.lustre.0 Request processed in 1398us (1744us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740517.803927:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 11 00000100:00100000:2.0:1790740517.810744:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740517.810903:0:17167:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001040000 00000100:00100000:0.0:1790740517.810919:0:17167:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001040000 00000100:00100000:0.0:1790740517.811006:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 12 00000100:00100000:0.0:1790740517.811018:0:17167:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e31bfdb-0682-4acb-9750-d1df4d991489+6:14891:x1877727001040000:12345-192.168.204.3@tcp:40:mount.lustre.0 00000100:00100000:0.0:1790740517.811154:0:17167:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e31bfdb-0682-4acb-9750-d1df4d991489+6:14891:x1877727001040000:12345-192.168.204.3@tcp:40:mount.lustre.0 Request processed in 138us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740517.811162:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 12 00000100:00100000:3.0:1790740517.825660:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740517.825733:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740517.825926:0:18675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001040128 00000100:00100000:0.0:1790740517.825964:0:18675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001040128 00000100:00100000:0.0:1790740517.826025:0:18675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001040256 00000100:00100000:0.0:1790740517.826071:0:18675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001040256 00000100:00100000:0.0:1790740517.826097:0:18675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 21 00000100:00100000:0.0:1790740517.826106:0:18675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2401:x1877727001040128:12345-192.168.204.3@tcp:8:mount.lustre.0 00010000:00080000:0.0:1790740517.826165:0:18675:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 8e31bfdb-0682-4acb-9750-d1df4d991489@192.168.204.3@tcp t0 exp 0000000000000000 cur 589 last 0 00000020:00000080:0.0:1790740517.826209:0:18675:0:(genops.c:1384:class_connect()) connect: client 8e31bfdb-0682-4acb-9750-d1df4d991489, cookie 0xb25dda4f4e92f153 00002000:00100000:0.0:1790740517.826226:0:18675:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8e31bfdb-0682-4acb-9750-d1df4d991489/ffff98dcbd3fd800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790740517.826250:0:18675:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790740517.826509:0:18675:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790740517.826556:0:18675:0:(import.c:65:import_set_state_nolock()) ffff98dcbd3fc800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790740517.826658:0:18675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8e31bfdb-0682-4acb-9750-d1df4d991489+6:2401:x1877727001040128:12345-192.168.204.3@tcp:8:mount.lustre.0 Request processed in 549us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740517.826666:0:18675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 21 00000100:00100000:0.0:1790740517.826690:0:18675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 22 00000100:00100000:0.0:1790740517.826695:0:18675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2401:x1877727001040256:12345-192.168.204.3@tcp:8:mount.lustre.0 00010000:00080000:0.0:1790740517.826727:0:18675:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 8e31bfdb-0682-4acb-9750-d1df4d991489@192.168.204.3@tcp t0 exp 0000000000000000 cur 589 last 0 00000020:00000080:0.0:1790740517.826757:0:18675:0:(genops.c:1384:class_connect()) connect: client 8e31bfdb-0682-4acb-9750-d1df4d991489, cookie 0xb25dda4f4e92f15a 00002000:00100000:0.0:1790740517.826775:0:18675:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8e31bfdb-0682-4acb-9750-d1df4d991489/ffff98dcbd3fa000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790740517.826791:0:18675:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790740517.827251:0:18675:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1790740517.827275:0:18675:0:(import.c:65:import_set_state_nolock()) ffff98dcbd3fc000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790740517.827314:0:18675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8e31bfdb-0682-4acb-9750-d1df4d991489+6:2401:x1877727001040256:12345-192.168.204.3@tcp:8:mount.lustre.0 Request processed in 617us (1579us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740517.827322:0:18675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 22 00000100:00100000:1.0:1790740517.830213:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740517.830414:0:17176:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001040384 00000100:00100000:3.0:1790740517.830428:0:17176:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001040384 00000100:00100000:3.0:1790740517.830503:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 3 00000100:00100000:3.0:1790740517.830517:0:17176:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8e31bfdb-0682-4acb-9750-d1df4d991489+6:14891:x1877727001040384:12345-192.168.204.3@tcp:900:mount.lustre.0 00000100:00100000:3.0:1790740517.830639:0:17176:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8e31bfdb-0682-4acb-9750-d1df4d991489+6:14891:x1877727001040384:12345-192.168.204.3@tcp:900:mount.lustre.0 Request processed in 124us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740517.830647:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 3 00000100:00100000:0.0:1790740517.833168:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740517.833466:0:17168:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001040512 00000100:00100000:1.0:1790740517.833481:0:17168:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001040512 00000100:00100000:1.0:1790740517.833551:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 0 00000100:00100000:1.0:1790740517.833562:0:17168:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8e31bfdb-0682-4acb-9750-d1df4d991489+6:14891:x1877727001040512:12345-192.168.204.3@tcp:33:mount.lustre.0 00000004:00080000:1.0:1790740517.838975:0:17168:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 5283us 00000004:00200000:3.0:1790740517.862175:0:17168:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1790740517.862368:0:17168:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8e31bfdb-0682-4acb-9750-d1df4d991489+6:14891:x1877727001040512:12345-192.168.204.3@tcp:33:mount.lustre.0 Request processed in 28799us (29205us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740517.862386:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 0 00000100:00100000:2.0:1790740518.029532:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740518.029833:0:19500:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001040640 00000100:00100000:0.0:1790740518.029848:0:19500:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001040640 00000100:00100000:0.0:1790740518.030351:0:19500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 13 00000100:00100000:0.0:1790740518.030366:0:19500:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e31bfdb-0682-4acb-9750-d1df4d991489+6:14937:x1877727001040640:12345-192.168.204.3@tcp:101:mkdir.0 00010000:00010000:0.0:1790740518.030400:0:19500:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740518.030907:0:19500:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db82343e00/0xb25dda4f4e92f161 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae24090 expref: -99 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740518.031007:0:19500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342400/0xb25dda4f4e92f168 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740518.031021:0:19500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342400/0xb25dda4f4e92f168 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740518.031082:0:19500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342400/0xb25dda4f4e92f168 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790740518.031136:0:19500:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790740518.031141:0:19500:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790740518.031178:0:19500:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342400/0xb25dda4f4e92f168 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740518.031206:0:19500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db82343e00/0xb25dda4f4e92f161 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24090 expref: 8 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740518.031227:0:19500:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342400/0xb25dda4f4e92f168 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24090 expref: 7 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740518.031236:0:19500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98db82cc9400) 00010000:00010000:0.0:1790740518.031252:0:19500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790740518.031256:0:19500:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db82342400, rc 0) 00000100:00100000:0.0:1790740518.031336:0:19500:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e31bfdb-0682-4acb-9750-d1df4d991489+7:14937:x1877727001040640:12345-192.168.204.3@tcp:101:mkdir.0 Request processed in 973us (1820us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740518.031345:0:19500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 13 00010000:00010000:3.0:1790740518.058381:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740519.018455:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022097920:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790740519.018573:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740519.018983:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ee8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022098048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790740519.019026:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740519.019063:0:18676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022097920 00000100:00100000:2.0:1790740519.019074:0:18676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022097920 00000100:00100000:1.0:1790740519.019102:0:19777:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022098048 00000100:00100000:1.0:1790740519.019120:0:19777:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022098048 00000100:00100000:2.0:1790740519.019153:0:18676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1790740519.019221:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790740519.019375:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3641:1877727022098176:0@lo:400:kworker.0 00000100:00100000:3.0:1790740519.019423:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740519.019437:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022098432:0@lo:400:kworker.0 00000100:00100000:3.0:1790740519.019455:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfc74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022098688:0@lo:400:kworker.0 00000100:00100000:0.0:1790740519.019476:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740519.019501:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfc77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877727022098944:0@lo:400:kworker.0 00000100:00100000:3.0:1790740519.019526:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740519.019533:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740519.019558:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfc75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1877727022099200:0@lo:400:kworker.0 00000100:00100000:0.0:1790740519.019560:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfc75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1877727022099456:0@lo:400:kworker.0 00000100:00100000:3.0:1790740519.019591:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740519.019609:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022098176 00000100:00100000:0.0:1790740519.019614:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022098176 00000100:00100000:3.0:1790740519.019628:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1790740519.019637:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877727022098560:0@lo:400:kworker.0 00000100:00100000:0.0:1790740519.019651:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1790740519.019663:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+24:3641:x1877727022098176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740519.019670:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740519.019736:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+24:3641:x1877727022098176:12345-0@lo:400:kworker.0 Request processed in 75us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740519.019744:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1790740519.019780:0:18675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022098432 00000100:00100000:0.0:1790740519.019783:0:18675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022098432 00000100:00100000:0.0:1790740519.019894:0:18675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790740519.019902:0:18675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022098432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740519.019936:0:18675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022098432:12345-0@lo:400:kworker.0 Request processed in 36us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740519.019943:0:18675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790740519.019972:0:17167:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022098944 00000100:00100000:0.0:1790740519.019976:0:17167:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022098944 00000100:00100000:0.0:1790740519.019999:0:17167:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022099200 00000100:00100000:0.0:1790740519.020002:0:17167:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022099200 00000100:00100000:0.0:1790740519.020016:0:17167:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022098560 00000100:00100000:0.0:1790740519.020019:0:17167:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022098560 00000100:00100000:0.0:1790740519.020071:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790740519.020078:0:17167:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877727022098944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740519.020111:0:17167:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877727022098944:12345-0@lo:400:kworker.0 Request processed in 34us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740519.020118:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790740519.020128:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790740519.020134:0:17167:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1877727022099200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740519.020160:0:17167:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1877727022099200:12345-0@lo:400:kworker.0 Request processed in 26us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740519.020166:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790740519.020177:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790740519.020296:0:18676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022097920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790740519.020317:0:18676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1790740519.020355:0:18676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022097920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (1783us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740519.020384:0:17167:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877727022098560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740519.020413:0:17167:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877727022098560:12345-0@lo:400:kworker.0 Request processed in 32us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740519.020421:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790740519.020441:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877727022098560:0@lo:400:kworker.0 00000100:00080000:0.0:1790740519.020441:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790740519.020447:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790740519.020454:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfc77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1877727022099072:0@lo:400:kworker.0 00000100:00100000:0.0:1790740519.020466:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740519.020490:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740519.020509:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022097920:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790740519.020555:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3641:1877727022098176:0@lo:400:kworker.0 00000100:00100000:1.0:1790740519.030184:0:19777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790740519.030308:0:19777:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1877727022098048:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790740519.030329:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022098432:0@lo:400:kworker.0 00002000:00000024:1.0:1790740519.030358:0:19777:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1790740519.030378:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfc77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877727022098944:0@lo:400:kworker.0 00000100:00100000:0.0:1790740519.030426:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1790740519.030452:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022098304:0@lo:400:kworker.0 00000100:00100000:0.0:1790740519.030506:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740519.030566:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfc76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022098816:0@lo:400:kworker.0 00000100:00100000:2.0:1790740519.030651:0:18676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790740519.030681:0:19777:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1877727022098048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 477us (11652us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740519.030724:0:17170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022098688 00000100:00100000:2.0:1790740519.030733:0:17170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022098688 00000100:00100000:2.0:1790740519.030777:0:17170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022098304 00000100:00100000:2.0:1790740519.030782:0:17170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022098304 00000100:00100000:1.0:1790740519.030782:0:19777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790740519.030852:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ee8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022098048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790740519.030913:0:19500:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022099456 00000100:00100000:1.0:1790740519.030917:0:19500:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022099456 00000100:00100000:1.0:1790740519.030969:0:19500:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022099072 00000100:00100000:1.0:1790740519.030974:0:19500:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022099072 00000100:00100000:1.0:1790740519.030997:0:19500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790740519.031005:0:19500:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ee9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1877727022099456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740519.031080:0:19500:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ee9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1877727022099456:12345-0@lo:400:kworker.0 Request processed in 76us (10615us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740519.031087:0:19500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790740519.031100:0:19500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790740519.031107:0:19500:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1877727022099072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740519.031140:0:19500:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1877727022099072:12345-0@lo:400:kworker.0 Request processed in 35us (10652us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740519.031146:0:19500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1790740519.031164:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790740519.031169:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790740519.031393:0:17907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790740519.031404:0:17907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022098688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740519.031492:0:17907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022098688:12345-0@lo:400:kworker.0 Request processed in 45us (11941us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740519.031500:0:17907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790740519.031518:0:17907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790740519.031524:0:17907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022098304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740519.031571:0:17907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022098304:12345-0@lo:400:kworker.0 Request processed in 48us (1066us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740519.031577:0:17907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790740519.032314:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740519.032363:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfc75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1877727022099328:0@lo:400:kworker.0 00000100:00100000:0.0:1790740519.032408:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1790740519.032449:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcbfc75f80 x1877727022099456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740535 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740519.032465:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfc75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1877727022099456:0@lo:400:kworker.0 00000100:00100000:0.0:1790740519.032492:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022098304:0@lo:400:kworker.0 00000100:00100000:0.0:1790740519.032522:0:19500:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022099328 00000100:00100000:0.0:1790740519.032528:0:19500:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022099328 00000100:00100000:0.0:1790740519.032578:0:19500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790740519.032586:0:19500:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1877727022099328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740519.032630:0:19500:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1877727022099328:12345-0@lo:400:kworker.0 Request processed in 45us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740519.032638:0:19500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1790740519.032658:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790740519.032682:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfc75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1877727022099328:0@lo:400:kworker.0 00010000:00080000:3.0:1790740519.035024:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98dcbfc75180 x1877727022099200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740535 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740519.035066:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfc75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1877727022099200:0@lo:400:kworker.0 00000100:00100000:3.0:1790740519.035172:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfc77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1877727022099072:0@lo:400:kworker.0 00000100:00100000:3.0:1790740519.035188:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfc74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022098688:0@lo:400:kworker.0 00000100:00100000:1.0:1790740519.037126:0:18673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022098816 00000100:00100000:1.0:1790740519.037147:0:18673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022098816 00000100:00100000:1.0:1790740519.037277:0:18673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790740519.037288:0:18673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022098816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740519.037452:0:18673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022098816:12345-0@lo:400:kworker.0 Request processed in 164us (5139us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740519.037460:0:18673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790740519.038852:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfc76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022098816:0@lo:400:kworker.0 00000100:00080000:0.0:1790740519.041788:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790740519.089118:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740519.531016:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790740519.537424:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022099584:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790740519.537534:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740519.542538:0:19777:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022099584 00000100:00100000:1.0:1790740519.542562:0:19777:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022099584 00000100:00100000:1.0:1790740519.542663:0:19777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790740519.542686:0:19777:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022099584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790740519.542726:0:19777:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1790740519.542971:0:19777:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022099584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 297us (5436us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740519.542981:0:19777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790740519.543066:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022099584:0@lo:13:osp-pre-0-1.0 00000001:00100000:3.0:1790740519.544828:0:19487:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8e31bfdb-0682-4acb-9750-d1df4d991489 00000001:00080000:3.0:1790740519.544859:0:19487:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:2.0:1790740520.042747:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ee9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022099712:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790740520.043104:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740520.044615:0:17907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022099712 00000100:00100000:1.0:1790740520.044787:0:17907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022099712 00000100:00100000:1.0:1790740520.044888:0:17907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790740520.044901:0:17907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022099712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790740520.044954:0:17907:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1790740520.051607:0:17907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022099712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 6692us (8486us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740520.051632:0:17907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790740520.053745:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ee9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022099712:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1790740520.107722:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740520.325784:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740520.326531:0:17166:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001040768 00000100:00100000:1.0:1790740520.326545:0:17166:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001040768 00000100:00100000:1.0:1790740520.326671:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 14 00000100:00100000:1.0:1790740520.326685:0:17166:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e31bfdb-0682-4acb-9750-d1df4d991489+7:14989:x1877727001040768:12345-192.168.204.3@tcp:41:lfs.0 00000004:00000024:1.0:1790740520.326742:0:17166:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1790740520.326875:0:17166:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e31bfdb-0682-4acb-9750-d1df4d991489+7:14989:x1877727001040768:12345-192.168.204.3@tcp:41:lfs.0 Request processed in 193us (1105us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740520.326884:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 14 00000100:00080000:0.0:1790740520.327085:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790740520.330818:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740520.331071:0:19500:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001040896 00000100:00100000:0.0:1790740520.331086:0:19500:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001040896 00000100:00100000:0.0:1790740520.331204:0:19500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 15 00000100:00100000:0.0:1790740520.331237:0:19500:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e31bfdb-0682-4acb-9750-d1df4d991489+6:14989:x1877727001040896:12345-192.168.204.3@tcp:41:lfs.0 00000004:00000024:0.0:1790740520.331293:0:19500:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790740520.331429:0:19500:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e31bfdb-0682-4acb-9750-d1df4d991489+6:14989:x1877727001040896:12345-192.168.204.3@tcp:41:lfs.0 Request processed in 195us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740520.331438:0:19500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 15 00000100:00080000:1.0:1790740520.332461:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790740520.336884:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740520.337408:0:18676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001041024 00000100:00100000:1.0:1790740520.337423:0:18676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001041024 00000100:00100000:1.0:1790740520.337906:0:18676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 13 00000100:00100000:1.0:1790740520.337921:0:18676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8e31bfdb-0682-4acb-9750-d1df4d991489+6:14989:x1877727001041024:12345-192.168.204.3@tcp:13:lfs.0 00000100:00080000:0.0:1790740520.338061:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1790740520.339603:0:18676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1790740520.339827:0:18676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8e31bfdb-0682-4acb-9750-d1df4d991489+6:14989:x1877727001041024:12345-192.168.204.3@tcp:13:lfs.0 Request processed in 1897us (3875us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740520.339840:0:18676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 13 00000100:00100000:3.0:1790740520.356196:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740520.356821:0:19777:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001041152 00000100:00100000:1.0:1790740520.356836:0:19777:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001041152 00000100:00080000:0.0:1790740520.357016:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790740520.358139:0:19777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 14 00000100:00100000:1.0:1790740520.358164:0:19777:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8e31bfdb-0682-4acb-9750-d1df4d991489+5:14989:x1877727001041152:12345-192.168.204.3@tcp:13:lfs.0 00002000:00000024:1.0:1790740520.358213:0:19777:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1790740520.358495:0:19777:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8e31bfdb-0682-4acb-9750-d1df4d991489+5:14989:x1877727001041152:12345-192.168.204.3@tcp:13:lfs.0 Request processed in 340us (2313us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740520.358504:0:19777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 14 00000040:00080000:2.0:1790740520.491003:0:17201:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1790740520.543289:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740520.543539:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001041280 00000100:00100000:3.0:1790740520.543554:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001041280 00000100:00100000:3.0:1790740520.543649:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 134 00000100:00100000:3.0:1790740520.543672:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc37b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b6742f8-8cda-45db-8c52-3634e9260d75+10:15023:x1877727001041280:12345-192.168.204.3@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790740520.543696:0:17161:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740520.543722:0:17161:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcb5dc8800/0xb25dda4f4e92f16f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae24097 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740520.543762:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcb5dc8800/0xb25dda4f4e92f16f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24097 expref: 11 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740520.543778:0:17161:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcb5dc8800/0xb25dda4f4e92f16f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24097 expref: 11 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740520.543787:0:17161:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc8800, rc 0) 00000100:00100000:3.0:1790740520.543966:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc37b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b6742f8-8cda-45db-8c52-3634e9260d75+11:15023:x1877727001041280:12345-192.168.204.3@tcp:101:mount.lustre.0 Request processed in 306us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740520.543975:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 134 00000100:00100000:3.0:1790740520.556606:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790740520.556645:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022099840:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790740520.556764:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740520.557184:0:17170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022099840 00000100:00100000:2.0:1790740520.557196:0:17170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022099840 00000100:00100000:2.0:1790740520.557279:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790740520.557290:0:17170:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022099840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790740520.557329:0:17170:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790740520.557403:0:17170:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022099840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740520.557411:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790740520.557607:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022099840:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790740520.560897:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740520.561117:0:17160:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001041408 00000100:00100000:1.0:1790740520.561149:0:17160:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001041408 00000100:00100000:1.0:1790740520.561226:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 135 00000100:00100000:1.0:1790740520.561238:0:17160:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc37b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b6742f8-8cda-45db-8c52-3634e9260d75+11:15023:x1877727001041408:12345-192.168.204.3@tcp:501:mount.lustre.0 00000100:00100000:1.0:1790740520.561457:0:17160:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc37b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b6742f8-8cda-45db-8c52-3634e9260d75+11:15023:x1877727001041408:12345-192.168.204.3@tcp:501:mount.lustre.0 Request processed in 220us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740520.561466:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 135 00000100:00100000:1.0:1790740520.564714:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740520.565315:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001041536 00000100:00100000:3.0:1790740520.565329:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001041536 00000100:00100000:3.0:1790740520.565462:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 136 00000100:00100000:3.0:1790740520.565476:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc37bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b6742f8-8cda-45db-8c52-3634e9260d75+11:15023:x1877727001041536:12345-192.168.204.3@tcp:503:mount.lustre.0 00000100:00100000:3.0:1790740520.565733:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc37bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b6742f8-8cda-45db-8c52-3634e9260d75+11:15023:x1877727001041536:12345-192.168.204.3@tcp:503:mount.lustre.0 Request processed in 260us (1034us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740520.565743:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 136 00000100:00100000:2.0:1790740520.569816:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740520.569954:0:17160:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001041664 00000100:00100000:1.0:1790740520.569969:0:17160:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001041664 00000100:00100000:1.0:1790740520.570098:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 137 00000100:00100000:1.0:1790740520.570111:0:17160:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b6742f8-8cda-45db-8c52-3634e9260d75+11:15028:x1877727001041664:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790740520.570345:0:17160:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b6742f8-8cda-45db-8c52-3634e9260d75+11:15028:x1877727001041664:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 236us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740520.570355:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 137 00000100:00100000:2.0:1790740520.617262:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740520.617427:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001041792 00000100:00100000:3.0:1790740520.617442:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001041792 00000100:00100000:3.0:1790740520.617521:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 138 00000100:00100000:3.0:1790740520.617533:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc37a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b6742f8-8cda-45db-8c52-3634e9260d75+11:15028:x1877727001041792:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790740520.617755:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc37a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b6742f8-8cda-45db-8c52-3634e9260d75+11:15028:x1877727001041792:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 224us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740520.617764:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 138 00000100:00100000:3.0:1790740520.629088:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740520.629225:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001041920 00000100:00100000:0.0:1790740520.629240:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001041920 00000100:00100000:0.0:1790740520.629322:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 139 00000100:00100000:0.0:1790740520.629335:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc378850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b6742f8-8cda-45db-8c52-3634e9260d75+11:15028:x1877727001041920:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790740520.629567:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc378850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b6742f8-8cda-45db-8c52-3634e9260d75+11:15028:x1877727001041920:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 234us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740520.629585:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 139 00000100:00100000:2.0:1790740520.637396:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740520.637547:0:17160:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001042048 00000100:00100000:1.0:1790740520.637564:0:17160:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001042048 00000100:00100000:1.0:1790740520.637645:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 140 00000100:00100000:1.0:1790740520.637668:0:17160:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc37b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b6742f8-8cda-45db-8c52-3634e9260d75+11:15023:x1877727001042048:12345-192.168.204.3@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790740520.637692:0:17160:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740520.637719:0:17160:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcbfc44c00/0xb25dda4f4e92f176 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae240c8 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740520.637757:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcbfc44c00/0xb25dda4f4e92f176 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae240c8 expref: 12 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740520.637770:0:17160:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcbfc44c00/0xb25dda4f4e92f176 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae240c8 expref: 12 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740520.637811:0:17160:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcbfc44c00, rc 0) 00000100:00100000:1.0:1790740520.638118:0:17160:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc37b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b6742f8-8cda-45db-8c52-3634e9260d75+12:15023:x1877727001042048:12345-192.168.204.3@tcp:101:mount.lustre.0 Request processed in 460us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740520.638126:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 140 00000100:00100000:2.0:1790740520.646803:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740520.646992:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001042176 00000100:00100000:3.0:1790740520.647019:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001042176 00000100:00100000:3.0:1790740520.647364:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 141 00000100:00100000:3.0:1790740520.647376:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b6742f8-8cda-45db-8c52-3634e9260d75+12:15023:x1877727001042176:12345-192.168.204.3@tcp:256:mount.lustre.0 20000000:01000000:3.0:1790740520.647416:0:17161:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1790740520.647454:0:17161:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1790740520.647459:0:17161:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1790740520.647463:0:17161:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1790740520.647467:0:17161:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1790740520.647469:0:17161:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:3.0:1790740520.651651:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b6742f8-8cda-45db-8c52-3634e9260d75+12:15023:x1877727001042176:12345-192.168.204.3@tcp:256:mount.lustre.0 Request processed in 4258us (4859us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740520.651682:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 141 00000100:00100000:2.0:1790740520.656768:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740520.656992:0:17160:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001042304 00000100:00100000:1.0:1790740520.657014:0:17160:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001042304 00000100:00100000:1.0:1790740520.657293:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 142 00000100:00100000:1.0:1790740520.657306:0:17160:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b6742f8-8cda-45db-8c52-3634e9260d75+12:15023:x1877727001042304:12345-192.168.204.3@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790740520.657330:0:17160:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740520.657353:0:17160:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcbfc45400/0xb25dda4f4e92f17d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae240cf expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740520.657392:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcbfc45400/0xb25dda4f4e92f17d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae240cf expref: 13 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740520.657404:0:17160:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcbfc45400/0xb25dda4f4e92f17d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae240cf expref: 13 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740520.657416:0:17160:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcbfc45400, rc 0) 00000100:00100000:1.0:1790740520.657500:0:17160:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b6742f8-8cda-45db-8c52-3634e9260d75+13:15023:x1877727001042304:12345-192.168.204.3@tcp:101:mount.lustre.0 Request processed in 198us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740520.657508:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 142 00000100:00100000:2.0:1790740520.659718:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740520.659903:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001042432 00000100:00100000:3.0:1790740520.659916:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001042432 00000100:00100000:3.0:1790740520.660000:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 143 00000100:00100000:3.0:1790740520.660017:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc37a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b6742f8-8cda-45db-8c52-3634e9260d75+13:15023:x1877727001042432:12345-192.168.204.3@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790740520.660693:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc37a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b6742f8-8cda-45db-8c52-3634e9260d75+13:15023:x1877727001042432:12345-192.168.204.3@tcp:501:mount.lustre.0 Request processed in 680us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740520.660704:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 143 00000100:00100000:2.0:1790740520.664766:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740520.665521:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001042560 00000100:00100000:0.0:1790740520.665536:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001042560 00000100:00100000:0.0:1790740520.665734:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 144 00000100:00100000:0.0:1790740520.665748:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b6742f8-8cda-45db-8c52-3634e9260d75+13:15023:x1877727001042560:12345-192.168.204.3@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790740520.665984:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b6742f8-8cda-45db-8c52-3634e9260d75+13:15023:x1877727001042560:12345-192.168.204.3@tcp:503:mount.lustre.0 Request processed in 238us (1231us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740520.665994:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 144 00000100:00100000:1.0:1790740520.669608:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740520.670981:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001042688 00000100:00100000:2.0:1790740520.670997:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001042688 00000100:00100000:2.0:1790740520.674966:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 145 00000100:00100000:2.0:1790740520.675043:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbc378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b6742f8-8cda-45db-8c52-3634e9260d75+13:15033:x1877727001042688:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790740520.675482:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbc378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b6742f8-8cda-45db-8c52-3634e9260d75+13:15033:x1877727001042688:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 492us (5887us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740520.675492:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 145 00000100:00100000:2.0:1790740520.699144:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740520.699923:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001042816 00000100:00100000:1.0:1790740520.699937:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001042816 00000100:00100000:1.0:1790740520.700022:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 146 00000100:00100000:1.0:1790740520.700092:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb6d1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b6742f8-8cda-45db-8c52-3634e9260d75+13:15033:x1877727001042816:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790740520.700290:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb6d1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b6742f8-8cda-45db-8c52-3634e9260d75+13:15033:x1877727001042816:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 207us (1159us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740520.700299:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 146 00000100:00100000:0.0:1790740520.717591:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740520.717643:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740520.718361:0:17166:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001042944 00000100:00100000:1.0:1790740520.718375:0:17166:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001042944 00000100:00100000:1.0:1790740520.718425:0:17166:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001043200 00000100:00100000:1.0:1790740520.718428:0:17166:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001043200 00000100:00100000:1.0:1790740520.718462:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 16 00000100:00100000:1.0:1790740520.718473:0:17166:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ee8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1877727001042944:12345-192.168.204.3@tcp:38:mount.lustre.0 00010000:00080000:1.0:1790740520.718514:0:17166:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 4dca2668-e8ad-455d-9a0a-ed2d1013e863@192.168.204.3@tcp t0 exp 0000000000000000 cur 592 last 0 00000100:00100000:3.0:1790740520.718670:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 17 00000100:00100000:3.0:1790740520.718677:0:17167:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1877727001043200:12345-192.168.204.3@tcp:38:mount.lustre.0 00010000:00080000:3.0:1790740520.718695:0:17167:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 4dca2668-e8ad-455d-9a0a-ed2d1013e863@192.168.204.3@tcp t0 exp 0000000000000000 cur 592 last 0 00000020:00000080:3.0:1790740520.718721:0:17167:0:(genops.c:1384:class_connect()) connect: client 4dca2668-e8ad-455d-9a0a-ed2d1013e863, cookie 0xb25dda4f4e92f18b 00000004:00100000:3.0:1790740520.718754:0:17167:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1790740520.718891:0:17167:0:(import.c:65:import_set_state_nolock()) ffff98db82aac800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790740520.718980:0:17167:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4dca2668-e8ad-455d-9a0a-ed2d1013e863+6:2401:x1877727001043200:12345-192.168.204.3@tcp:38:mount.lustre.0 Request processed in 301us (1336us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740520.718987:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 17 00000020:00000080:1.0:1790740520.719158:0:17166:0:(genops.c:1384:class_connect()) connect: client 4dca2668-e8ad-455d-9a0a-ed2d1013e863, cookie 0xb25dda4f4e92f184 00000004:00100000:1.0:1790740520.719174:0:17166:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1790740520.719525:0:17166:0:(import.c:65:import_set_state_nolock()) ffff98dcbb764800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790740520.719708:0:17166:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ee8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4dca2668-e8ad-455d-9a0a-ed2d1013e863+6:2401:x1877727001042944:12345-192.168.204.3@tcp:38:mount.lustre.0 Request processed in 1235us (2141us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740520.719716:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 16 00000100:00100000:0.0:1790740520.741171:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740520.741397:0:17167:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001043328 00000100:00100000:3.0:1790740520.741411:0:17167:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001043328 00000100:00100000:3.0:1790740520.741527:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 18 00000100:00100000:3.0:1790740520.741540:0:17167:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4dca2668-e8ad-455d-9a0a-ed2d1013e863+6:0:x1877727001043328:12345-192.168.204.3@tcp:41:mount.lustre.0 00000004:00000024:3.0:1790740520.741613:0:17167:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00080000:1.0:1790740520.741759:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790740520.745746:0:17167:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4dca2668-e8ad-455d-9a0a-ed2d1013e863+6:0:x1877727001043328:12345-192.168.204.3@tcp:41:mount.lustre.0 Request processed in 4188us (4570us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740520.745767:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 18 00000100:00100000:2.0:1790740520.757423:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740520.757512:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740520.757644:0:17166:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001043456 00000100:00100000:1.0:1790740520.757668:0:17166:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001043456 00000100:00100000:1.0:1790740520.757769:0:17166:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001043072 00000100:00100000:1.0:1790740520.757773:0:17166:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001043072 00000100:00100000:1.0:1790740520.757813:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 19 00000100:00100000:1.0:1790740520.757827:0:17166:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4dca2668-e8ad-455d-9a0a-ed2d1013e863+7:15023:x1877727001043456:12345-192.168.204.3@tcp:41:mount.lustre.0 00000004:00000024:1.0:1790740520.757882:0:17166:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1790740520.757975:0:17166:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4dca2668-e8ad-455d-9a0a-ed2d1013e863+7:15023:x1877727001043456:12345-192.168.204.3@tcp:41:mount.lustre.0 Request processed in 152us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740520.758003:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 19 00000100:00100000:1.0:1790740520.758026:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 20 00000100:00100000:1.0:1790740520.758063:0:17166:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4dca2668-e8ad-455d-9a0a-ed2d1013e863+6:0:x1877727001043072:12345-192.168.204.3@tcp:41:mount.lustre.0 00000004:00000024:1.0:1790740520.758077:0:17166:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1790740520.758296:0:17166:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4dca2668-e8ad-455d-9a0a-ed2d1013e863+6:0:x1877727001043072:12345-192.168.204.3@tcp:41:mount.lustre.0 Request processed in 263us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740520.758303:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 20 00000100:00080000:2.0:1790740520.760697:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790740520.760897:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740520.761349:0:17166:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001043584 00000100:00100000:1.0:1790740520.761363:0:17166:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001043584 00000100:00100000:1.0:1790740520.761437:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 21 00000100:00100000:1.0:1790740520.761448:0:17166:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4dca2668-e8ad-455d-9a0a-ed2d1013e863+6:15023:x1877727001043584:12345-192.168.204.3@tcp:40:mount.lustre.0 00000100:00100000:1.0:1790740520.764983:0:17166:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4dca2668-e8ad-455d-9a0a-ed2d1013e863+6:15023:x1877727001043584:12345-192.168.204.3@tcp:40:mount.lustre.0 Request processed in 3515us (4071us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740520.765002:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 21 00000100:00100000:0.0:1790740520.774127:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740520.774195:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740520.774241:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740520.774335:0:17176:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001043968 00000100:00100000:3.0:1790740520.774349:0:17176:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001043968 00000100:00100000:3.0:1790740520.774428:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 4 00000100:00100000:3.0:1790740520.774451:0:17176:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4dca2668-e8ad-455d-9a0a-ed2d1013e863+6:15023:x1877727001043968:12345-192.168.204.3@tcp:900:mount.lustre.0 00000100:00100000:3.0:1790740520.774558:0:17176:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4dca2668-e8ad-455d-9a0a-ed2d1013e863+6:15023:x1877727001043968:12345-192.168.204.3@tcp:900:mount.lustre.0 Request processed in 120us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740520.774566:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 4 00000100:00100000:1.0:1790740520.775463:0:18675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001043712 00000100:00100000:1.0:1790740520.775473:0:18675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001043712 00000100:00100000:1.0:1790740520.775515:0:18675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001043840 00000100:00100000:1.0:1790740520.775519:0:18675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001043840 00000100:00100000:1.0:1790740520.775547:0:18675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 23 00000100:00100000:1.0:1790740520.775554:0:18675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ee8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2401:x1877727001043712:12345-192.168.204.3@tcp:8:mount.lustre.0 00010000:00080000:1.0:1790740520.775630:0:18675:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 4dca2668-e8ad-455d-9a0a-ed2d1013e863@192.168.204.3@tcp t0 exp 0000000000000000 cur 592 last 0 00000100:00100000:3.0:1790740520.775679:0:19778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 24 00000020:00000080:1.0:1790740520.775681:0:18675:0:(genops.c:1384:class_connect()) connect: client 4dca2668-e8ad-455d-9a0a-ed2d1013e863, cookie 0xb25dda4f4e92f192 00000100:00100000:3.0:1790740520.775685:0:19778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2401:x1877727001043840:12345-192.168.204.3@tcp:8:mount.lustre.0 00002000:00100000:1.0:1790740520.775698:0:18675:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4dca2668-e8ad-455d-9a0a-ed2d1013e863/ffff98dcbb764000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00010000:00080000:3.0:1790740520.775710:0:19778:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 4dca2668-e8ad-455d-9a0a-ed2d1013e863@192.168.204.3@tcp t0 exp 0000000000000000 cur 592 last 0 00002000:00100000:1.0:1790740520.775714:0:18675:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000020:00000080:3.0:1790740520.775733:0:19778:0:(genops.c:1384:class_connect()) connect: client 4dca2668-e8ad-455d-9a0a-ed2d1013e863, cookie 0xb25dda4f4e92f199 00002000:00100000:3.0:1790740520.775738:0:19778:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4dca2668-e8ad-455d-9a0a-ed2d1013e863/ffff98db82aae000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790740520.775745:0:19778:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790740520.775838:0:19778:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00002000:00080000:1.0:1790740520.775838:0:18675:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1790740520.775878:0:19778:0:(import.c:65:import_set_state_nolock()) ffff98db82aa9000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1790740520.779726:0:18675:0:(import.c:65:import_set_state_nolock()) ffff98dcbb766000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790740520.780373:0:18675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ee8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4dca2668-e8ad-455d-9a0a-ed2d1013e863+6:2401:x1877727001043712:12345-192.168.204.3@tcp:8:mount.lustre.0 Request processed in 4809us (6168us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740520.780391:0:18675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 23 00000100:00100000:3.0:1790740520.786903:0:19778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4dca2668-e8ad-455d-9a0a-ed2d1013e863+6:2401:x1877727001043840:12345-192.168.204.3@tcp:8:mount.lustre.0 Request processed in 11196us (12641us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740520.786924:0:19778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 24 00000100:00100000:2.0:1790740520.799482:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740520.800440:0:17169:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001044096 00000100:00100000:1.0:1790740520.800455:0:17169:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001044096 00000100:00100000:1.0:1790740520.800522:0:17169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 1 00000100:00100000:1.0:1790740520.800534:0:17169:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4dca2668-e8ad-455d-9a0a-ed2d1013e863+6:15023:x1877727001044096:12345-192.168.204.3@tcp:33:mount.lustre.0 00000004:00200000:1.0:1790740520.800678:0:17169:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1790740520.800788:0:17169:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4dca2668-e8ad-455d-9a0a-ed2d1013e863+6:15023:x1877727001044096:12345-192.168.204.3@tcp:33:mount.lustre.0 Request processed in 256us (1322us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740520.800797:0:17169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 1 00000100:00100000:0.0:1790740521.010241:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740521.019415:0:17165:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001044224 00000100:00100000:3.0:1790740521.019442:0:17165:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001044224 00000100:00100000:3.0:1790740521.020749:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 22 00000100:00100000:3.0:1790740521.020775:0:17165:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ee9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4dca2668-e8ad-455d-9a0a-ed2d1013e863+6:15056:x1877727001044224:12345-192.168.204.3@tcp:101:mkdir.0 00010000:00010000:3.0:1790740521.020806:0:17165:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740521.020842:0:17165:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92f1a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae24100 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740521.020942:0:17165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9a00/0xb25dda4f4e92f1a7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740521.020961:0:17165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9a00/0xb25dda4f4e92f1a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740521.020980:0:17165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9a00/0xb25dda4f4e92f1a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740521.021059:0:17165:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790740521.021089:0:17165:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790740521.021119:0:17165:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9a00/0xb25dda4f4e92f1a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740521.021154:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92f1a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24100 expref: 8 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740521.021665:0:17165:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9a00/0xb25dda4f4e92f1a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24100 expref: 7 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740521.021679:0:17165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98db82cc9400) 00010000:00010000:3.0:1790740521.021682:0:17165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790740521.021687:0:17165:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc9a00, rc 0) 00000100:00100000:3.0:1790740521.021813:0:17165:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ee9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4dca2668-e8ad-455d-9a0a-ed2d1013e863+7:15056:x1877727001044224:12345-192.168.204.3@tcp:101:mkdir.0 Request processed in 1048us (11746us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740521.021822:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 22 00010000:00010000:2.0:1790740521.131970:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740521.581255:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790740521.590991:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83eeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022099968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790740521.591122:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740521.595359:0:18677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022099968 00000100:00100000:3.0:1790740521.595383:0:18677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022099968 00000100:00100000:3.0:1790740521.595555:0:18677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790740521.595570:0:18677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022099968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790740521.595604:0:18677:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1790740521.595730:0:18677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022099968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 164us (4607us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740521.595738:0:18677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790740521.596560:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83eeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022099968:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790740521.607811:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790740522.155437:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740523.180143:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790740523.627716:0:18669:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4dca2668-e8ad-455d-9a0a-ed2d1013e863 00000001:00100000:0.0:1790740523.627738:0:18669:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8e31bfdb-0682-4acb-9750-d1df4d991489 00000001:00100000:2.0:1790740523.631140:0:17146:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4dca2668-e8ad-455d-9a0a-ed2d1013e863 00000001:00100000:2.0:1790740523.631160:0:17146:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8e31bfdb-0682-4acb-9750-d1df4d991489 00000001:00100000:0.0:1790740523.638405:0:17899:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 4dca2668-e8ad-455d-9a0a-ed2d1013e863 00000001:00100000:0.0:1790740523.638434:0:17899:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 8e31bfdb-0682-4acb-9750-d1df4d991489 00000100:00100000:1.0:1790740524.140469:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790740524.140500:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022100096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790740524.140611:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740524.140709:0:19777:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022100096 00000100:00100000:1.0:1790740524.140720:0:19777:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022100096 00000100:00100000:1.0:1790740524.140794:0:19777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790740524.140806:0:19777:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022100096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790740524.140848:0:19777:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1790740524.140904:0:19777:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022100096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740524.140931:0:19777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1790740524.140960:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790740524.140995:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1790740524.141023:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022100096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790740524.144240:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022100352:0@lo:400:kworker.0 00000100:00100000:1.0:1790740524.144343:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740524.144394:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022100864:0@lo:400:kworker.0 00000100:00100000:1.0:1790740524.144419:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740524.144433:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1877727022101376:0@lo:400:kworker.0 00000100:00100000:1.0:1790740524.144457:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740524.144486:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1790740524.144491:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84650700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022100480:0@lo:400:kworker.0 00000100:00100000:1.0:1790740524.144512:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740524.144530:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022100992:0@lo:400:kworker.0 00000100:00100000:1.0:1790740524.144551:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740524.144566:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1877727022101504:0@lo:400:kworker.0 00000100:00100000:1.0:1790740524.144599:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740524.144639:0:17907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022100352 00000100:00100000:1.0:1790740524.144649:0:17907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022100352 00000100:00100000:1.0:1790740524.144710:0:17907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790740524.144720:0:17907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022100352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740524.144791:0:17907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022100352:12345-0@lo:400:kworker.0 Request processed in 71us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740524.144800:0:17907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790740524.144854:0:19500:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022101376 00000100:00100000:1.0:1790740524.144858:0:19500:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022101376 00000100:00100000:1.0:1790740524.144901:0:19500:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022101504 00000100:00100000:1.0:1790740524.144904:0:19500:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022101504 00000100:00100000:1.0:1790740524.144933:0:19500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790740524.144939:0:19500:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877727022101376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740524.144975:0:19500:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877727022101376:12345-0@lo:400:kworker.0 Request processed in 37us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740524.144982:0:19500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790740524.144993:0:19500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790740524.144999:0:19500:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877727022101504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740524.145026:0:19500:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877727022101504:12345-0@lo:400:kworker.0 Request processed in 27us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740524.145071:0:19500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790740524.145092:0:18674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022100864 00000100:00100000:1.0:1790740524.145096:0:18674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022100864 00000100:00100000:1.0:1790740524.145129:0:18674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022100480 00000100:00100000:1.0:1790740524.145132:0:18674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022100480 00000100:00100000:1.0:1790740524.145145:0:18674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022100992 00000100:00100000:1.0:1790740524.145147:0:18674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022100992 00000100:00100000:1.0:1790740524.145163:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790740524.145170:0:18674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022100864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740524.145202:0:18674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022100864:12345-0@lo:400:kworker.0 Request processed in 33us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740524.145208:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790740524.145219:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790740524.145225:0:18674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022100480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740524.145251:0:18674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022100480:12345-0@lo:400:kworker.0 Request processed in 27us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740524.145264:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790740524.145276:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790740524.145282:0:18674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022100992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740524.145312:0:18674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022100992:12345-0@lo:400:kworker.0 Request processed in 30us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740524.145318:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1790740524.145359:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790740524.145364:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790740524.145367:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790740524.145369:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790740524.145408:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84650700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022100480:0@lo:400:kworker.0 00000100:00100000:1.0:1790740524.145421:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022100992:0@lo:400:kworker.0 00000100:00100000:1.0:1790740524.145431:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1877727022101504:0@lo:400:kworker.0 00000100:00100000:1.0:1790740524.145442:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022100352:0@lo:400:kworker.0 00000100:00100000:1.0:1790740524.145452:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022100864:0@lo:400:kworker.0 00010000:00080000:1.0:1790740524.145466:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83dc6d80 x1877727022101376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740540 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740524.145478:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1877727022101376:0@lo:400:kworker.0 00000100:00100000:1.0:1790740524.148939:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877727022100608:0@lo:400:kworker.0 00000100:00100000:1.0:1790740524.149063:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740524.149112:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877727022101120:0@lo:400:kworker.0 00000100:00100000:1.0:1790740524.149134:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740524.149174:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1877727022101632:0@lo:400:kworker.0 00000100:00100000:1.0:1790740524.149197:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740524.149226:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1790740524.149232:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3640:1877727022100224:0@lo:400:kworker.0 00000100:00100000:1.0:1790740524.149264:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740524.149295:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022100736:0@lo:400:kworker.0 00000100:00100000:1.0:1790740524.149320:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740524.149342:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1877727022101248:0@lo:400:kworker.0 00000100:00100000:1.0:1790740524.149363:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740524.149373:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db8468df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022101760:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790740524.149395:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740524.149429:0:18676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022101760 00000100:00100000:1.0:1790740524.149439:0:18676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022101760 00000100:00100000:1.0:1790740524.149492:0:18676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790740524.149502:0:18676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022101760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790740524.149530:0:18676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1790740524.149585:0:18676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022101760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740524.149606:0:18676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790740524.149638:0:17166:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022100608 00000100:00100000:1.0:1790740524.149642:0:17166:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022100608 00000100:00100000:1.0:1790740524.149664:0:17166:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022101120 00000100:00100000:1.0:1790740524.149667:0:17166:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022101120 00000100:00100000:1.0:1790740524.149676:0:17166:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022101632 00000100:00100000:1.0:1790740524.149679:0:17166:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022101632 00000100:00100000:1.0:1790740524.149703:0:17166:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022101248 00000100:00100000:1.0:1790740524.149705:0:17166:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022101248 00000100:00100000:1.0:1790740524.149723:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790740524.149738:0:17166:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877727022100608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740524.149776:0:17166:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877727022100608:12345-0@lo:400:kworker.0 Request processed in 39us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740524.149783:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790740524.149797:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790740524.149803:0:17166:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877727022101120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740524.149833:0:17166:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877727022101120:12345-0@lo:400:kworker.0 Request processed in 30us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740524.149839:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790740524.149849:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790740524.149855:0:17166:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877727022101632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740524.149882:0:17166:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877727022101632:12345-0@lo:400:kworker.0 Request processed in 28us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740524.149888:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790740524.149898:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790740524.149903:0:17166:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877727022101248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740524.149928:0:17166:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877727022101248:12345-0@lo:400:kworker.0 Request processed in 24us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740524.149934:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1790740524.149955:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790740524.149959:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790740524.149999:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1877727022101248:0@lo:400:kworker.0 00000100:00100000:1.0:1790740524.150019:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db8468df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022101760:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790740524.150064:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877727022100608:0@lo:400:kworker.0 00000100:00100000:1.0:1790740524.150088:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877727022101120:0@lo:400:kworker.0 00010000:00080000:1.0:1790740524.150103:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83dc7100 x1877727022101632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740540 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740524.150115:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1877727022101632:0@lo:400:kworker.0 00000100:00100000:0.0:1790740524.150314:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022100224 00000100:00100000:0.0:1790740524.150321:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022100224 00000100:00100000:0.0:1790740524.150367:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1790740524.150376:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb6d1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+24:3640:x1877727022100224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740524.150514:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb6d1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+24:3640:x1877727022100224:12345-0@lo:400:kworker.0 Request processed in 140us (1248us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740524.150522:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1790740524.150566:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3640:1877727022100224:0@lo:400:kworker.0 00000100:00100000:2.0:1790740524.162133:0:17170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022100736 00000100:00100000:2.0:1790740524.162230:0:17170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022100736 00000100:00100000:2.0:1790740524.162313:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790740524.162324:0:17170:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022100736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740524.162474:0:17170:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022100736:12345-0@lo:400:kworker.0 Request processed in 151us (13152us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740524.162482:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790740524.163091:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022100736:0@lo:400:kworker.0 00010000:00010000:3.0:1790740524.209549:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740524.651689:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790740524.651742:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022101888:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790740524.651858:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740524.653263:0:18677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022101888 00000100:00100000:2.0:1790740524.653280:0:18677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022101888 00000100:00100000:2.0:1790740524.653611:0:18677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790740524.653624:0:18677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022101888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790740524.653659:0:18677:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1790740524.653768:0:18677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022101888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 147us (1910us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740524.653775:0:18677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790740524.653911:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022101888:0@lo:13:osp-pre-0-1.0 00000001:02000400:2.0:1790740524.740181:0:20045:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1790740525.164260:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790740525.164288:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83eeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022102016:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790740525.164387:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740525.164498:0:17171:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022102016 00000100:00100000:0.0:1790740525.164511:0:17171:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022102016 00000100:00100000:0.0:1790740525.164576:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790740525.164586:0:17171:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022102016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790740525.164637:0:17171:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1790740525.164840:0:17171:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022102016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 254us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740525.164848:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790740525.164997:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83eeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022102016:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1790740525.234836:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740525.677608:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790740525.677634:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022102144:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790740525.677710:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740525.677860:0:17907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022102144 00000100:00100000:2.0:1790740525.677869:0:17907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022102144 00000100:00100000:2.0:1790740525.677929:0:17907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790740525.677939:0:17907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022102144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790740525.677975:0:17907:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790740525.678461:0:17907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022102144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 521us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740525.678488:0:17907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790740525.687395:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022102144:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790740525.988004:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740525.988115:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740525.988144:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740525.988175:0:18674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001044864 00000100:00100000:1.0:1790740525.988188:0:18674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001044864 00000100:00100000:1.0:1790740525.988269:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 11 00000100:00100000:1.0:1790740525.988281:0:18674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8e31bfdb-0682-4acb-9750-d1df4d991489+5:2402:x1877727001044864:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1790740525.988381:0:17160:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001044352 00000100:00100000:1.0:1790740525.988383:0:18674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8e31bfdb-0682-4acb-9750-d1df4d991489+5:2402:x1877727001044864:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 103us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740525.988400:0:17160:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001044352 00000100:00100000:1.0:1790740525.988421:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 11 00000100:00080000:1.0:1790740525.988459:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790740525.988482:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 148 00000100:00100000:2.0:1790740525.988497:0:17160:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb6d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b6742f8-8cda-45db-8c52-3634e9260d75+13:2402:x1877727001044352:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1790740525.988514:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740525.988545:0:17167:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001044608 00000100:00100000:1.0:1790740525.988550:0:17167:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001044608 00000100:00100000:1.0:1790740525.988601:0:17167:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001045120 00000100:00100000:2.0:1790740525.988605:0:17160:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb6d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b6742f8-8cda-45db-8c52-3634e9260d75+13:2402:x1877727001044352:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 110us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740525.988607:0:17167:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001045120 00000100:00100000:2.0:1790740525.988620:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 148 00000100:00100000:1.0:1790740525.988648:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 51 00000100:00100000:1.0:1790740525.988662:0:17167:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e31bfdb-0682-4acb-9750-d1df4d991489+5:2402:x1877727001044608:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1790740525.988709:0:17167:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e31bfdb-0682-4acb-9750-d1df4d991489+5:2402:x1877727001044608:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 52us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740525.988717:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 51 00000100:00100000:1.0:1790740525.988732:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 52 00000100:00100000:1.0:1790740525.988739:0:17167:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4dca2668-e8ad-455d-9a0a-ed2d1013e863+5:2402:x1877727001045120:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1790740525.988763:0:17167:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4dca2668-e8ad-455d-9a0a-ed2d1013e863+5:2402:x1877727001045120:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 25us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740525.988770:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 52 00000100:00080000:1.0:1790740525.988792:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790740525.988878:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740525.988935:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740525.988941:0:19778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001045376 00000100:00100000:2.0:1790740525.988949:0:19778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001045376 00000100:00100000:1.0:1790740525.988960:0:17167:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001044480 00000100:00100000:1.0:1790740525.988967:0:17167:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001044480 00000100:00100000:1.0:1790740525.989010:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 53 00000100:00100000:1.0:1790740525.989020:0:17167:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e31bfdb-0682-4acb-9750-d1df4d991489+6:2402:x1877727001044480:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1790740525.989028:0:19778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 12 00000100:00100000:2.0:1790740525.989071:0:19778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4dca2668-e8ad-455d-9a0a-ed2d1013e863+6:2402:x1877727001045376:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1790740525.989090:0:17167:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e31bfdb-0682-4acb-9750-d1df4d991489+6:2402:x1877727001044480:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 70us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740525.989108:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 53 00000100:00100000:2.0:1790740525.989124:0:19778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4dca2668-e8ad-455d-9a0a-ed2d1013e863+6:2402:x1877727001045376:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 51us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740525.989134:0:19778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 12 00000100:00080000:2.0:1790740525.989165:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790740525.989172:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790740525.989182:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740525.989232:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740525.989249:0:17167:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001044992 00000100:00100000:1.0:1790740525.989253:0:17167:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001044992 00000100:00100000:1.0:1790740525.989283:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 54 00000100:00100000:1.0:1790740525.989290:0:17167:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4dca2668-e8ad-455d-9a0a-ed2d1013e863+6:2402:x1877727001044992:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1790740525.989321:0:17167:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4dca2668-e8ad-455d-9a0a-ed2d1013e863+6:2402:x1877727001044992:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 32us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740525.989328:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 54 00000100:00100000:1.0:1790740525.989373:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740525.989387:0:18675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001044736 00000100:00100000:1.0:1790740525.989391:0:18675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001044736 00000100:00100000:1.0:1790740525.989413:0:18675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001045248 00000100:00100000:1.0:1790740525.989416:0:18675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001045248 00000100:00100000:1.0:1790740525.989431:0:18675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 13 00000100:00100000:1.0:1790740525.989438:0:18675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8e31bfdb-0682-4acb-9750-d1df4d991489+5:2402:x1877727001044736:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1790740525.989464:0:18675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8e31bfdb-0682-4acb-9750-d1df4d991489+5:2402:x1877727001044736:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 26us (287us total) trans 0 rc 0/0 00000100:00080000:2.0:1790740525.989470:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790740525.989476:0:18675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 13 00000100:00080000:2.0:1790740525.989479:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790740525.989503:0:18675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 14 00000100:00100000:1.0:1790740525.989512:0:18675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4dca2668-e8ad-455d-9a0a-ed2d1013e863+5:2402:x1877727001045248:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1790740525.993739:0:18675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4dca2668-e8ad-455d-9a0a-ed2d1013e863+5:2402:x1877727001045248:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 4217us (4355us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740525.993756:0:18675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 14 00010000:00010000:1.0:1790740526.252203:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790740526.449420:0:17922:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790740526.698254:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022102272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790740526.698326:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740526.698379:0:19777:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022102272 00000100:00100000:1.0:1790740526.698386:0:19777:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022102272 00000100:00100000:1.0:1790740526.698434:0:19777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790740526.698442:0:19777:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022102272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790740526.698481:0:19777:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1790740526.698522:0:19777:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022102272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740526.698528:0:19777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1790740526.698559:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790740526.698595:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022102272:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1790740526.706734:0:19487:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4dca2668-e8ad-455d-9a0a-ed2d1013e863 00010000:00010000:2.0:1790740527.276801:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740528.298378:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790740528.657885:0:20192:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffff7d6b850 20000000:00000080:1.0:1790740528.657902:0:20192:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98dc81325800 uarg=0000000000000000 20000000:01000000:1.0:1790740528.657945:0:20192:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1790740528.657952:0:20192:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1790740528.657957:0:20192:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1790740528.658919:0:20193:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1790740528.659290:0:20192:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1790740528.670647:0:20192:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1790740528.670820:0:20192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98dcaf061600/0xb25dda4f4e92f1ae lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740528.670842:0:20192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dcb5dc8e00/0xb25dda4f4e92ee43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92ee3c expref: 23 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740528.671105:0:20192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dcb5dc9800/0xb25dda4f4e92ee51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92ee4a expref: 23 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740528.671121:0:20192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98db83f32200/0xb25dda4f4e92ee90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92ee89 expref: 23 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740528.671127:0:20192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dcaf060400/0xb25dda4f4e92efee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92efe7 expref: 23 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740528.671137:0:20192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dcb5dc8200/0xb25dda4f4e92f13e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae2405f expref: 12 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740528.671144:0:20192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98dcbfc45400/0xb25dda4f4e92f17d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae240cf expref: 12 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740528.671151:0:20192:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98dcaf061600/0xb25dda4f4e92f1ae lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740528.671201:0:20192:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dcbfc45400/0xb25dda4f4e92f17d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae240cf expref: 12 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740528.671219:0:20192:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98dcbfc45400/0xb25dda4f4e92f17d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae240cf expref: 12 pid: 17160 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740528.671234:0:20192:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20192:1877727022102400:192.168.204.3@tcp:104: 00010000:00010000:2.0:1790740528.673022:0:20192:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dcb5dc8200/0xb25dda4f4e92f13e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae2405f expref: 12 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740528.673579:0:20192:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98dcb5dc8200/0xb25dda4f4e92f13e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae2405f expref: 12 pid: 17159 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740528.673596:0:20192:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83e1df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20192:1877727022102528:192.168.204.3@tcp:104: 00010000:00010000:2.0:1790740528.673686:0:20192:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dcaf060400/0xb25dda4f4e92efee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92efe7 expref: 23 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740528.673695:0:20192:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98dcaf060400/0xb25dda4f4e92efee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92efe7 expref: 23 pid: 17161 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740528.673705:0:20192:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db84533100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20192:1877727022102656:0@lo:104: 00000100:00100000:2.0:1790740528.673747:0:20192:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790740528.673786:0:20192:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98db83f32200/0xb25dda4f4e92ee90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92ee89 expref: 23 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740528.673794:0:20192:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98db83f32200/0xb25dda4f4e92ee90 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92ee89 expref: 23 pid: 17160 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740528.673801:0:20192:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefd9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20192:1877727022102784:0@lo:104: 00000100:00100000:2.0:1790740528.673820:0:20192:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740528.673999:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022102656 00000100:00100000:0.0:1790740528.674012:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022102656 00000100:00100000:0.0:1790740528.674180:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022102784 00000100:00100000:0.0:1790740528.674186:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022102784 00000100:00100000:0.0:1790740528.674209:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790740528.674216:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84532a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+4:20192:x1877727022102656:12345-0@lo:104: 00010000:00010000:0.0:1790740528.674228:0:17149:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff98db83f33800/0xb25dda4f4e92efe7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92efee expref: -99 pid: 19486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740528.674280:0:17149:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790740528.674285:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84532a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+4:20192:x1877727022102656:12345-0@lo:104: Request processed in 70us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740528.674292:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790740528.674309:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790740528.674315:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaefd9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+3:20192:x1877727022102784:12345-0@lo:104: 00010000:00010000:0.0:1790740528.674322:0:17149:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3000/0xb25dda4f4e92ee89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92ee90 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740528.674354:0:17149:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790740528.674358:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaefd9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+3:20192:x1877727022102784:12345-0@lo:104: Request processed in 45us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740528.674363:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1790740528.674380:0:17154:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790740528.674386:0:17154:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98db83f33800/0xb25dda4f4e92efe7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92efee expref: -99 pid: 19486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740528.674394:0:17154:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f33800 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:0.0:1790740528.674398:0:17154:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98db83f33800/0xb25dda4f4e92efe7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92efee expref: -99 pid: 19486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740528.674861:0:20192:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dcb5dc9800/0xb25dda4f4e92ee51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92ee4a expref: 23 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740528.674871:0:20192:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98dcb5dc9800/0xb25dda4f4e92ee51 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92ee4a expref: 23 pid: 17161 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740528.674881:0:20192:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefd8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20192:1877727022102912:0@lo:104: 00000100:00100000:2.0:1790740528.674910:0:20192:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790740528.674985:0:20192:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98dcb5dc8e00/0xb25dda4f4e92ee43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb25dda4f4e92ee3c expref: 23 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740528.674994:0:20192:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98dcb5dc8e00/0xb25dda4f4e92ee43 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb25dda4f4e92ee3c expref: 23 pid: 17159 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740528.675014:0:20192:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefd9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20192:1877727022103040:0@lo:104: 00000100:00100000:2.0:1790740528.675051:0:20192:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790740528.675097:0:17154:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98db83f33800/0xb25dda4f4e92efe7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92efee expref: -99 pid: 19486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790740528.675109:0:17154:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98db83f33800/0xb25dda4f4e92efe7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92efee expref: -99 pid: 19486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740528.675115:0:17154:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790740528.675149:0:17154:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98db83f33800/0xb25dda4f4e92efe7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92efee expref: -99 pid: 19486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740528.675156:0:17154:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790740528.675175:0:17154:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98db83f33800/0xb25dda4f4e92efe7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92efee expref: -99 pid: 19486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740528.675183:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98db83f33800/0xb25dda4f4e92efe7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92efee expref: -99 pid: 19486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740528.675199:0:17154:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790740528.675202:0:17154:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3000/0xb25dda4f4e92ee89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92ee90 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740528.675208:0:17154:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaeee3000 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:0.0:1790740528.675211:0:17154:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3000/0xb25dda4f4e92ee89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92ee90 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740528.675217:0:17154:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3000/0xb25dda4f4e92ee89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92ee90 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790740528.675223:0:17154:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3000/0xb25dda4f4e92ee89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92ee90 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740528.675235:0:17154:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790740528.675250:0:17154:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3000/0xb25dda4f4e92ee89 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92ee90 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740528.675261:0:17154:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790740528.675268:0:17154:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3000/0xb25dda4f4e92ee89 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92ee90 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740528.675274:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dcaeee3000/0xb25dda4f4e92ee89 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92ee90 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740528.675284:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740528.675286:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740528.675287:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740528.675294:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740528.675314:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ee9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3638:1877727022103168:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790740528.675344:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740528.675388:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790740528.675401:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ee8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3638:1877727022103296:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790740528.675430:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740528.675477:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022103168 00000100:00100000:0.0:1790740528.675483:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022103168 00010000:00010000:0.0:1790740528.675512:0:17151:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dcaf060400/0xb25dda4f4e92efee lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92efe7 expref: 24 pid: 17161 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740528.675532:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022103296 00000100:00100000:0.0:1790740528.675535:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022103296 00010000:00010000:0.0:1790740528.675547:0:17151:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98db83f32200/0xb25dda4f4e92ee90 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92ee89 expref: 25 pid: 17160 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740528.675577:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790740528.675583:0:17151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eeb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+25:3638:x1877727022103168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790740528.675594:0:17151:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740528.675600:0:17151:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dcaf060400/0xb25dda4f4e92efee lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92efe7 expref: 25 pid: 17161 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740528.675607:0:17151:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dcaf060400/0xb25dda4f4e92efee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92efe7 expref: 25 pid: 17161 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740528.675622:0:17151:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740528.675653:0:17151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eeb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+25:3638:x1877727022103168:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740528.675659:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790740528.675674:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790740528.675679:0:17151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+24:3638:x1877727022103296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790740528.675699:0:17151:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740528.675704:0:17151:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98db83f32200/0xb25dda4f4e92ee90 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92ee89 expref: 24 pid: 17160 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740528.675712:0:17151:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98db83f32200/0xb25dda4f4e92ee90 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92ee89 expref: 24 pid: 17160 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740528.675722:0:17151:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740528.675745:0:17151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+24:3638:x1877727022103296:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740528.675751:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790740528.675789:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ee8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3638:1877727022103296:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790740528.675808:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ee9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3638:1877727022103168:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790740528.681962:0:20192:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82e52240 going to sleep for 11 seconds 00010000:00010000:2.0:1790740528.682006:0:20192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcaf060400/0xb25dda4f4e92efee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92efe7 expref: 23 pid: 17161 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740528.682025:0:20192:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db84533100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20192:1877727022102656:0@lo:104: 00010000:00010000:2.0:1790740528.682204:0:20192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98db83f32200/0xb25dda4f4e92ee90 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92ee89 expref: 22 pid: 17160 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740528.682214:0:20192:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefd9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20192:1877727022102784:0@lo:104: 00000100:00100000:1.0:1790740528.682526:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022102912 00000100:00100000:1.0:1790740528.682535:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022102912 00000100:00100000:1.0:1790740528.682586:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022103040 00000100:00100000:1.0:1790740528.682589:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022103040 00000100:00100000:1.0:1790740528.682605:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790740528.682615:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaefd9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+4:20192:x1877727022102912:12345-0@lo:104: 00010000:00010000:1.0:1790740528.682651:0:17149:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8600/0xb25dda4f4e92ee4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92ee51 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740528.682734:0:17149:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790740528.682740:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaefd9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+4:20192:x1877727022102912:12345-0@lo:104: Request processed in 127us (7830us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740528.682747:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790740528.682767:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790740528.682773:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaefdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+3:20192:x1877727022103040:12345-0@lo:104: 00010000:00010000:1.0:1790740528.682781:0:17149:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff98db83f33000/0xb25dda4f4e92ee3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92ee43 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740528.682814:0:17149:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790740528.682818:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaefdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+3:20192:x1877727022103040:12345-0@lo:104: Request processed in 47us (7768us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740528.682824:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1790740528.682965:0:17155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790740528.682972:0:17155:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8600/0xb25dda4f4e92ee4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92ee51 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740528.682982:0:17155:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc8600 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:0.0:1790740528.682986:0:17155:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8600/0xb25dda4f4e92ee4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92ee51 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740528.682996:0:17155:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8600/0xb25dda4f4e92ee4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92ee51 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790740528.683003:0:17155:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8600/0xb25dda4f4e92ee4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92ee51 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740528.683010:0:17155:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790740528.683070:0:17155:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8600/0xb25dda4f4e92ee4a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92ee51 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740528.683087:0:17155:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790740528.683104:0:17155:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8600/0xb25dda4f4e92ee4a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92ee51 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740528.683111:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98dcb5dc8600/0xb25dda4f4e92ee4a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92ee51 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740528.683128:0:17155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790740528.683132:0:17155:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff98db83f33000/0xb25dda4f4e92ee3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb25dda4f4e92ee43 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740528.683148:0:17155:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f33000 already unused, calling callback (ffffffffc1355c20) 10000000:00010000:0.0:1790740528.683151:0:17155:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff98db83f33000/0xb25dda4f4e92ee3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb25dda4f4e92ee43 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740528.683158:0:17155:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff98db83f33000/0xb25dda4f4e92ee3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb25dda4f4e92ee43 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790740528.683164:0:17155:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff98db83f33000/0xb25dda4f4e92ee3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb25dda4f4e92ee43 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740528.683170:0:17155:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790740528.683184:0:17155:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff98db83f33000/0xb25dda4f4e92ee3c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92ee43 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740528.683189:0:17155:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790740528.683196:0:17155:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff98db83f33000/0xb25dda4f4e92ee3c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92ee43 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740528.683202:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff98db83f33000/0xb25dda4f4e92ee3c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb25dda4f4e92ee43 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740528.683217:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740528.683219:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740528.683221:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740528.683228:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740528.683252:0:20192:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefd8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20192:1877727022102912:0@lo:104: 00000100:00100000:0.0:1790740528.683262:0:20192:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefd9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20192:1877727022103040:0@lo:104: 00000100:00100000:1.0:1790740528.685552:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3640:1877727022103424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790740528.685638:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740528.685751:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790740528.685758:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3640:1877727022103552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790740528.685782:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740528.690243:0:20192:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20192:1877727022102400:192.168.204.3@tcp:104: 00000100:00100000:2.0:1790740528.690378:0:20192:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83e1df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20192:1877727022102528:192.168.204.3@tcp:104: 00010000:00010000:2.0:1790740528.690422:0:20192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98dcaf061600/0xb25dda4f4e92f1ae lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740528.692920:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022103424 00000100:00100000:0.0:1790740528.692952:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022103424 00010000:00010000:0.0:1790740528.692995:0:17151:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dcb5dc9800/0xb25dda4f4e92ee51 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92ee4a expref: 22 pid: 17161 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740528.693110:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022103552 00000100:00100000:0.0:1790740528.693114:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022103552 00010000:00010000:0.0:1790740528.693130:0:17151:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dcb5dc8e00/0xb25dda4f4e92ee43 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92ee3c expref: 23 pid: 17159 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740528.693301:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790740528.693314:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+23:3640:x1877727022103424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790740528.693330:0:17152:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740528.693337:0:17152:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dcb5dc9800/0xb25dda4f4e92ee51 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92ee4a expref: 23 pid: 17161 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740528.693363:0:17152:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dcb5dc9800/0xb25dda4f4e92ee51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92ee4a expref: 23 pid: 17161 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740528.693384:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcb5dc9800/0xb25dda4f4e92ee51 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92ee4a expref: 23 pid: 17161 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740528.693397:0:17152:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740528.693483:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+22:3640:x1877727022103424:12345-0@lo:103:ldlm_bl.0 Request processed in 172us (7844us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740528.693491:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790740528.693522:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790740528.693529:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+21:3640:x1877727022103552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790740528.693538:0:17152:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740528.693542:0:17152:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dcb5dc8e00/0xb25dda4f4e92ee43 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb25dda4f4e92ee3c expref: 21 pid: 17159 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740528.693550:0:17152:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dcb5dc8e00/0xb25dda4f4e92ee43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb25dda4f4e92ee3c expref: 21 pid: 17159 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740528.693560:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcb5dc8e00/0xb25dda4f4e92ee43 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb25dda4f4e92ee3c expref: 21 pid: 17159 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740528.693568:0:17152:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740528.693602:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+20:3640:x1877727022103552:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (7819us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740528.693608:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790740528.693673:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3640:1877727022103552:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790740528.693683:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3640:1877727022103424:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790740528.696431:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740528.696566:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001045504 00000100:00100000:0.0:1790740528.696576:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001045504 00010000:00010000:0.0:1790740528.696616:0:17151:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dcbfc45400/0xb25dda4f4e92f17d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae240cf expref: 13 pid: 17160 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740528.696662:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 13 00000100:00100000:0.0:1790740528.696672:0:17151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db829bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b6742f8-8cda-45db-8c52-3634e9260d75+13:2402:x1877727001045504:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790740528.696700:0:17151:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740528.696707:0:17151:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dcbfc45400/0xb25dda4f4e92f17d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae240cf expref: 13 pid: 17160 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740528.696721:0:17151:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dcbfc45400/0xb25dda4f4e92f17d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae240cf expref: 13 pid: 17160 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740528.696740:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcbfc45400/0xb25dda4f4e92f17d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae240cf expref: 13 pid: 17160 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740528.696756:0:17151:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740528.698317:0:17151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db829bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b6742f8-8cda-45db-8c52-3634e9260d75+12:2402:x1877727001045504:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 1638us (1967us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740528.698331:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 13 00000100:00100000:3.0:1790740528.714300:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740528.714573:0:17152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001045632 00000100:00100000:0.0:1790740528.714585:0:17152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001045632 00010000:00010000:0.0:1790740528.714627:0:17152:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98dcb5dc8200/0xb25dda4f4e92f13e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae2405f expref: 12 pid: 17159 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740528.714743:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 14 00000100:00100000:0.0:1790740528.714753:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b6742f8-8cda-45db-8c52-3634e9260d75+12:2402:x1877727001045632:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790740528.714769:0:17152:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740528.714775:0:17152:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98dcb5dc8200/0xb25dda4f4e92f13e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae2405f expref: 12 pid: 17159 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740528.714803:0:17152:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98dcb5dc8200/0xb25dda4f4e92f13e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae2405f expref: 12 pid: 17159 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740528.714821:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcb5dc8200/0xb25dda4f4e92f13e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae2405f expref: 12 pid: 17159 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740528.714837:0:17152:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98dcaf061600/0xb25dda4f4e92f1ae lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740528.714845:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcaf061600/0xb25dda4f4e92f1ae lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740528.714861:0:17152:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98dcaf061600/0xb25dda4f4e92f1ae lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740528.714868:0:17152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98dcaf061600/0xb25dda4f4e92f1ae lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740528.714875:0:17152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98dcaf061600/0xb25dda4f4e92f1ae lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740528.714900:0:17152:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98dcaf061600/0xb25dda4f4e92f1ae lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740528.714905:0:17152:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf061600 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:0.0:1790740528.714909:0:17152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98dcaf061600/0xb25dda4f4e92f1ae lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740528.714916:0:17152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98dcaf061600/0xb25dda4f4e92f1ae lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740528.714938:0:17152:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98dcaf061600/0xb25dda4f4e92f1ae lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740528.714949:0:17152:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740528.715018:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b6742f8-8cda-45db-8c52-3634e9260d75+11:2402:x1877727001045632:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 265us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740528.715026:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 14 00010000:00010000:2.0:1790740528.715140:0:20192:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98dcaf061600/0xb25dda4f4e92f1ae lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740528.715150:0:20192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98dcaf061600/0xb25dda4f4e92f1ae lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740528.715157:0:20192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98dcaf061600/0xb25dda4f4e92f1ae lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740529.263608:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022103680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790740529.263681:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740529.263866:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022103936:0@lo:400:kworker.0 00000100:00100000:0.0:1790740529.263897:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740529.263919:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022104448:0@lo:400:kworker.0 00000100:00100000:0.0:1790740529.263948:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740529.263966:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82333b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1877727022104960:0@lo:400:kworker.0 00000100:00100000:0.0:1790740529.263994:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740529.264015:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1790740529.264054:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022104064:0@lo:400:kworker.0 00000100:00100000:0.0:1790740529.264081:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740529.264102:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83eeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022104576:0@lo:400:kworker.0 00000100:00100000:0.0:1790740529.264123:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740529.264142:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1877727022105088:0@lo:400:kworker.0 00000100:00100000:0.0:1790740529.264162:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740529.264196:0:17170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022103936 00000100:00100000:0.0:1790740529.264204:0:17170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022103936 00000100:00100000:0.0:1790740529.264255:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790740529.264263:0:17170:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82332d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727022103936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740529.264324:0:17170:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82332d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727022103936:12345-0@lo:400:kworker.0 Request processed in 61us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740529.264332:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790740529.264356:0:18673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022104448 00000100:00100000:0.0:1790740529.264361:0:18673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022104448 00000100:00100000:0.0:1790740529.264524:0:18673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022104064 00000100:00100000:0.0:1790740529.264528:0:18673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022104064 00000100:00100000:0.0:1790740529.264545:0:18673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022104576 00000100:00100000:0.0:1790740529.264548:0:18673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022104576 00000100:00100000:0.0:1790740529.264563:0:18673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790740529.264570:0:18673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc98ac8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022104448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740529.264606:0:18673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc98ac8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022104448:12345-0@lo:400:kworker.0 Request processed in 37us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740529.264612:0:18673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790740529.264779:0:18673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790740529.264787:0:18673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82333480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727022104064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740529.264816:0:18673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82333480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727022104064:12345-0@lo:400:kworker.0 Request processed in 31us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740529.264831:0:18673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790740529.264843:0:18673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790740529.264850:0:18673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82331c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022104576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740529.264880:0:18673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82331c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022104576:12345-0@lo:400:kworker.0 Request processed in 31us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740529.264886:0:18673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790740529.264904:0:17167:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022104960 00000100:00100000:0.0:1790740529.264908:0:17167:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022104960 00000100:00100000:0.0:1790740529.264933:0:17167:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022105088 00000100:00100000:0.0:1790740529.264936:0:17167:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022105088 00000100:00100000:0.0:1790740529.264956:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790740529.264962:0:17167:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82332680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877727022104960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740529.264994:0:17167:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82332680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877727022104960:12345-0@lo:400:kworker.0 Request processed in 32us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740529.265001:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790740529.265012:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790740529.265017:0:17167:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877727022105088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740529.265071:0:17167:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877727022105088:12345-0@lo:400:kworker.0 Request processed in 54us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740529.265077:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1790740529.265108:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790740529.265112:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790740529.265114:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790740529.265116:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790740529.265138:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3639:1877727022103808:0@lo:400:kworker.0 00000100:00100000:0.0:1790740529.265173:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740529.265211:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022104320:0@lo:400:kworker.0 00000100:00100000:0.0:1790740529.265241:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740529.265260:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ee8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1877727022104832:0@lo:400:kworker.0 00000100:00100000:0.0:1790740529.265278:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740529.265295:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1790740529.265301:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877727022104192:0@lo:400:kworker.0 00000100:00100000:0.0:1790740529.265321:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740529.265336:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83ee9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877727022104704:0@lo:400:kworker.0 00000100:00100000:0.0:1790740529.265352:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740529.265364:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1877727022105216:0@lo:400:kworker.0 00000100:00100000:0.0:1790740529.265380:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740529.265405:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022103808 00000100:00100000:0.0:1790740529.265951:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022103808 00000100:00100000:0.0:1790740529.265995:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1790740529.266002:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb6d1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+20:3639:x1877727022103808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740529.266067:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb6d1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+20:3639:x1877727022103808:12345-0@lo:400:kworker.0 Request processed in 65us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740529.266073:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1790740529.266103:0:17907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022104320 00000100:00100000:0.0:1790740529.266107:0:17907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022104320 00000100:00100000:0.0:1790740529.266129:0:17907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790740529.266135:0:17907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022104320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740529.266167:0:17907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022104320:12345-0@lo:400:kworker.0 Request processed in 33us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740529.266174:0:17907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790740529.266193:0:17165:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022104832 00000100:00100000:0.0:1790740529.266203:0:17165:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022104832 00000100:00100000:0.0:1790740529.266292:0:17165:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022104192 00000100:00100000:0.0:1790740529.266296:0:17165:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022104192 00000100:00100000:0.0:1790740529.266307:0:17165:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022104704 00000100:00100000:0.0:1790740529.266309:0:17165:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022104704 00000100:00100000:0.0:1790740529.266317:0:17165:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022105216 00000100:00100000:0.0:1790740529.266319:0:17165:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022105216 00000100:00100000:0.0:1790740529.266335:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790740529.266341:0:17165:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1877727022104832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740529.266372:0:17165:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1877727022104832:12345-0@lo:400:kworker.0 Request processed in 32us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740529.266378:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790740529.266402:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790740529.266408:0:17165:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877727022104192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740529.266436:0:17165:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877727022104192:12345-0@lo:400:kworker.0 Request processed in 29us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740529.266441:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790740529.266452:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790740529.266457:0:17165:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877727022104704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740529.266483:0:17165:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877727022104704:12345-0@lo:400:kworker.0 Request processed in 26us (1129us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740529.266489:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790740529.266511:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790740529.266517:0:17165:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82332300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1877727022105216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740529.266544:0:17165:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82332300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1877727022105216:12345-0@lo:400:kworker.0 Request processed in 27us (1162us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740529.266549:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:0.0:1790740529.266579:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790740529.266582:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790740529.266624:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877727022104192:0@lo:400:kworker.0 00000100:00100000:0.0:1790740529.266635:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ee9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877727022104704:0@lo:400:kworker.0 00010000:00080000:0.0:1790740529.266647:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db82330a80 x1877727022105216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740529.266656:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1877727022105216:0@lo:400:kworker.0 00000100:00100000:0.0:1790740529.266665:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3639:1877727022103808:0@lo:400:kworker.0 00000100:00100000:0.0:1790740529.266673:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022104320:0@lo:400:kworker.0 00000100:00100000:0.0:1790740529.266683:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83ee8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1877727022104832:0@lo:400:kworker.0 00000100:00100000:0.0:1790740529.266728:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022104064:0@lo:400:kworker.0 00000100:00100000:0.0:1790740529.266738:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83eeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022104576:0@lo:400:kworker.0 00000100:00100000:0.0:1790740529.266749:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1877727022105088:0@lo:400:kworker.0 00000100:00100000:0.0:1790740529.266760:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022103936:0@lo:400:kworker.0 00000100:00100000:0.0:1790740529.266771:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022104448:0@lo:400:kworker.0 00010000:00080000:0.0:1790740529.266782:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db82333b80 x1877727022104960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740529.266791:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82333b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1877727022104960:0@lo:400:kworker.0 00000100:00100000:1.0:1790740529.266927:0:18677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022103680 00000100:00100000:1.0:1790740529.266932:0:18677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022103680 00000100:00100000:1.0:1790740529.266969:0:18677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790740529.266977:0:18677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022103680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790740529.267000:0:18677:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1790740529.267062:0:18677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022103680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (3382us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740529.267075:0:18677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1790740529.269585:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790740529.269666:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022103680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790740529.269983:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfc77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022105344:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790740529.270087:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740529.270205:0:18676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022105344 00000100:00100000:3.0:1790740529.270582:0:18676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022105344 00000100:00100000:3.0:1790740529.271176:0:18676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790740529.271189:0:18676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022105344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790740529.271226:0:18676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1790740529.271292:0:18676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022105344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 107us (1205us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740529.271299:0:18676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790740529.272359:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfc77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022105344:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1790740529.323280:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740529.780368:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790740529.780394:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022105472:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790740529.780466:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740529.780639:0:19777:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022105472 00000100:00100000:2.0:1790740529.780647:0:19777:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022105472 00000100:00100000:2.0:1790740529.780700:0:19777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790740529.780710:0:19777:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022105472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790740529.780753:0:19777:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1790740529.781688:0:19777:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022105472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 976us (1218us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740529.781697:0:19777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790740529.781748:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022105472:0@lo:13:osp-pre-0-1.0 10000000:01000000:2.0:1790740530.091124:0:17163:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790740530.091131:0:17163:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98dcb6c3a800 from 13 10000000:01000000:2.0:1790740530.091135:0:17163:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790740530.091180:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaf061600/0xb25dda4f4e92f1b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740530.091192:0:17163:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dcaf061600/0xb25dda4f4e92f1b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740530.091203:0:17163:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dcaf061600/0xb25dda4f4e92f1b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740530.091229:0:17163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefd8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022105600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790740530.091305:0:17163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740530.091397:0:17163:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82e52780 going to sleep for 11 seconds 00000100:00100000:1.0:1790740530.095157:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022105600 00000100:00100000:1.0:1790740530.095172:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022105600 00000100:00100000:1.0:1790740530.096300:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1790740530.096313:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb6d1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+20:17163:x1877727022105600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790740530.096332:0:17159:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740530.096354:0:17159:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcbfc45600/0xb25dda4f4e92f1bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92f1b5 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740530.096382:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcbfc45600/0xb25dda4f4e92f1bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92f1b5 expref: 21 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740530.096406:0:17159:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcbfc45600/0xb25dda4f4e92f1bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92f1b5 expref: 21 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740530.096416:0:17159:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcbfc45600, rc 0) 00000100:00100000:1.0:1790740530.096508:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb6d1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+21:17163:x1877727022105600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 197us (5203us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740530.096516:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1790740530.098580:0:17163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefd8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022105600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790740530.098608:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dcaf061600/0xb25dda4f4e92f1b5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92f1bc expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740530.098631:0:17163:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dcaf061600/0xb25dda4f4e92f1b5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92f1bc expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740530.098715:0:17163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefd8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022105728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790740530.098767:0:17163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740530.098806:0:17163:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82e52780 going to sleep for 11 seconds 00000100:00100000:2.0:1790740530.098824:0:17160:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022105728 00000100:00100000:2.0:1790740530.098829:0:17160:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022105728 00000100:00100000:2.0:1790740530.098865:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1790740530.098873:0:17160:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb6d1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+21:17163:x1877727022105728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790740530.099593:0:17160:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb6d1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+21:17163:x1877727022105728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 718us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740530.099602:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1790740530.099645:0:17163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefd8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022105728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790740530.099680:0:17163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefd8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022105856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790740530.099718:0:17163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740530.099741:0:17163:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82e52780 going to sleep for 11 seconds 00000100:00100000:2.0:1790740530.099753:0:17160:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022105856 00000100:00100000:2.0:1790740530.099757:0:17160:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022105856 00000100:00100000:2.0:1790740530.099776:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1790740530.099782:0:17160:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb6d1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+21:17163:x1877727022105856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790740530.099855:0:17160:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb6d1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+21:17163:x1877727022105856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740530.099862:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1790740530.100143:0:17163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefd8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022105856:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790740530.108501:0:20259:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1790740530.108644:0:17163:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1790740530.108666:0:17163:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790740530.108678:0:17163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaf061600/0xb25dda4f4e92f1b5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92f1bc expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740530.108690:0:17163:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dcaf061600/0xb25dda4f4e92f1b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92f1bc expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740530.108700:0:17163:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790740530.108702:0:17163:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98dc9892f000 from 13 10000000:01000000:2.0:1790740530.108705:0:17163:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790740530.108741:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaf061a00/0xb25dda4f4e92f1c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740530.108749:0:17163:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dcaf061a00/0xb25dda4f4e92f1c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740530.108761:0:17163:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dcaf061a00/0xb25dda4f4e92f1c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740530.108783:0:17163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefd8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022105984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790740530.108847:0:17163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740530.108880:0:17163:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82e52780 going to sleep for 11 seconds 00000100:00100000:2.0:1790740530.108897:0:17160:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022105984 00000100:00100000:2.0:1790740530.108915:0:17160:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022105984 00000100:00100000:2.0:1790740530.108957:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1790740530.108965:0:17160:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb6d1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+21:17163:x1877727022105984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790740530.108978:0:17160:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740530.109138:0:17160:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcaf060a00/0xb25dda4f4e92f1ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92f1c3 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740530.109161:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcaf060a00/0xb25dda4f4e92f1ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92f1c3 expref: 22 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740530.109172:0:17160:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcaf060a00/0xb25dda4f4e92f1ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92f1c3 expref: 22 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740530.109180:0:17160:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaf060a00, rc 0) 00000100:00100000:2.0:1790740530.109219:0:17160:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb6d1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0847d467-2c8f-428f-ab2a-50e9cfba84d8+22:17163:x1877727022105984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 254us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740530.109224:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1790740530.109264:0:17163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefd8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022105984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790740530.109277:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dcaf061a00/0xb25dda4f4e92f1c3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92f1ca expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740530.109286:0:17163:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dcaf061a00/0xb25dda4f4e92f1c3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92f1ca expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740530.109333:0:17163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefd8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022106112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790740530.109357:0:17163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740530.109372:0:17163:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82e52780 going to sleep for 11 seconds 00000100:00100000:2.0:1790740530.109384:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022106112 00000100:00100000:2.0:1790740530.109387:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022106112 00000100:00100000:2.0:1790740530.109407:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1790740530.109413:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb6d1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+22:17163:x1877727022106112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790740530.109522:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb6d1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+22:17163:x1877727022106112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740530.109536:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1790740530.109567:0:17163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefd8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022106112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790740530.109594:0:17163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefd8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022106240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790740530.109632:0:17163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740530.109644:0:17163:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82e52780 going to sleep for 11 seconds 00000100:00100000:2.0:1790740530.109654:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022106240 00000100:00100000:2.0:1790740530.109657:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022106240 00000100:00100000:2.0:1790740530.109673:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1790740530.109678:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb6d1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+22:17163:x1877727022106240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790740530.109739:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb6d1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+22:17163:x1877727022106240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 60us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740530.109745:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1790740530.109776:0:17163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefd8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022106240:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1790740530.110666:0:20260:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1790740530.110716:0:17163:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1790740530.110731:0:17163:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790740530.110739:0:17163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaf061a00/0xb25dda4f4e92f1c3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92f1ca expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740530.110749:0:17163:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dcaf061a00/0xb25dda4f4e92f1c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92f1ca expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740530.110758:0:17163:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790740530.110761:0:17163:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98dcae18b800 from 13 10000000:01000000:2.0:1790740530.110764:0:17163:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790740530.110786:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaf061c00/0xb25dda4f4e92f1d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740530.110802:0:17163:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dcaf061c00/0xb25dda4f4e92f1d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740530.110812:0:17163:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dcaf061c00/0xb25dda4f4e92f1d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740530.110828:0:17163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefd8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022106368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790740530.110866:0:17163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740530.110884:0:17163:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82e52b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790740530.110912:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022106368 00000100:00100000:2.0:1790740530.110917:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022106368 00000100:00100000:2.0:1790740530.110945:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1790740530.110952:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb6d1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+22:17163:x1877727022106368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790740530.110961:0:17161:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740530.110972:0:17161:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcaf061000/0xb25dda4f4e92f1d8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92f1d1 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740530.111261:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcaf061000/0xb25dda4f4e92f1d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92f1d1 expref: 23 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740530.111275:0:17161:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcaf061000/0xb25dda4f4e92f1d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92f1d1 expref: 23 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740530.111282:0:17161:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaf061000, rc 0) 00000100:00100000:2.0:1790740530.111317:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb6d1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+23:17163:x1877727022106368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 365us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740530.111324:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1790740530.111369:0:17163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefd8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022106368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790740530.111382:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dcaf061c00/0xb25dda4f4e92f1d1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92f1d8 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740530.111581:0:17163:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dcaf061c00/0xb25dda4f4e92f1d1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92f1d8 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740530.111627:0:17163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefd8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022106496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790740530.111654:0:17163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740530.111719:0:17163:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82e52b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790740530.112170:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022106496 00000100:00100000:1.0:1790740530.112176:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022106496 00000100:00100000:1.0:1790740530.112246:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1790740530.112254:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb6d1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+23:17163:x1877727022106496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790740530.112372:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb6d1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+23:17163:x1877727022106496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740530.112387:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1790740530.112492:0:17163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefd8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022106496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790740530.112526:0:17163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfc75c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022106624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790740530.112565:0:17163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740530.112667:0:17163:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcb5fed300 going to sleep for 11 seconds 00000100:00100000:1.0:1790740530.112722:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022106624 00000100:00100000:1.0:1790740530.112725:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022106624 00000100:00100000:1.0:1790740530.112740:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1790740530.112745:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb6d1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+23:17163:x1877727022106624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790740530.112816:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb6d1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+23:17163:x1877727022106624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740530.112824:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1790740530.113161:0:17163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfc75c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022106624:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790740530.114269:0:20261:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1790740530.114534:0:17163:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1790740530.114559:0:17163:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790740530.114570:0:17163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcaf061c00/0xb25dda4f4e92f1d1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92f1d8 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740530.114582:0:17163:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dcaf061c00/0xb25dda4f4e92f1d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92f1d8 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740530.114591:0:17163:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790740530.114594:0:17163:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98db84771800 from 13 10000000:01000000:1.0:1790740530.114597:0:17163:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790740530.114629:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcbfc44800/0xb25dda4f4e92f1df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740530.114637:0:17163:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff98dcbfc44800/0xb25dda4f4e92f1df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740530.114646:0:17163:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff98dcbfc44800/0xb25dda4f4e92f1df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740530.114665:0:17163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022106752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790740530.114731:0:17163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740530.114815:0:17163:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc84ca26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740530.114853:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022106752 00000100:00100000:2.0:1790740530.114861:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022106752 00000100:00100000:2.0:1790740530.115007:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1790740530.115018:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb6d1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+23:17163:x1877727022106752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790740530.115061:0:17159:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740530.115075:0:17159:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcaf060800/0xb25dda4f4e92f1e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb25dda4f4e92f1df expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740530.115100:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcaf060800/0xb25dda4f4e92f1e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb25dda4f4e92f1df expref: 24 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740530.115111:0:17159:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcaf060800/0xb25dda4f4e92f1e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb25dda4f4e92f1df expref: 24 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740530.115119:0:17159:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaf060800, rc 0) 00000100:00100000:2.0:1790740530.115161:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb6d1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0847d467-2c8f-428f-ab2a-50e9cfba84d8+24:17163:x1877727022106752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740530.115169:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1790740530.115265:0:17163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022106752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790740530.115280:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff98dcbfc44800/0xb25dda4f4e92f1df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92f1e6 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740530.115289:0:17163:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff98dcbfc44800/0xb25dda4f4e92f1df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb25dda4f4e92f1e6 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740530.115344:0:17163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022106880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790740530.115374:0:17163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740530.115606:0:17163:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc84ca26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790740530.115638:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022106880 00000100:00100000:3.0:1790740530.115643:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022106880 00000100:00100000:3.0:1790740530.115666:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1790740530.115673:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83b40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+24:17163:x1877727022106880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790740530.115827:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83b40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+24:17163:x1877727022106880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 154us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740530.115836:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1790740530.115983:0:17163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022106880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790740530.116206:0:17163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83dc6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022107008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790740530.116249:0:17163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740530.116307:0:17163:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc84ca26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790740530.116338:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022107008 00000100:00100000:3.0:1790740530.116342:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022107008 00000100:00100000:3.0:1790740530.116470:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1790740530.116489:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83b43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+24:17163:x1877727022107008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790740530.116585:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83b43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+24:17163:x1877727022107008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 108us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740530.116592:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1790740530.116658:0:17163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83dc6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0847d467-2c8f-428f-ab2a-50e9cfba84d8:17163:1877727022107008:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1790740530.117364:0:20262:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1790740530.117589:0:17163:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1790740530.117616:0:17163:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790740530.117625:0:17163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff98dcbfc44800/0xb25dda4f4e92f1df lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92f1e6 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740530.117635:0:17163:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff98dcbfc44800/0xb25dda4f4e92f1df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb25dda4f4e92f1e6 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740530.282231:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790740530.282253:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82333b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022107136:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790740530.282327:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740530.282422:0:17171:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022107136 00000100:00100000:0.0:1790740530.282430:0:17171:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022107136 00000100:00100000:0.0:1790740530.282493:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790740530.282502:0:17171:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022107136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790740530.282535:0:17171:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1790740530.282593:0:17171:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022107136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740530.282600:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790740530.282683:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82333b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022107136:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790740530.328490:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740530.328610:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001045760 00000100:00100000:0.0:1790740530.328621:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001045760 00000100:00100000:0.0:1790740530.328683:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 162 00000100:00100000:0.0:1790740530.328692:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83b42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b6742f8-8cda-45db-8c52-3634e9260d75+11:14905:x1877727001045760:12345-192.168.204.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790740530.328711:0:17159:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740530.328729:0:17159:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98db82343000/0xb25dda4f4e92f1ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae24107 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740530.328761:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98db82343000/0xb25dda4f4e92f1ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24107 expref: 12 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740530.328795:0:17159:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98db82343000/0xb25dda4f4e92f1ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24107 expref: 12 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740530.328804:0:17159:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db82343000, rc 0) 00000100:00100000:0.0:1790740530.328865:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83b42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b6742f8-8cda-45db-8c52-3634e9260d75+12:14905:x1877727001045760:12345-192.168.204.3@tcp:101:ll_cfg_requeue.0 Request processed in 173us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740530.328872:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 162 00000100:00100000:3.0:1790740530.331342:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740530.331424:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001045888 00000100:00100000:0.0:1790740530.331434:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001045888 00000100:00100000:0.0:1790740530.331495:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 163 00000100:00100000:0.0:1790740530.331505:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83b43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b6742f8-8cda-45db-8c52-3634e9260d75+12:14905:x1877727001045888:12345-192.168.204.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790740530.331662:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83b43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b6742f8-8cda-45db-8c52-3634e9260d75+12:14905:x1877727001045888:12345-192.168.204.3@tcp:501:ll_cfg_requeue.0 Request processed in 158us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740530.331670:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 163 00000100:00100000:3.0:1790740530.341222:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740530.342301:0:17160:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001046016 00000100:00100000:1.0:1790740530.342312:0:17160:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001046016 00000100:00100000:1.0:1790740530.342376:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 164 00000100:00100000:1.0:1790740530.342396:0:17160:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83b40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b6742f8-8cda-45db-8c52-3634e9260d75+12:14905:x1877727001046016:12345-192.168.204.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790740530.342597:0:17160:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83b40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b6742f8-8cda-45db-8c52-3634e9260d75+12:14905:x1877727001046016:12345-192.168.204.3@tcp:503:ll_cfg_requeue.0 Request processed in 202us (1385us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740530.342612:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 164 00010000:00010000:3.0:1790740530.349980:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740530.354246:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740530.354857:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001046144 00000100:00100000:1.0:1790740530.354868:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001046144 00000100:00100000:1.0:1790740530.354942:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 165 00000100:00100000:1.0:1790740530.354953:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83b42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b6742f8-8cda-45db-8c52-3634e9260d75+12:14905:x1877727001046144:12345-192.168.204.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790740530.354973:0:17159:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740530.354996:0:17159:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98dcbfc44600/0xb25dda4f4e92f1f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae2410e expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740530.355025:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98dcbfc44600/0xb25dda4f4e92f1f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae2410e expref: 13 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740530.355062:0:17159:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98dcbfc44600/0xb25dda4f4e92f1f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae2410e expref: 13 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740530.355070:0:17159:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcbfc44600, rc 0) 00000100:00100000:1.0:1790740530.355129:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83b42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b6742f8-8cda-45db-8c52-3634e9260d75+13:14905:x1877727001046144:12345-192.168.204.3@tcp:101:ll_cfg_requeue.0 Request processed in 178us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740530.355137:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 165 00000100:00100000:0.0:1790740530.367401:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740530.367438:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001046272 00000100:00100000:0.0:1790740530.367446:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001046272 00000100:00100000:0.0:1790740530.367507:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 166 00000100:00100000:0.0:1790740530.367517:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83b41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b6742f8-8cda-45db-8c52-3634e9260d75+13:14905:x1877727001046272:12345-192.168.204.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790740530.368116:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83b41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b6742f8-8cda-45db-8c52-3634e9260d75+13:14905:x1877727001046272:12345-192.168.204.3@tcp:501:ll_cfg_requeue.0 Request processed in 598us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740530.368125:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 166 00000100:00100000:1.0:1790740530.372371:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740530.372418:0:17160:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001046400 00000100:00100000:1.0:1790740530.372428:0:17160:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001046400 00000100:00100000:1.0:1790740530.372489:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 167 00000100:00100000:1.0:1790740530.372500:0:17160:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83b43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b6742f8-8cda-45db-8c52-3634e9260d75+13:14905:x1877727001046400:12345-192.168.204.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790740530.372635:0:17160:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83b43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b6742f8-8cda-45db-8c52-3634e9260d75+13:14905:x1877727001046400:12345-192.168.204.3@tcp:503:ll_cfg_requeue.0 Request processed in 136us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740530.372652:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 167 00000040:00080000:1.0:1790740530.747359:0:17201:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790740530.794287:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790740530.794312:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022107264:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790740530.794396:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740530.812547:0:17170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022107264 00000100:00100000:2.0:1790740530.812564:0:17170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022107264 00000100:00100000:2.0:1790740530.812629:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790740530.812639:0:17170:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022107264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790740530.812674:0:17170:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790740530.812767:0:17170:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022107264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 129us (18371us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740530.812773:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790740530.814126:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022107264:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790740531.101126:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740531.101171:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740531.101305:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740531.101331:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740531.101350:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740531.101369:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740531.101386:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740531.101403:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740531.101427:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740531.101480:0:19500:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001046784 00000100:00100000:1.0:1790740531.101488:0:19500:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001046784 00000100:00100000:1.0:1790740531.101540:0:19500:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001047296 00000100:00100000:1.0:1790740531.101543:0:19500:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001047296 00000100:00100000:1.0:1790740531.101557:0:19500:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001046656 00000100:00100000:1.0:1790740531.101559:0:19500:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001046656 00000100:00100000:1.0:1790740531.101570:0:19500:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001047168 00000100:00100000:1.0:1790740531.101572:0:19500:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001047168 00000100:00100000:1.0:1790740531.101588:0:19500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 61 00000100:00100000:1.0:1790740531.101597:0:19500:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e31bfdb-0682-4acb-9750-d1df4d991489+5:2403:x1877727001046784:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1790740531.103706:0:18674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001047040 00000100:00100000:0.0:1790740531.103720:0:18674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001047040 00000100:00100000:0.0:1790740531.103765:0:18674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001047552 00000100:00100000:0.0:1790740531.103779:0:18674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001047552 00000100:00100000:0.0:1790740531.103817:0:18674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001046912 00000100:00100000:0.0:1790740531.103820:0:18674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001046912 00000100:00100000:1.0:1790740531.105184:0:19500:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e31bfdb-0682-4acb-9750-d1df4d991489+5:2403:x1877727001046784:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 3580us (4004us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740531.105197:0:19500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 61 00000100:00100000:1.0:1790740531.105237:0:19500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 62 00000100:00100000:1.0:1790740531.105246:0:19500:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4dca2668-e8ad-455d-9a0a-ed2d1013e863+5:2403:x1877727001047296:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1790740531.105273:0:19500:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4dca2668-e8ad-455d-9a0a-ed2d1013e863+5:2403:x1877727001047296:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 30us (3942us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740531.105278:0:19500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 62 00000100:00100000:1.0:1790740531.105289:0:19500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 63 00000100:00100000:1.0:1790740531.105295:0:19500:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84652300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e31bfdb-0682-4acb-9750-d1df4d991489+6:2403:x1877727001046656:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1790740531.105319:0:19500:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84652300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e31bfdb-0682-4acb-9750-d1df4d991489+6:2403:x1877727001046656:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 24us (3949us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740531.105324:0:19500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 63 00000100:00100000:1.0:1790740531.105334:0:19500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 64 00000100:00100000:1.0:1790740531.105340:0:19500:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84650700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4dca2668-e8ad-455d-9a0a-ed2d1013e863+6:2403:x1877727001047168:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1790740531.105362:0:19500:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84650700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4dca2668-e8ad-455d-9a0a-ed2d1013e863+6:2403:x1877727001047168:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 23us (3958us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740531.105369:0:19500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 64 00000100:00100000:1.0:1790740531.105407:0:19778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001047424 00000100:00100000:1.0:1790740531.105414:0:19778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001047424 00000100:00100000:1.0:1790740531.105438:0:19778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 18 00000100:00100000:1.0:1790740531.105444:0:19778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8e31bfdb-0682-4acb-9750-d1df4d991489+5:2403:x1877727001047040:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1790740531.105482:0:19778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8e31bfdb-0682-4acb-9750-d1df4d991489+5:2403:x1877727001047040:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 37us (4176us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740531.105488:0:19778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 18 00000100:00100000:1.0:1790740531.105502:0:19778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 19 00000100:00100000:1.0:1790740531.105509:0:19778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4dca2668-e8ad-455d-9a0a-ed2d1013e863+5:2403:x1877727001047552:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1790740531.105542:0:19778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4dca2668-e8ad-455d-9a0a-ed2d1013e863+5:2403:x1877727001047552:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 34us (4190us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740531.105549:0:19778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 19 00000100:00100000:1.0:1790740531.105561:0:19778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 20 00000100:00100000:1.0:1790740531.105568:0:19778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4dca2668-e8ad-455d-9a0a-ed2d1013e863+5:2403:x1877727001047424:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1790740531.105592:0:19778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4dca2668-e8ad-455d-9a0a-ed2d1013e863+5:2403:x1877727001047424:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 25us (4164us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740531.105598:0:19778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 20 00000100:00080000:3.0:1790740531.105908:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790740531.105914:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790740531.105917:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790740531.105919:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790740531.105973:0:17159:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001046528 00000100:00100000:2.0:1790740531.105978:0:17159:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001046528 00000100:00100000:0.0:1790740531.108225:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 21 00000100:00100000:0.0:1790740531.108247:0:18674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84652d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8e31bfdb-0682-4acb-9750-d1df4d991489+5:2403:x1877727001046912:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1790740531.108325:0:18674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84652d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8e31bfdb-0682-4acb-9750-d1df4d991489+5:2403:x1877727001046912:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 88us (6938us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740531.108332:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 21 00000100:00100000:2.0:1790740531.108430:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 168 00000100:00100000:2.0:1790740531.108441:0:17159:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83b41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b6742f8-8cda-45db-8c52-3634e9260d75+13:2403:x1877727001046528:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1790740531.108480:0:17159:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83b41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b6742f8-8cda-45db-8c52-3634e9260d75+13:2403:x1877727001046528:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 43us (7364us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740531.108487:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 168 00010000:00010000:2.0:1790740531.373568:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740531.818352:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83cc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022107392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790740531.818426:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740531.818548:0:18676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022107392 00000100:00100000:1.0:1790740531.818556:0:18676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022107392 00000100:00100000:1.0:1790740531.818625:0:18676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790740531.818637:0:18676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022107392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790740531.818676:0:18676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1790740531.818733:0:18676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022107392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740531.818740:0:18676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790740531.818798:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83cc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022107392:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790740531.819055:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790740532.397684:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740532.632839:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740532.633136:0:19500:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001047680 00000100:00100000:0.0:1790740532.633146:0:19500:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001047680 00000100:00100000:0.0:1790740532.633211:0:19500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 23 00000100:00100000:0.0:1790740532.633221:0:19500:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e31bfdb-0682-4acb-9750-d1df4d991489+6:15572:x1877727001047680:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790740532.633241:0:19500:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740532.633263:0:19500:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342a00/0xb25dda4f4e92f1fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae24115 expref: -99 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740532.633334:0:19500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db82343600/0xb25dda4f4e92f202 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740532.633348:0:19500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db82343600/0xb25dda4f4e92f202 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740532.633359:0:19500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db82343600/0xb25dda4f4e92f202 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740532.633376:0:19500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db82343800/0xb25dda4f4e92f209 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740532.633383:0:19500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db82343800/0xb25dda4f4e92f209 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740532.633408:0:19500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db82343800/0xb25dda4f4e92f209 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740532.633514:0:19500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db82343c00/0xb25dda4f4e92f210 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740532.633523:0:19500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db82343c00/0xb25dda4f4e92f210 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740532.633530:0:19500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db82343c00/0xb25dda4f4e92f210 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790740532.633562:0:19500:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790740532.633566:0:19500:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790740532.633605:0:19500:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98db82343c00/0xb25dda4f4e92f210 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740532.633616:0:19500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db82343600/0xb25dda4f4e92f202 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740532.633622:0:19500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db82343600/0xb25dda4f4e92f202 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740532.633628:0:19500:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98db82343600/0xb25dda4f4e92f202 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740532.633635:0:19500:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db82343600 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:0.0:1790740532.633640:0:19500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db82343600/0xb25dda4f4e92f202 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740532.633648:0:19500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db82343600/0xb25dda4f4e92f202 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740532.633670:0:19500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98db82cc9400) 00010000:00010000:0.0:1790740532.633673:0:19500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740532.633678:0:19500:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98db82343600/0xb25dda4f4e92f202 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740532.633686:0:19500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db82343600/0xb25dda4f4e92f202 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740532.633715:0:19500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db82343800/0xb25dda4f4e92f209 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740532.633722:0:19500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db82343800/0xb25dda4f4e92f209 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740532.633727:0:19500:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98db82343800/0xb25dda4f4e92f209 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740532.633732:0:19500:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db82343800 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:0.0:1790740532.633735:0:19500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db82343800/0xb25dda4f4e92f209 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740532.633741:0:19500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db82343800/0xb25dda4f4e92f209 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740532.633749:0:19500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff98db82eca700) 00010000:00010000:0.0:1790740532.633751:0:19500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740532.633754:0:19500:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98db82343800/0xb25dda4f4e92f209 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740532.633760:0:19500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db82343800/0xb25dda4f4e92f209 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740532.633803:0:19500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342a00/0xb25dda4f4e92f1fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24115 expref: 8 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740532.633817:0:19500:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98db82343c00/0xb25dda4f4e92f210 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24115 expref: 7 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740532.633824:0:19500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98db82ecab00) 00010000:00010000:0.0:1790740532.633826:0:19500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790740532.633828:0:19500:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db82343c00, rc 0) 00000100:00100000:0.0:1790740532.634817:0:19500:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e31bfdb-0682-4acb-9750-d1df4d991489+7:15572:x1877727001047680:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 672us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740532.634828:0:19500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 23 00000100:00100000:2.0:1790740532.648341:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740532.648543:0:17177:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001047808 00000100:00100000:0.0:1790740532.648554:0:17177:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001047808 00000100:00100000:0.0:1790740532.648610:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 5 00000100:00100000:0.0:1790740532.648621:0:17177:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaefdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8e31bfdb-0682-4acb-9750-d1df4d991489+7:15572:x1877727001047808:12345-192.168.204.3@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1790740532.648718:0:17177:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaefdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8e31bfdb-0682-4acb-9750-d1df4d991489+7:15572:x1877727001047808:12345-192.168.204.3@tcp:900:lhsmtool_posix.0 Request processed in 99us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740532.648728:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 5 00000100:00100000:1.0:1790740532.664141:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740532.664315:0:17167:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001048064 00000100:00100000:2.0:1790740532.664326:0:17167:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001048064 00000100:00100000:2.0:1790740532.664393:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 24 00000100:00100000:2.0:1790740532.664403:0:17167:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e31bfdb-0682-4acb-9750-d1df4d991489+7:15572:x1877727001048064:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790740532.664439:0:17167:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740532.664466:0:17167:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061e00/0xb25dda4f4e92f217 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae2411c expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.664565:0:17167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060600/0xb25dda4f4e92f21e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.664580:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060600/0xb25dda4f4e92f21e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.664593:0:17167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060600/0xb25dda4f4e92f21e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.664660:0:17167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061400/0xb25dda4f4e92f225 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.664668:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061400/0xb25dda4f4e92f225 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.664675:0:17167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061400/0xb25dda4f4e92f225 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.664989:0:17167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061200/0xb25dda4f4e92f22c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.664999:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061200/0xb25dda4f4e92f22c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.665006:0:17167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061200/0xb25dda4f4e92f22c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740532.665016:0:17167:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1790740532.665204:0:17167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060600/0xb25dda4f4e92f21e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.665220:0:17167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060600/0xb25dda4f4e92f21e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.665227:0:17167:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060600/0xb25dda4f4e92f21e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.665233:0:17167:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf060600 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740532.665238:0:17167:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060600/0xb25dda4f4e92f21e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.665245:0:17167:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060600/0xb25dda4f4e92f21e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.665256:0:17167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98db82ecab00) 00010000:00010000:2.0:1790740532.665259:0:17167:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740532.665262:0:17167:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060600/0xb25dda4f4e92f21e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.665268:0:17167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060600/0xb25dda4f4e92f21e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.665281:0:17167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061400/0xb25dda4f4e92f225 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.665287:0:17167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061400/0xb25dda4f4e92f225 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.665292:0:17167:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061400/0xb25dda4f4e92f225 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.665297:0:17167:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf061400 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740532.665304:0:17167:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061400/0xb25dda4f4e92f225 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.665310:0:17167:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061400/0xb25dda4f4e92f225 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.665317:0:17167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff98dcaf045500) 00010000:00010000:2.0:1790740532.665320:0:17167:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740532.665322:0:17167:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061400/0xb25dda4f4e92f225 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.665328:0:17167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061400/0xb25dda4f4e92f225 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.668670:0:17167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061e00/0xb25dda4f4e92f217 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae2411c expref: 10 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.668710:0:17167:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061200/0xb25dda4f4e92f22c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae2411c expref: 9 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.668719:0:17167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98dcaf045000) 00010000:00010000:2.0:1790740532.668723:0:17167:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740532.668726:0:17167:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaf061200, rc 0) 00000100:00100000:2.0:1790740532.668815:0:17167:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e31bfdb-0682-4acb-9750-d1df4d991489+9:15572:x1877727001048064:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 4412us (4682us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1790740532.668824:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 24 00000100:00100000:1.0:1790740532.683364:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740532.683470:0:17165:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001048192 00000100:00100000:3.0:1790740532.683480:0:17165:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001048192 00000100:00100000:3.0:1790740532.683545:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 25 00000100:00100000:3.0:1790740532.683573:0:17165:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e31bfdb-0682-4acb-9750-d1df4d991489+9:15572:x1877727001048192:12345-192.168.204.3@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1790740532.683690:0:17165:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e31bfdb-0682-4acb-9750-d1df4d991489+9:15572:x1877727001048192:12345-192.168.204.3@tcp:59:lhsmtool_posix.0 Request processed in 120us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740532.683922:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 25 00000100:00100000:3.0:1790740532.687415:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740532.687992:0:17166:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001048320 00000100:00100000:1.0:1790740532.688002:0:17166:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001048320 00000100:00100000:0.0:1790740532.691218:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 26 00000100:00100000:0.0:1790740532.691249:0:17166:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e31bfdb-0682-4acb-9750-d1df4d991489+5:15572:x1877727001048320:12345-192.168.204.3@tcp:59:lhsmtool_posix.0 00000004:00080000:2.0:1790740532.697435:0:17166:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 6118us 00000100:00100000:1.0:1790740532.718777:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740532.719391:0:19500:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001048448 00000100:00100000:2.0:1790740532.719402:0:19500:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001048448 00000100:00100000:2.0:1790740532.719489:0:19500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 27 00000100:00100000:2.0:1790740532.719499:0:19500:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e31bfdb-0682-4acb-9750-d1df4d991489+9:15578:x1877727001048448:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:2.0:1790740532.719520:0:19500:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740532.719542:0:19500:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061e00/0xb25dda4f4e92f23a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae24123 expref: -99 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.719613:0:19500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061400/0xb25dda4f4e92f241 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.719627:0:19500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061400/0xb25dda4f4e92f241 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.719642:0:19500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061400/0xb25dda4f4e92f241 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.719658:0:19500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060600/0xb25dda4f4e92f248 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.719666:0:19500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060600/0xb25dda4f4e92f248 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.719674:0:19500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060600/0xb25dda4f4e92f248 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.719730:0:19500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061400/0xb25dda4f4e92f241 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.719738:0:19500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061400/0xb25dda4f4e92f241 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.719745:0:19500:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061400/0xb25dda4f4e92f241 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.719763:0:19500:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf061400 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740532.719768:0:19500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061400/0xb25dda4f4e92f241 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.719777:0:19500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061400/0xb25dda4f4e92f241 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.719791:0:19500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98db82cc9400) 00010000:00010000:2.0:1790740532.719795:0:19500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740532.719801:0:19500:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061400/0xb25dda4f4e92f241 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.719808:0:19500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061400/0xb25dda4f4e92f241 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.719821:0:19500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060600/0xb25dda4f4e92f248 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.719827:0:19500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060600/0xb25dda4f4e92f248 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.719833:0:19500:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060600/0xb25dda4f4e92f248 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.719839:0:19500:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf060600 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740532.719842:0:19500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060600/0xb25dda4f4e92f248 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.719848:0:19500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060600/0xb25dda4f4e92f248 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.719869:0:19500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98dcaf045500) 00010000:00010000:2.0:1790740532.719872:0:19500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740532.719876:0:19500:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060600/0xb25dda4f4e92f248 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.719883:0:19500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060600/0xb25dda4f4e92f248 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.719918:0:19500:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061e00/0xb25dda4f4e92f23a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24123 expref: 10 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.719929:0:19500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98db82cc9400) 00010000:00010000:2.0:1790740532.719931:0:19500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740532.719936:0:19500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061e00/0xb25dda4f4e92f23a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24123 expref: 10 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.719946:0:19500:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaf061e00, rc 0) 00000100:00100000:2.0:1790740532.720070:0:19500:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e31bfdb-0682-4acb-9750-d1df4d991489+9:15578:x1877727001048448:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 535us (1263us total) trans 0 rc 301/301 00000100:00100000:2.0:1790740532.720079:0:19500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 27 00000100:00100000:0.0:1790740532.728901:0:17166:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e31bfdb-0682-4acb-9750-d1df4d991489+5:15572:x1877727001048320:12345-192.168.204.3@tcp:59:lhsmtool_posix.0 Request processed in 37657us (41484us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740532.728916:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 26 00000100:00100000:1.0:1790740532.750593:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740532.750729:0:17174:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001048576 00000100:00100000:2.0:1790740532.750741:0:17174:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001048576 00000100:00100000:2.0:1790740532.750798:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 0 00000100:00100000:2.0:1790740532.750809:0:17174:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8e31bfdb-0682-4acb-9750-d1df4d991489+9:15578:x1877727001048576:12345-192.168.204.3@tcp:700:lfs.0 00000100:00100000:2.0:1790740532.750901:0:17174:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8e31bfdb-0682-4acb-9750-d1df4d991489+9:15578:x1877727001048576:12345-192.168.204.3@tcp:700:lfs.0 Request processed in 93us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740532.750909:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 0 00000100:00100000:1.0:1790740532.760572:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740532.760654:0:17167:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001048832 00000100:00100000:2.0:1790740532.760664:0:17167:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001048832 00000100:00100000:2.0:1790740532.760736:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 28 00000100:00100000:2.0:1790740532.760746:0:17167:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e31bfdb-0682-4acb-9750-d1df4d991489+9:15578:x1877727001048832:12345-192.168.204.3@tcp:36:lfs.0 00010000:00010000:2.0:1790740532.760800:0:17167:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740532.760826:0:17167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342400/0xb25dda4f4e92f168 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24090 expref: 9 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.760846:0:17167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98db82cc9400) 00010000:00010000:2.0:1790740532.760851:0:17167:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790740532.760908:0:17167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061e00/0xb25dda4f4e92f24f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.760926:0:17167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9a00/0xb25dda4f4e92f1a7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24100 expref: 5 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.760934:0:17167:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061e00/0xb25dda4f4e92f24f lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.760990:0:17167:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9a00/0xb25dda4f4e92f1a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24100 expref: 5 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.761004:0:17167:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9a00/0xb25dda4f4e92f1a7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24100 expref: 5 pid: 17165 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740532.761028:0:17167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefd8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17167:1877727022107520:192.168.204.3@tcp:104: 00000100:00100000:2.0:1790740532.761152:0:17167:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc83e4f780 going to sleep for 11 seconds 00000100:00100000:0.0:1790740532.764363:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740532.764535:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001048960 00000100:00100000:3.0:1790740532.764544:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001048960 00010000:00010000:3.0:1790740532.764584:0:17151:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9a00/0xb25dda4f4e92f1a7 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24100 expref: 6 pid: 17165 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740532.764617:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 15 00000100:00100000:3.0:1790740532.764625:0:17151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82330380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4dca2668-e8ad-455d-9a0a-ed2d1013e863+6:2403:x1877727001048960:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790740532.764638:0:17151:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740532.764644:0:17151:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9a00/0xb25dda4f4e92f1a7 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24100 expref: 6 pid: 17165 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740532.764655:0:17151:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9a00/0xb25dda4f4e92f1a7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24100 expref: 6 pid: 17165 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740532.764675:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98db82cc9400) 00010000:00010000:3.0:1790740532.764680:0:17151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061e00/0xb25dda4f4e92f24f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740532.764689:0:17151:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061e00/0xb25dda4f4e92f24f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740532.764709:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061e00/0xb25dda4f4e92f24f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740532.764755:0:17151:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740532.764814:0:17151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82330380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4dca2668-e8ad-455d-9a0a-ed2d1013e863+6:2403:x1877727001048960:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 189us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740532.764822:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 15 00010000:00010000:2.0:1790740532.770495:0:17167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9a00/0xb25dda4f4e92f1a7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24100 expref: 5 pid: 17165 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740532.770540:0:17167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefd8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17167:1877727022107520:192.168.204.3@tcp:104: 00010000:00010000:2.0:1790740532.770569:0:17167:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061e00/0xb25dda4f4e92f24f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.770580:0:17167:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061e00/0xb25dda4f4e92f24f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.770587:0:17167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061e00/0xb25dda4f4e92f24f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.770615:0:17167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060600/0xb25dda4f4e92f256 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.770630:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060600/0xb25dda4f4e92f256 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.770640:0:17167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060600/0xb25dda4f4e92f256 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.772573:0:17167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061400/0xb25dda4f4e92f25d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.772593:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061400/0xb25dda4f4e92f25d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.772602:0:17167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061400/0xb25dda4f4e92f25d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790740532.772621:0:17167:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f1f629cb reply state 00000000076c3df4 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061400/0xb25dda4f4e92f25d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.772643:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061400/0xb25dda4f4e92f25d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.772650:0:17167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98dcaf045e00) 00010000:00010000:2.0:1790740532.772653:0:17167:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790740532.772656:0:17167:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1790740532.772664:0:17167:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1790740532.772676:0:17167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061e00/0xb25dda4f4e92f24f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.772682:0:17167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061e00/0xb25dda4f4e92f24f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.772688:0:17167:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061e00/0xb25dda4f4e92f24f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.772693:0:17167:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf061e00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740532.772710:0:17167:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061e00/0xb25dda4f4e92f24f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.772718:0:17167:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061e00/0xb25dda4f4e92f24f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.772727:0:17167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98db82cc9400) 00010000:00010000:2.0:1790740532.772729:0:17167:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740532.772733:0:17167:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061e00/0xb25dda4f4e92f24f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.772738:0:17167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061e00/0xb25dda4f4e92f24f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790740532.772765:0:17167:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f1f629cb reply state 00000000076c3df4 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060600/0xb25dda4f4e92f256 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.772773:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060600/0xb25dda4f4e92f256 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.772779:0:17167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98dcaf045500) 00010000:00010000:2.0:1790740532.772781:0:17167:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790740532.772783:0:17167:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1790740532.773288:0:17167:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e31bfdb-0682-4acb-9750-d1df4d991489+10:15578:x1877727001048832:12345-192.168.204.3@tcp:36:lfs.0 Request processed in 12539us (12721us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1790740532.773299:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 28 00000040:00080000:1.0:1790740532.778689:0:17201:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1790740532.869760:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740532.869885:0:19500:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001049088 00000100:00100000:2.0:1790740532.869896:0:19500:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001049088 00000100:00100000:2.0:1790740532.869960:0:19500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 29 00000100:00100000:2.0:1790740532.869970:0:19500:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82330a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e31bfdb-0682-4acb-9750-d1df4d991489+10:15586:x1877727001049088:12345-192.168.204.3@tcp:101:lctl.0 00010000:00010000:2.0:1790740532.869994:0:19500:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740532.870017:0:19500:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061e00/0xb25dda4f4e92f264 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae2412a expref: -99 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.870139:0:19500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060200/0xb25dda4f4e92f26b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.870154:0:19500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060200/0xb25dda4f4e92f26b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.870166:0:19500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060200/0xb25dda4f4e92f26b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740532.870228:0:19500:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790740532.870231:0:19500:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790740532.870276:0:19500:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060200/0xb25dda4f4e92f26b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.870301:0:19500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061e00/0xb25dda4f4e92f264 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae2412a expref: 12 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.870321:0:19500:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060200/0xb25dda4f4e92f26b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae2412a expref: 11 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.870329:0:19500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98dcaf045a00) 00010000:00010000:2.0:1790740532.870332:0:19500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790740532.870335:0:19500:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaf060200, rc 0) 00000100:00100000:2.0:1790740532.870392:0:19500:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82330a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e31bfdb-0682-4acb-9750-d1df4d991489+11:15586:x1877727001049088:12345-192.168.204.3@tcp:101:lctl.0 Request processed in 424us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740532.870398:0:19500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 29 00000100:00100000:1.0:1790740532.899578:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740532.899748:0:17165:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001049216 00000100:00100000:3.0:1790740532.899763:0:17165:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001049216 00000100:00100000:3.0:1790740532.899925:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 30 00000100:00100000:3.0:1790740532.899937:0:17165:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4dca2668-e8ad-455d-9a0a-ed2d1013e863+5:15587:x1877727001049216:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:3.0:1790740532.899964:0:17165:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740532.899990:0:17165:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcc2174200/0xb25dda4f4e92f272 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae24131 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740532.900115:0:17165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcc2175600/0xb25dda4f4e92f279 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740532.900134:0:17165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcc2175600/0xb25dda4f4e92f279 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740532.900146:0:17165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcc2175600/0xb25dda4f4e92f279 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740532.900203:0:17165:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790740532.900208:0:17165:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790740532.900237:0:17165:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98dcc2175600/0xb25dda4f4e92f279 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740532.900266:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcc2174200/0xb25dda4f4e92f272 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24131 expref: 7 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740532.900302:0:17165:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcc2175600/0xb25dda4f4e92f279 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24131 expref: 6 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740532.900312:0:17165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98dcaf045a00) 00010000:00010000:3.0:1790740532.900316:0:17165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790740532.900320:0:17165:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcc2175600, rc 0) 00000100:00100000:3.0:1790740532.900612:0:17165:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4dca2668-e8ad-455d-9a0a-ed2d1013e863+6:15587:x1877727001049216:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 676us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740532.900621:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 30 00000100:00100000:1.0:1790740532.904179:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740532.904278:0:19500:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001049344 00000100:00100000:2.0:1790740532.904292:0:19500:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001049344 00000100:00100000:2.0:1790740532.904416:0:19500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 31 00000100:00100000:2.0:1790740532.904439:0:19500:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4dca2668-e8ad-455d-9a0a-ed2d1013e863+6:15587:x1877727001049344:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:2.0:1790740532.904473:0:19500:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740532.904501:0:19500:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061e00/0xb25dda4f4e92f280 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae24138 expref: -99 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.904594:0:19500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060c00/0xb25dda4f4e92f287 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.904633:0:19500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060c00/0xb25dda4f4e92f287 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.904660:0:19500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060c00/0xb25dda4f4e92f287 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.904674:0:19500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060400/0xb25dda4f4e92f28e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.904682:0:19500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060400/0xb25dda4f4e92f28e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.904688:0:19500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060400/0xb25dda4f4e92f28e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.904782:0:19500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92f295 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.904790:0:19500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92f295 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.904798:0:19500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92f295 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740532.904916:0:19500:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790740532.904921:0:19500:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790740532.904950:0:19500:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92f295 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.904965:0:19500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060c00/0xb25dda4f4e92f287 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.904985:0:19500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060c00/0xb25dda4f4e92f287 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.904993:0:19500:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060c00/0xb25dda4f4e92f287 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.904999:0:19500:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf060c00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740532.905004:0:19500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060c00/0xb25dda4f4e92f287 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.905014:0:19500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060c00/0xb25dda4f4e92f287 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.905060:0:19500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98dcaf045a00) 00010000:00010000:2.0:1790740532.905064:0:19500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740532.905071:0:19500:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060c00/0xb25dda4f4e92f287 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.905078:0:19500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060c00/0xb25dda4f4e92f287 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.905095:0:19500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060400/0xb25dda4f4e92f28e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.905101:0:19500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060400/0xb25dda4f4e92f28e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.905106:0:19500:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060400/0xb25dda4f4e92f28e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.905112:0:19500:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf060400 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740532.905121:0:19500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060400/0xb25dda4f4e92f28e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.905128:0:19500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060400/0xb25dda4f4e92f28e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.905136:0:19500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98dcaf045500) 00010000:00010000:2.0:1790740532.905138:0:19500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740532.905141:0:19500:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060400/0xb25dda4f4e92f28e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.905148:0:19500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060400/0xb25dda4f4e92f28e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.905181:0:19500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061e00/0xb25dda4f4e92f280 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24138 expref: 8 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.905195:0:19500:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92f295 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24138 expref: 7 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.905203:0:19500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98dcaf045e00) 00010000:00010000:2.0:1790740532.905205:0:19500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790740532.905208:0:19500:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaf061800, rc 0) 00000100:00100000:2.0:1790740532.905313:0:19500:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4dca2668-e8ad-455d-9a0a-ed2d1013e863+7:15587:x1877727001049344:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 876us (1148us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740532.905321:0:19500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 31 00000100:00100000:0.0:1790740532.908842:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740532.908978:0:17177:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001049472 00000100:00100000:1.0:1790740532.908993:0:17177:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001049472 00000100:00100000:1.0:1790740532.909176:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 6 00000100:00100000:1.0:1790740532.909189:0:17177:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82333100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4dca2668-e8ad-455d-9a0a-ed2d1013e863+5:15587:x1877727001049472:12345-192.168.204.3@tcp:900:lfs.0 00000100:00100000:1.0:1790740532.909683:0:17177:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82333100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4dca2668-e8ad-455d-9a0a-ed2d1013e863+5:15587:x1877727001049472:12345-192.168.204.3@tcp:900:lfs.0 Request processed in 495us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740532.909693:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 6 00000100:00100000:3.0:1790740532.916769:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740532.916836:0:17167:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001049728 00000100:00100000:2.0:1790740532.916850:0:17167:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001049728 00000100:00100000:2.0:1790740532.916932:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 32 00000100:00100000:2.0:1790740532.916945:0:17167:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4dca2668-e8ad-455d-9a0a-ed2d1013e863+7:15587:x1877727001049728:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:2.0:1790740532.916996:0:17167:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740532.917026:0:17167:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92f29c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae2413f expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740532.917224:0:17167:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1790740532.917375:0:17167:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92f29c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae2413f expref: 9 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.917392:0:17167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98dcaf045a00) 00010000:00010000:2.0:1790740532.917395:0:17167:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790740532.917402:0:17167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92f29c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae2413f expref: 9 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.917430:0:17167:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f33000, rc 0) 00000100:00100000:2.0:1790740532.917522:0:17167:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4dca2668-e8ad-455d-9a0a-ed2d1013e863+8:15587:x1877727001049728:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 579us (764us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1790740532.917540:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 32 00000100:00100000:1.0:1790740532.933133:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740532.933252:0:17166:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001049984 00000100:00100000:0.0:1790740532.933269:0:17166:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001049984 00000100:00100000:0.0:1790740532.933353:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 33 00000100:00100000:0.0:1790740532.933366:0:17166:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4dca2668-e8ad-455d-9a0a-ed2d1013e863+8:15587:x1877727001049984:12345-192.168.204.3@tcp:36:lfs.0 00010000:00010000:0.0:1790740532.933454:0:17166:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740532.933518:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92f295 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24138 expref: 8 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740532.933545:0:17166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98dcaf045e00) 00010000:00010000:0.0:1790740532.933551:0:17166:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790740532.933584:0:17166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98db82343e00/0xb25dda4f4e92f2aa lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740532.933601:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db82343e00/0xb25dda4f4e92f2aa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740532.933613:0:17166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db82343e00/0xb25dda4f4e92f2aa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790740532.934016:0:17166:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003615c812 reply state 00000000de1c97ea transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff98db82343e00/0xb25dda4f4e92f2aa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740532.934069:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db82343e00/0xb25dda4f4e92f2aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740532.934077:0:17166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98dcaf045e00) 00010000:00010000:0.0:1790740532.934080:0:17166:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1790740532.934103:0:17166:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1790740532.934113:0:17166:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1790740532.934229:0:17166:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4dca2668-e8ad-455d-9a0a-ed2d1013e863+9:15587:x1877727001049984:12345-192.168.204.3@tcp:36:lfs.0 Request processed in 865us (1112us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1790740532.934238:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 33 00000100:00100000:0.0:1790740532.937079:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740532.937189:0:17169:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001050240 00000100:00100000:1.0:1790740532.937203:0:17169:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001050240 00000100:00100000:1.0:1790740532.937278:0:17169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 2 00000100:00100000:1.0:1790740532.937289:0:17169:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82331880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4dca2668-e8ad-455d-9a0a-ed2d1013e863+9:15587:x1877727001050240:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:1.0:1790740532.937629:0:17169:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82331880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4dca2668-e8ad-455d-9a0a-ed2d1013e863+10:15587:x1877727001050240:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 341us (565us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1790740532.937817:0:17169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 2 00000100:00100000:3.0:1790740532.940515:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740532.940750:0:17167:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001050496 00000100:00100000:2.0:1790740532.940765:0:17167:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001050496 00000100:00100000:2.0:1790740532.940847:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 34 00000100:00100000:2.0:1790740532.940860:0:17167:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4dca2668-e8ad-455d-9a0a-ed2d1013e863+10:15587:x1877727001050496:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:2.0:1790740532.940893:0:17167:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740532.940919:0:17167:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33800/0xb25dda4f4e92f2b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae24146 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.941023:0:17167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92f2b8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.941089:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92f2b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.941104:0:17167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92f2b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.941120:0:17167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061e00/0xb25dda4f4e92f2bf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.941128:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061e00/0xb25dda4f4e92f2bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.941134:0:17167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061e00/0xb25dda4f4e92f2bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740532.941289:0:17167:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1790740532.943818:0:17167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92f2b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.943842:0:17167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92f2b8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.943853:0:17167:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92f2b8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.943860:0:17167:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f32200 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740532.943866:0:17167:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92f2b8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.943876:0:17167:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92f2b8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.943919:0:17167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98dcaf045a00) 00010000:00010000:2.0:1790740532.943922:0:17167:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740532.943928:0:17167:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92f2b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.943935:0:17167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92f2b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.943951:0:17167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061e00/0xb25dda4f4e92f2bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.943958:0:17167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061e00/0xb25dda4f4e92f2bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.943964:0:17167:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061e00/0xb25dda4f4e92f2bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.943969:0:17167:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf061e00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740532.943973:0:17167:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061e00/0xb25dda4f4e92f2bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.943979:0:17167:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061e00/0xb25dda4f4e92f2bf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.943988:0:17167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98dcaf045500) 00010000:00010000:2.0:1790740532.943990:0:17167:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740532.943993:0:17167:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061e00/0xb25dda4f4e92f2bf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.943999:0:17167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061e00/0xb25dda4f4e92f2bf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.944091:0:17167:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33800/0xb25dda4f4e92f2b1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24146 expref: 12 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.944104:0:17167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98dcaf045a00) 00010000:00010000:2.0:1790740532.944107:0:17167:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790740532.944111:0:17167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33800/0xb25dda4f4e92f2b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24146 expref: 12 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740532.944122:0:17167:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f33800, rc 0) 00000100:00100000:2.0:1790740532.944225:0:17167:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4dca2668-e8ad-455d-9a0a-ed2d1013e863+11:15587:x1877727001050496:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 3366us (3723us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1790740532.944235:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 34 00000100:00100000:0.0:1790740532.947154:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740532.947289:0:19500:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001050624 00000100:00100000:3.0:1790740532.947306:0:19500:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001050624 00000100:00100000:3.0:1790740532.947395:0:19500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 35 00000100:00100000:3.0:1790740532.947409:0:19500:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82330700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4dca2668-e8ad-455d-9a0a-ed2d1013e863+11:15587:x1877727001050624:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:3.0:1790740532.947452:0:19500:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740532.947481:0:19500:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcc2174200/0xb25dda4f4e92f2cd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae2414d expref: -99 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740532.947618:0:19500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcc2174a00/0xb25dda4f4e92f2d4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740532.947958:0:19500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcc2174a00/0xb25dda4f4e92f2d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740532.947976:0:19500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcc2174a00/0xb25dda4f4e92f2d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740532.948213:0:19500:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790740532.948218:0:19500:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790740532.948245:0:19500:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98dcc2174a00/0xb25dda4f4e92f2d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740532.948279:0:19500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcc2174200/0xb25dda4f4e92f2cd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae2414d expref: 13 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740532.948301:0:19500:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcc2174a00/0xb25dda4f4e92f2d4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae2414d expref: 12 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740532.948311:0:19500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98dcaf045e00) 00010000:00010000:3.0:1790740532.948314:0:19500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790740532.948319:0:19500:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcc2174a00, rc 0) 00000100:00100000:3.0:1790740532.948535:0:19500:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82330700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4dca2668-e8ad-455d-9a0a-ed2d1013e863+12:15587:x1877727001050624:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 1127us (1393us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740532.948544:0:19500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 35 00000100:00100000:0.0:1790740532.962959:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740532.963123:0:17168:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001050752 00000100:00100000:3.0:1790740532.963137:0:17168:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001050752 00000100:00100000:3.0:1790740532.963209:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 3 00000100:00100000:3.0:1790740532.963222:0:17168:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4dca2668-e8ad-455d-9a0a-ed2d1013e863+12:15587:x1877727001050752:12345-192.168.204.3@tcp:37:lfs.0 00000100:00100000:2.0:1790740532.987655:0:17168:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4dca2668-e8ad-455d-9a0a-ed2d1013e863+12:15587:x1877727001050752:12345-192.168.204.3@tcp:37:lfs.0 Request processed in 24417us (24690us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740532.987684:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 3 00000100:00100000:0.0:1790740532.994126:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740532.994284:0:17169:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001051008 00000100:00100000:1.0:1790740532.994301:0:17169:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001051008 00000100:00100000:1.0:1790740532.994380:0:17169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 4 00000100:00100000:1.0:1790740532.994393:0:17169:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbbcb3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4dca2668-e8ad-455d-9a0a-ed2d1013e863+12:15587:x1877727001051008:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:1.0:1790740532.994768:0:17169:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbbcb3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4dca2668-e8ad-455d-9a0a-ed2d1013e863+13:15587:x1877727001051008:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 377us (657us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1790740532.994778:0:17169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 4 00000100:00100000:0.0:1790740533.064394:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740533.064551:0:17165:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001051136 00000100:00100000:3.0:1790740533.064566:0:17165:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001051136 00000100:00100000:3.0:1790740533.064677:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 36 00000100:00100000:3.0:1790740533.064692:0:17165:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82333800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e31bfdb-0682-4acb-9750-d1df4d991489+11:15593:x1877727001051136:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:3.0:1790740533.064726:0:17165:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740533.064775:0:17165:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcc2174200/0xb25dda4f4e92f2db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae24154 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.064892:0:17165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcc2174600/0xb25dda4f4e92f2e2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.064912:0:17165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcc2174600/0xb25dda4f4e92f2e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.064927:0:17165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcc2174600/0xb25dda4f4e92f2e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.064940:0:17165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcc2174c00/0xb25dda4f4e92f2e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.064948:0:17165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcc2174c00/0xb25dda4f4e92f2e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.064955:0:17165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcc2174c00/0xb25dda4f4e92f2e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.065128:0:17165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9a00/0xb25dda4f4e92f2f0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.065140:0:17165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9a00/0xb25dda4f4e92f2f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.065148:0:17165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9a00/0xb25dda4f4e92f2f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740533.065197:0:17165:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790740533.065202:0:17165:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790740533.065254:0:17165:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9a00/0xb25dda4f4e92f2f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.065277:0:17165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcc2174600/0xb25dda4f4e92f2e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.065285:0:17165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcc2174600/0xb25dda4f4e92f2e2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.065294:0:17165:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcc2174600/0xb25dda4f4e92f2e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.065301:0:17165:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcc2174600 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740533.065306:0:17165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcc2174600/0xb25dda4f4e92f2e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.065316:0:17165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcc2174600/0xb25dda4f4e92f2e2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.065345:0:17165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98dcaf045a00) 00010000:00010000:3.0:1790740533.065349:0:17165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740533.065356:0:17165:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcc2174600/0xb25dda4f4e92f2e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.065362:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcc2174600/0xb25dda4f4e92f2e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.065381:0:17165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcc2174c00/0xb25dda4f4e92f2e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.065388:0:17165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcc2174c00/0xb25dda4f4e92f2e9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.065394:0:17165:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcc2174c00/0xb25dda4f4e92f2e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.065406:0:17165:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcc2174c00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740533.065410:0:17165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcc2174c00/0xb25dda4f4e92f2e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.065428:0:17165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcc2174c00/0xb25dda4f4e92f2e9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.065439:0:17165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98dcaf045500) 00010000:00010000:3.0:1790740533.065442:0:17165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740533.065445:0:17165:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcc2174c00/0xb25dda4f4e92f2e9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.065452:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcc2174c00/0xb25dda4f4e92f2e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.065486:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcc2174200/0xb25dda4f4e92f2db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24154 expref: 13 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.065501:0:17165:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9a00/0xb25dda4f4e92f2f0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24154 expref: 12 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.065509:0:17165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98dcaf045e00) 00010000:00010000:3.0:1790740533.065512:0:17165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1790740533.065514:0:17165:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc9a00, rc 0) 00000100:00100000:3.0:1790740533.065611:0:17165:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82333800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e31bfdb-0682-4acb-9750-d1df4d991489+12:15593:x1877727001051136:12345-192.168.204.3@tcp:101:bash.0 Request processed in 924us (1233us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740533.065621:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 36 00000100:00080000:0.0:1790740533.066150:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790740533.077294:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740533.077459:0:17176:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001051264 00000100:00100000:0.0:1790740533.077474:0:17176:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001051264 00000100:00080000:3.0:1790740533.077694:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790740533.078307:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 7 00000100:00100000:0.0:1790740533.078325:0:17176:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8e31bfdb-0682-4acb-9750-d1df4d991489+5:15593:x1877727001051264:12345-192.168.204.3@tcp:900:bash.0 00000100:00100000:0.0:1790740533.078491:0:17176:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8e31bfdb-0682-4acb-9750-d1df4d991489+5:15593:x1877727001051264:12345-192.168.204.3@tcp:900:bash.0 Request processed in 101us (1141us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740533.078501:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 7 00000100:00100000:1.0:1790740533.084999:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740533.085160:0:17166:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001051520 00000100:00100000:0.0:1790740533.085173:0:17166:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001051520 00000100:00100000:0.0:1790740533.085251:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 37 00000100:00100000:0.0:1790740533.085262:0:17166:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e31bfdb-0682-4acb-9750-d1df4d991489+12:15593:x1877727001051520:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:0.0:1790740533.085292:0:17166:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740533.085321:0:17166:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342800/0xb25dda4f4e92f2f7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae2415b expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740533.085490:0:17166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342e00/0xb25dda4f4e92f2fe lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740533.085741:0:17166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcc2174a00/0xb25dda4f4e92f2d4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae2414d expref: 12 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740533.085753:0:17166:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342e00/0xb25dda4f4e92f2fe lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740533.085882:0:17166:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98dcc2174a00/0xb25dda4f4e92f2d4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae2414d expref: 12 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740533.085902:0:17166:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcc2174a00/0xb25dda4f4e92f2d4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae2414d expref: 12 pid: 19500 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740533.085922:0:17166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82331880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17166:1877727022107648:192.168.204.3@tcp:104: 00000100:00100000:0.0:1790740533.087239:0:17166:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc909bfd80 going to sleep for 11 seconds 00000100:00100000:0.0:1790740533.091999:0:17166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82331880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17166:1877727022107648:192.168.204.3@tcp:104: 00010000:00010000:0.0:1790740533.092926:0:17166:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342e00/0xb25dda4f4e92f2fe lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740533.092974:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740533.093097:0:17152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001051648 00000100:00100000:0.0:1790740533.093108:0:17152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001051648 00010000:00010000:0.0:1790740533.093244:0:17152:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcc2174a00/0xb25dda4f4e92f2d4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae2414d expref: 13 pid: 19500 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740533.093343:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 16 00000100:00100000:0.0:1790740533.093355:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eeb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4dca2668-e8ad-455d-9a0a-ed2d1013e863+13:2403:x1877727001051648:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790740533.093377:0:17152:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740533.093407:0:17152:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98dcc2174a00/0xb25dda4f4e92f2d4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae2414d expref: 13 pid: 19500 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1790740533.093425:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790740533.093431:0:17152:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98dcc2174a00/0xb25dda4f4e92f2d4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae2414d expref: 13 pid: 19500 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740533.093462:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcc2174a00/0xb25dda4f4e92f2d4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae2414d expref: 13 pid: 19500 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740533.093484:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98dcaf045e00) 00010000:00010000:0.0:1790740533.093490:0:17152:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342e00/0xb25dda4f4e92f2fe lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740533.093574:0:17152:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342e00/0xb25dda4f4e92f2fe lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740533.093583:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342e00/0xb25dda4f4e92f2fe lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740533.093618:0:17152:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740533.093696:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eeb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4dca2668-e8ad-455d-9a0a-ed2d1013e863+12:2403:x1877727001051648:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 343us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740533.093705:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 16 00010000:00010000:2.0:1790740533.093776:0:17166:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342e00/0xb25dda4f4e92f2fe lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.093796:0:17166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342e00/0xb25dda4f4e92f2fe lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.093829:0:17166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061e00/0xb25dda4f4e92f305 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.093851:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061e00/0xb25dda4f4e92f305 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.093861:0:17166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061e00/0xb25dda4f4e92f305 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.095761:0:17166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060400/0xb25dda4f4e92f30c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.095789:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060400/0xb25dda4f4e92f30c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.095801:0:17166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060400/0xb25dda4f4e92f30c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740533.095815:0:17166:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790740533.095863:0:17166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342e00/0xb25dda4f4e92f2fe lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.095871:0:17166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342e00/0xb25dda4f4e92f2fe lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.095880:0:17166:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342e00/0xb25dda4f4e92f2fe lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.095887:0:17166:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db82342e00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740533.095893:0:17166:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342e00/0xb25dda4f4e92f2fe lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.095902:0:17166:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342e00/0xb25dda4f4e92f2fe lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.095916:0:17166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98dcaf045e00) 00010000:00010000:2.0:1790740533.095920:0:17166:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740533.095925:0:17166:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342e00/0xb25dda4f4e92f2fe lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.095957:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342e00/0xb25dda4f4e92f2fe lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790740533.095975:0:17166:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002e791db2 reply state 00000000359f6d4d transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061e00/0xb25dda4f4e92f305 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.095989:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061e00/0xb25dda4f4e92f305 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.095995:0:17166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff98dcaf045800) 00010000:00010000:2.0:1790740533.095998:0:17166:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790740533.096012:0:17166:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790740533.096088:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342800/0xb25dda4f4e92f2f7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae2415b expref: 15 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.096105:0:17166:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060400/0xb25dda4f4e92f30c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae2415b expref: 14 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.096112:0:17166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98dcaf045300) 00010000:00010000:2.0:1790740533.096114:0:17166:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1790740533.096116:0:17166:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaf060400, rc 0) 00000100:00100000:2.0:1790740533.096208:0:17166:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e31bfdb-0682-4acb-9750-d1df4d991489+15:15593:x1877727001051520:12345-192.168.204.3@tcp:101:bash.0 Request processed in 10948us (11223us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1790740533.096217:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 37 00000100:00100000:1.0:1790740533.113399:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740533.113555:0:17165:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001051776 00000100:00100000:3.0:1790740533.113568:0:17165:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001051776 00000100:00100000:3.0:1790740533.113695:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 38 00000100:00100000:3.0:1790740533.113708:0:17165:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ee8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e31bfdb-0682-4acb-9750-d1df4d991489+15:15593:x1877727001051776:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:3.0:1790740533.113745:0:17165:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740533.113773:0:17165:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92f31a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae24162 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.113867:0:17165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8e00/0xb25dda4f4e92f321 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.113884:0:17165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8e00/0xb25dda4f4e92f321 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.113899:0:17165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8e00/0xb25dda4f4e92f321 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740533.113970:0:17165:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1790740533.113976:0:17165:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790740533.113998:0:17165:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8e00/0xb25dda4f4e92f321 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.114010:0:17165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8e00/0xb25dda4f4e92f321 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.114065:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92f31a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24162 expref: 17 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.114090:0:17165:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8e00/0xb25dda4f4e92f321 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24162 expref: 16 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.114109:0:17165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98dcaf045300) 00010000:00010000:3.0:1790740533.114112:0:17165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790740533.114116:0:17165:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc8e00, rc 0) 00000100:00100000:3.0:1790740533.114199:0:17165:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ee8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e31bfdb-0682-4acb-9750-d1df4d991489+16:15593:x1877727001051776:12345-192.168.204.3@tcp:101:bash.0 Request processed in 494us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740533.114208:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 38 00000100:00100000:1.0:1790740533.116765:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740533.116893:0:17168:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001052032 00000100:00100000:2.0:1790740533.116906:0:17168:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001052032 00000100:00100000:2.0:1790740533.116969:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 5 00000100:00100000:2.0:1790740533.116978:0:17168:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ee9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8e31bfdb-0682-4acb-9750-d1df4d991489+16:15593:x1877727001052032:12345-192.168.204.3@tcp:35:bash.0 00000100:00100000:2.0:1790740533.117391:0:17168:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ee9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8e31bfdb-0682-4acb-9750-d1df4d991489+17:15593:x1877727001052032:12345-192.168.204.3@tcp:35:bash.0 Request processed in 413us (648us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1790740533.117549:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 5 00000100:00100000:0.0:1790740533.188927:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740533.189069:0:19500:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001052288 00000100:00100000:3.0:1790740533.189084:0:19500:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001052288 00000100:00100000:3.0:1790740533.189169:0:19500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 39 00000100:00100000:3.0:1790740533.189180:0:19500:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82331880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e31bfdb-0682-4acb-9750-d1df4d991489+17:15603:x1877727001052288:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:3.0:1790740533.189217:0:19500:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740533.189248:0:19500:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92f328 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae24169 expref: -99 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740533.189388:0:19500:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1790740533.189548:0:19500:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92f328 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24169 expref: 19 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.189566:0:19500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98dcaf045a00) 00010000:00010000:3.0:1790740533.189570:0:19500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790740533.189576:0:19500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92f328 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24169 expref: 19 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.189594:0:19500:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc8200, rc 0) 00000100:00100000:3.0:1790740533.189682:0:19500:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82331880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e31bfdb-0682-4acb-9750-d1df4d991489+18:15603:x1877727001052288:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 504us (774us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1790740533.189713:0:19500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 39 00000100:00100000:0.0:1790740533.193278:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740533.193434:0:17169:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001052544 00000100:00100000:1.0:1790740533.193448:0:17169:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001052544 00000100:00100000:1.0:1790740533.193529:0:17169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 6 00000100:00100000:1.0:1790740533.193542:0:17169:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8e31bfdb-0682-4acb-9750-d1df4d991489+18:15603:x1877727001052544:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:1.0:1790740533.193878:0:17169:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8e31bfdb-0682-4acb-9750-d1df4d991489+19:15603:x1877727001052544:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 337us (614us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1790740533.193886:0:17169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 6 00000100:00100000:1.0:1790740533.231834:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740533.231968:0:17167:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001052800 00000100:00100000:2.0:1790740533.231982:0:17167:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001052800 00000100:00100000:2.0:1790740533.232117:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 40 00000100:00100000:2.0:1790740533.232130:0:17167:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e31bfdb-0682-4acb-9750-d1df4d991489+19:15606:x1877727001052800:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:2.0:1790740533.232181:0:17167:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740533.232207:0:17167:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060c00/0xb25dda4f4e92f336 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae24170 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.232394:0:17167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92f33d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.232411:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92f33d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.232436:0:17167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92f33d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740533.232450:0:17167:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790740533.232592:0:17167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060c00/0xb25dda4f4e92f336 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24170 expref: 22 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.232614:0:17167:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92f33d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24170 expref: 21 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.232624:0:17167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98dcaf045300) 00010000:00010000:2.0:1790740533.232634:0:17167:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790740533.232639:0:17167:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaf061800, rc 0) 00000100:00100000:2.0:1790740533.232715:0:17167:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e31bfdb-0682-4acb-9750-d1df4d991489+21:15606:x1877727001052800:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 588us (896us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1790740533.232723:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 40 00000100:00100000:0.0:1790740533.236218:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740533.236339:0:17166:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001052928 00000100:00100000:2.0:1790740533.236352:0:17166:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001052928 00000100:00100000:2.0:1790740533.236427:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 41 00000100:00100000:2.0:1790740533.236439:0:17166:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82333b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e31bfdb-0682-4acb-9750-d1df4d991489+21:15606:x1877727001052928:12345-192.168.204.3@tcp:54:lfs.0 00010000:00010000:2.0:1790740533.236532:0:17166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33800/0xb25dda4f4e92f34b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.236555:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33800/0xb25dda4f4e92f34b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.236569:0:17166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33800/0xb25dda4f4e92f34b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.236615:0:17166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33800/0xb25dda4f4e92f34b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.236623:0:17166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33800/0xb25dda4f4e92f34b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.236630:0:17166:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33800/0xb25dda4f4e92f34b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.236637:0:17166:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db83f33800 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740533.236642:0:17166:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33800/0xb25dda4f4e92f34b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.236684:0:17166:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33800/0xb25dda4f4e92f34b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.236699:0:17166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98dcaf045300) 00010000:00010000:2.0:1790740533.236702:0:17166:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790740533.236707:0:17166:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33800/0xb25dda4f4e92f34b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.236714:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33800/0xb25dda4f4e92f34b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740533.236816:0:17166:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82333b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e31bfdb-0682-4acb-9750-d1df4d991489+21:15606:x1877727001052928:12345-192.168.204.3@tcp:54:lfs.0 Request processed in 378us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740533.236825:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 41 00000100:00100000:0.0:1790740533.239275:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740533.239549:0:17153:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001053056 00000100:00100000:1.0:1790740533.239563:0:17153:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001053056 00000100:00100000:1.0:1790740533.239656:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 0 00000100:00100000:1.0:1790740533.239667:0:17153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc884b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e31bfdb-0682-4acb-9750-d1df4d991489+21:2405:x1877727001053056:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740533.239689:0:17153:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740533.239722:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92f33d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24170 expref: 21 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740533.239747:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98dcaf045300) 00010000:00010000:1.0:1790740533.239753:0:17153:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740533.239889:0:17153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc884b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e31bfdb-0682-4acb-9750-d1df4d991489+20:2405:x1877727001053056:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 222us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740533.239898:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 0 00000100:00100000:0.0:1790740533.242990:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740533.243632:0:17169:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001053312 00000100:00100000:2.0:1790740533.243646:0:17169:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001053312 00000100:00100000:2.0:1790740533.243717:0:17169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 7 00000100:00100000:2.0:1790740533.243729:0:17169:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc884b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8e31bfdb-0682-4acb-9750-d1df4d991489+20:15606:x1877727001053312:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:2.0:1790740533.244077:0:17169:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc884b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8e31bfdb-0682-4acb-9750-d1df4d991489+21:15606:x1877727001053312:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 350us (1102us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1790740533.244086:0:17169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 7 00010000:00010000:2.0:1790740533.418355:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740533.464668:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740533.464785:0:17167:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001053568 00000100:00100000:2.0:1790740533.464799:0:17167:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001053568 00000100:00100000:2.0:1790740533.464885:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 42 00000100:00100000:2.0:1790740533.464899:0:17167:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e31bfdb-0682-4acb-9750-d1df4d991489+21:15637:x1877727001053568:12345-192.168.204.3@tcp:101:cat.0 00010000:00010000:2.0:1790740533.464934:0:17167:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740533.464982:0:17167:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33800/0xb25dda4f4e92f352 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae24177 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.465177:0:17167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92f359 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.465196:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92f359 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.465210:0:17167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92f359 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740533.465225:0:17167:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790740533.465400:0:17167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33800/0xb25dda4f4e92f352 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24177 expref: 24 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.465437:0:17167:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92f359 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24177 expref: 23 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.465447:0:17167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98dcaf045300) 00010000:00010000:2.0:1790740533.465450:0:17167:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790740533.465454:0:17167:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f32200, rc 0) 00000100:00100000:2.0:1790740533.465545:0:17167:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e31bfdb-0682-4acb-9750-d1df4d991489+23:15637:x1877727001053568:12345-192.168.204.3@tcp:101:cat.0 Request processed in 648us (891us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1790740533.465553:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 42 00000100:00100000:0.0:1790740533.469789:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740533.469940:0:17169:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001053824 00000100:00100000:2.0:1790740533.469953:0:17169:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001053824 00000100:00100000:2.0:1790740533.470071:0:17169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 8 00000100:00100000:2.0:1790740533.470084:0:17169:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc884b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8e31bfdb-0682-4acb-9750-d1df4d991489+23:15637:x1877727001053824:12345-192.168.204.3@tcp:35:cat.0 00000100:00100000:2.0:1790740533.470531:0:17169:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc884b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8e31bfdb-0682-4acb-9750-d1df4d991489+24:15637:x1877727001053824:12345-192.168.204.3@tcp:35:cat.0 Request processed in 448us (756us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1790740533.470540:0:17169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 8 00000100:00100000:0.0:1790740533.474127:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740533.474476:0:17152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001053952 00000100:00100000:3.0:1790740533.474489:0:17152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001053952 00000100:00100000:3.0:1790740533.474573:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 1 00000100:00100000:3.0:1790740533.474584:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e31bfdb-0682-4acb-9750-d1df4d991489+24:2402:x1877727001053952:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790740533.474604:0:17152:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740533.474636:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92f359 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24177 expref: 24 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.474659:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98dcaf045300) 00010000:00010000:3.0:1790740533.474664:0:17152:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740533.474735:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e31bfdb-0682-4acb-9750-d1df4d991489+23:2402:x1877727001053952:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 152us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740533.474742:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 1 00000100:00100000:0.0:1790740533.535903:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740533.536067:0:17166:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001054208 00000100:00100000:2.0:1790740533.536081:0:17166:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001054208 00000100:00100000:2.0:1790740533.536165:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 43 00000100:00100000:2.0:1790740533.536178:0:17166:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfe2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e31bfdb-0682-4acb-9750-d1df4d991489+23:15643:x1877727001054208:12345-192.168.204.3@tcp:101:dd.0 00010000:00010000:2.0:1790740533.536213:0:17166:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740533.536242:0:17166:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33800/0xb25dda4f4e92f367 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae2417e expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.536420:0:17166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92f36e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.536440:0:17166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060400/0xb25dda4f4e92f30c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae2415b expref: 24 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.536449:0:17166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8e00/0xb25dda4f4e92f321 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24162 expref: 24 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.536458:0:17166:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92f36e lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.536505:0:17166:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8e00/0xb25dda4f4e92f321 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24162 expref: 24 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.536521:0:17166:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8e00/0xb25dda4f4e92f321 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24162 expref: 24 pid: 17165 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740533.536563:0:17166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefd8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17166:1877727022107776:192.168.204.3@tcp:104: 00010000:00010000:2.0:1790740533.536694:0:17166:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060400/0xb25dda4f4e92f30c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae2415b expref: 24 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.536705:0:17166:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060400/0xb25dda4f4e92f30c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae2415b expref: 24 pid: 17166 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740533.536716:0:17166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefdb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17166:1877727022107904:192.168.204.3@tcp:104: 00000100:00100000:2.0:1790740533.536742:0:17166:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc990699c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740533.540444:0:17166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefd8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17166:1877727022107776:192.168.204.3@tcp:104: 00000100:00100000:2.0:1790740533.540464:0:17166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefdb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17166:1877727022107904:192.168.204.3@tcp:104: 00010000:00010000:2.0:1790740533.540501:0:17166:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92f36e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740533.541201:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740533.541246:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740533.541391:0:17152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001054336 00000100:00100000:1.0:1790740533.541403:0:17152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001054336 00010000:00010000:1.0:1790740533.541472:0:17152:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8e00/0xb25dda4f4e92f321 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24162 expref: 25 pid: 17165 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740533.541543:0:17152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001054464 00000100:00100000:1.0:1790740533.541547:0:17152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001054464 00010000:00010000:1.0:1790740533.541561:0:17152:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060400/0xb25dda4f4e92f30c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae2415b expref: 26 pid: 17166 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740533.541576:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 17 00000100:00100000:1.0:1790740533.541585:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84524e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e31bfdb-0682-4acb-9750-d1df4d991489+26:2403:x1877727001054336:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740533.541606:0:17152:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740533.541614:0:17152:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8e00/0xb25dda4f4e92f321 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24162 expref: 26 pid: 17165 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740533.541626:0:17152:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8e00/0xb25dda4f4e92f321 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24162 expref: 26 pid: 17165 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740533.541654:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8e00/0xb25dda4f4e92f321 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24162 expref: 26 pid: 17165 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740533.541675:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98dcaf045300) 00010000:00010000:1.0:1790740533.541681:0:17152:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92f36e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740533.541950:0:17152:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92f36e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740533.541961:0:17152:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740533.542142:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84524e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e31bfdb-0682-4acb-9750-d1df4d991489+25:2403:x1877727001054336:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 556us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740533.542162:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 17 00000100:00100000:1.0:1790740533.542187:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 18 00000100:00100000:1.0:1790740533.542194:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db829b9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e31bfdb-0682-4acb-9750-d1df4d991489+24:2403:x1877727001054464:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740533.542204:0:17152:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740533.542209:0:17152:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060400/0xb25dda4f4e92f30c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae2415b expref: 24 pid: 17166 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740533.542219:0:17152:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060400/0xb25dda4f4e92f30c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae2415b expref: 24 pid: 17166 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740533.542233:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060400/0xb25dda4f4e92f30c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae2415b expref: 24 pid: 17166 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740533.542245:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98dcaf045300) 00010000:00010000:1.0:1790740533.542249:0:17152:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92f36e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740533.542257:0:17152:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92f36e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740533.542266:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92f36e lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740533.542291:0:17152:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740533.542310:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db829b9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e31bfdb-0682-4acb-9750-d1df4d991489+23:2403:x1877727001054464:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 117us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740533.542317:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 18 00010000:00010000:1.0:1790740533.542434:0:17166:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92f36e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740533.542444:0:17166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92f36e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740533.542468:0:17166:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1790740533.542668:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33800/0xb25dda4f4e92f367 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae2417e expref: 24 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740533.542687:0:17166:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f33000/0xb25dda4f4e92f36e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae2417e expref: 23 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740533.542696:0:17166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98dcaf045300) 00010000:00010000:1.0:1790740533.542699:0:17166:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790740533.542702:0:17166:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db83f33000, rc 0) 00000100:00100000:1.0:1790740533.542733:0:17166:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfe2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e31bfdb-0682-4acb-9750-d1df4d991489+23:15643:x1877727001054208:12345-192.168.204.3@tcp:101:dd.0 Request processed in 6560us (6848us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1790740533.542741:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 43 00000100:00100000:0.0:1790740533.547601:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740533.547701:0:17167:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001054592 00000100:00100000:2.0:1790740533.547715:0:17167:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001054592 00000100:00100000:2.0:1790740533.548263:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 44 00000100:00100000:2.0:1790740533.548276:0:17167:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e31bfdb-0682-4acb-9750-d1df4d991489+23:15643:x1877727001054592:12345-192.168.204.3@tcp:101:dd.0 00010000:00010000:2.0:1790740533.548313:0:17167:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740533.548350:0:17167:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92f37c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae24185 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.548395:0:17167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92f383 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.548449:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92f383 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.548461:0:17167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92f383 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.548597:0:17167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db83f32200/0xb25dda4f4e92f37c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24185 expref: 25 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.548619:0:17167:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92f383 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24185 expref: 24 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.548628:0:17167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98dcaf045300) 00010000:00010000:2.0:1790740533.548631:0:17167:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790740533.548636:0:17167:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcaf061800, rc 0) 00000100:00100000:2.0:1790740533.548718:0:17167:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e31bfdb-0682-4acb-9750-d1df4d991489+24:15643:x1877727001054592:12345-192.168.204.3@tcp:101:dd.0 Request processed in 445us (1134us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740533.548726:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 44 00000100:00100000:0.0:1790740533.554356:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740533.554601:0:19500:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001054848 00000100:00100000:3.0:1790740533.554615:0:19500:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001054848 00000100:00100000:3.0:1790740533.554692:0:19500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 45 00000100:00100000:3.0:1790740533.554704:0:19500:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db84524e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e31bfdb-0682-4acb-9750-d1df4d991489+24:15643:x1877727001054848:12345-192.168.204.3@tcp:36:dd.0 00010000:00010000:3.0:1790740533.555278:0:19500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92f38a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.555306:0:19500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92f38a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.555529:0:19500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92f38a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790740533.555636:0:19500:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1790740533.555686:0:19500:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000bc1b74f3 reply state 00000000b294f7be transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92f38a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.555703:0:19500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92f38a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.555712:0:19500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98dcaf045300) 00010000:00010000:3.0:1790740533.555715:0:19500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790740533.555720:0:19500:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790740533.556167:0:19500:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db84524e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e31bfdb-0682-4acb-9750-d1df4d991489+27:15643:x1877727001054848:12345-192.168.204.3@tcp:36:dd.0 Request processed in 1460us (1820us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1790740533.556178:0:19500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 45 00000020:00080000:3.0:1790740533.556185:0:19500:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1790740533.558908:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740533.559012:0:17165:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001054976 00000100:00100000:3.0:1790740533.559026:0:17165:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001054976 00000100:00100000:0.0:1790740533.559605:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 46 00000100:00100000:0.0:1790740533.559618:0:17165:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e31bfdb-0682-4acb-9750-d1df4d991489+27:15643:x1877727001054976:12345-192.168.204.3@tcp:101:dd.0 00010000:00010000:0.0:1790740533.559654:0:17165:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740533.559681:0:17165:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342a00/0xb25dda4f4e92f391 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae2418c expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740533.559759:0:17165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342a00/0xb25dda4f4e92f391 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae2418c expref: 28 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740533.559777:0:17165:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342a00/0xb25dda4f4e92f391 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae2418c expref: 28 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740533.559800:0:17165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98dcaf045300) 00010000:00010000:0.0:1790740533.559803:0:17165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790740533.559808:0:17165:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db82342a00, rc 0) 00000100:00100000:0.0:1790740533.559906:0:17165:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e31bfdb-0682-4acb-9750-d1df4d991489+28:15643:x1877727001054976:12345-192.168.204.3@tcp:101:dd.0 Request processed in 290us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740533.559916:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 46 00000100:00100000:0.0:1790740533.577477:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740533.577625:0:17152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001055232 00000100:00100000:1.0:1790740533.577639:0:17152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001055232 00000100:00100000:1.0:1790740533.577728:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 2 00000100:00100000:1.0:1790740533.577741:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e31bfdb-0682-4acb-9750-d1df4d991489+28:15643:x1877727001055232:12345-192.168.204.3@tcp:103:dd.0 00010000:00010000:1.0:1790740533.577762:0:17152:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740533.577797:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342a00/0xb25dda4f4e92f391 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae2418c expref: 28 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740533.577823:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98dcaf045300) 00010000:00010000:1.0:1790740533.577860:0:17152:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740533.577939:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e31bfdb-0682-4acb-9750-d1df4d991489+27:15643:x1877727001055232:12345-192.168.204.3@tcp:103:dd.0 Request processed in 201us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740533.577948:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 2 00000100:00100000:2.0:1790740533.581416:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740533.581751:0:17167:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001055360 00000100:00100000:0.0:1790740533.581764:0:17167:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001055360 00000100:00100000:0.0:1790740533.581988:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 47 00000100:00100000:0.0:1790740533.582018:0:17167:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaefdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e31bfdb-0682-4acb-9750-d1df4d991489+27:15643:x1877727001055360:12345-192.168.204.3@tcp:58:dd.0 00010000:00010000:0.0:1790740533.582213:0:17167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342400/0xb25dda4f4e92f398 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740533.582237:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342400/0xb25dda4f4e92f398 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740533.582252:0:17167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342400/0xb25dda4f4e92f398 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790740533.584084:0:17167:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790740533.584129:0:17167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1790740533.584292:0:17167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1790740533.584453:0:17167:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaefdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e31bfdb-0682-4acb-9750-d1df4d991489+27:15643:x1877727001055360:12345-192.168.204.3@tcp:58:dd.0 Request processed in 2430us (3055us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740533.584467:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 47 00000100:00100000:0.0:1790740533.593586:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740533.593716:0:17166:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001055488 00000100:00100000:1.0:1790740533.593730:0:17166:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001055488 00000100:00100000:1.0:1790740533.593847:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 48 00000100:00100000:1.0:1790740533.593859:0:17166:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e31bfdb-0682-4acb-9750-d1df4d991489+27:15643:x1877727001055488:12345-192.168.204.3@tcp:101:dd.0 00010000:00010000:1.0:1790740533.593900:0:17166:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740533.594105:0:17166:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44a00/0xb25dda4f4e92f39f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae24193 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740533.594202:0:17166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342400/0xb25dda4f4e92f398 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740533.594218:0:17166:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44a00/0xb25dda4f4e92f39f lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24193 expref: 28 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740533.594244:0:17166:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342400/0xb25dda4f4e92f398 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740533.594260:0:17166:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44a00/0xb25dda4f4e92f39f lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24193 expref: 28 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740533.594288:0:17166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98dcaf045300) 00010000:00010000:1.0:1790740533.594293:0:17166:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790740533.594297:0:17166:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44a00/0xb25dda4f4e92f39f lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24193 expref: 28 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740533.594331:0:17166:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcbfc44a00, rc 0) 00000100:00100000:1.0:1790740533.594426:0:17166:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e31bfdb-0682-4acb-9750-d1df4d991489+28:15643:x1877727001055488:12345-192.168.204.3@tcp:101:dd.0 Request processed in 569us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740533.594434:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 48 00000040:00080000:0.0:1790740533.612668:0:17922:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1790740533.805099:0:17201:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1790740533.805114:0:17201:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790740533.805152:0:17201:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1790740533.805167:0:17201:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1790740533.805361:0:17201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83eeb480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17201:1877727022108032:192.168.204.3@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790740533.805498:0:17201:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc84ca2600 going to sleep for 11 seconds 00000100:00100000:1.0:1790740533.814641:0:17201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83eeb480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17201:1877727022108032:192.168.204.3@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790740533.823192:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740533.823303:0:19500:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001055616 00000100:00100000:3.0:1790740533.823313:0:19500:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001055616 00000100:00100000:3.0:1790740533.823368:0:19500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 49 00000100:00100000:3.0:1790740533.823377:0:19500:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaefd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e31bfdb-0682-4acb-9750-d1df4d991489+28:15644:x1877727001055616:12345-192.168.204.3@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790740533.823421:0:19500:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790740533.823559:0:19500:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaefd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e31bfdb-0682-4acb-9750-d1df4d991489+28:15644:x1877727001055616:12345-192.168.204.3@tcp:53:lhsmtool_posix.0 Request processed in 182us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740533.823566:0:19500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 49 00000100:00100000:0.0:1790740533.830813:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740533.836865:0:17165:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001055744 00000100:00100000:2.0:1790740533.836883:0:17165:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001055744 00000100:00100000:2.0:1790740533.836965:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 50 00000100:00100000:2.0:1790740533.836975:0:17165:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e31bfdb-0682-4acb-9750-d1df4d991489+28:15644:x1877727001055744:12345-192.168.204.3@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1790740533.837076:0:17165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060400/0xb25dda4f4e92f3a6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.837091:0:17165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060400/0xb25dda4f4e92f3a6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.837118:0:17165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060400/0xb25dda4f4e92f3a6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.837171:0:17165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060c00/0xb25dda4f4e92f3ad lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.837179:0:17165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060c00/0xb25dda4f4e92f3ad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.837188:0:17165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060c00/0xb25dda4f4e92f3ad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.837209:0:17165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80031e00/0xb25dda4f4e92f3b4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.837217:0:17165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80031e00/0xb25dda4f4e92f3b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.837224:0:17165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80031e00/0xb25dda4f4e92f3b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740533.837267:0:17165:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1790740533.837271:0:17165:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790740533.837283:0:17165:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80031e00/0xb25dda4f4e92f3b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.837293:0:17165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060400/0xb25dda4f4e92f3a6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.837300:0:17165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060400/0xb25dda4f4e92f3a6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.837315:0:17165:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060400/0xb25dda4f4e92f3a6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.837321:0:17165:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf060400 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740533.837325:0:17165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060400/0xb25dda4f4e92f3a6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.837333:0:17165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060400/0xb25dda4f4e92f3a6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.837342:0:17165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98dcaf045000) 00010000:00010000:2.0:1790740533.837345:0:17165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740533.837349:0:17165:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060400/0xb25dda4f4e92f3a6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.837354:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060400/0xb25dda4f4e92f3a6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.837367:0:17165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060c00/0xb25dda4f4e92f3ad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.837373:0:17165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060c00/0xb25dda4f4e92f3ad lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.837378:0:17165:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060c00/0xb25dda4f4e92f3ad lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.837382:0:17165:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf060c00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740533.837385:0:17165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060c00/0xb25dda4f4e92f3ad lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.837397:0:17165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060c00/0xb25dda4f4e92f3ad lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.837416:0:17165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff98dcaf045700) 00010000:00010000:2.0:1790740533.837418:0:17165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740533.837421:0:17165:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060c00/0xb25dda4f4e92f3ad lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.837426:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060c00/0xb25dda4f4e92f3ad lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.837441:0:17165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80031e00/0xb25dda4f4e92f3b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.837446:0:17165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80031e00/0xb25dda4f4e92f3b4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.837451:0:17165:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80031e00/0xb25dda4f4e92f3b4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.837455:0:17165:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dc80031e00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740533.837457:0:17165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80031e00/0xb25dda4f4e92f3b4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.837462:0:17165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80031e00/0xb25dda4f4e92f3b4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.837467:0:17165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98dcaf045300) 00010000:00010000:2.0:1790740533.837469:0:17165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740533.837471:0:17165:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80031e00/0xb25dda4f4e92f3b4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.837661:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80031e00/0xb25dda4f4e92f3b4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740533.838002:0:17165:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e31bfdb-0682-4acb-9750-d1df4d991489+28:15644:x1877727001055744:12345-192.168.204.3@tcp:34:lhsmtool_posix.0 Request processed in 1026us (7196us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740533.838011:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 50 00000100:00100000:1.0:1790740533.843978:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740533.844211:0:19500:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001056000 00000100:00100000:3.0:1790740533.844222:0:19500:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001056000 00000100:00100000:3.0:1790740533.844283:0:19500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 51 00000100:00100000:3.0:1790740533.844294:0:19500:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e31bfdb-0682-4acb-9750-d1df4d991489+28:15644:x1877727001056000:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790740533.844330:0:19500:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740533.844350:0:19500:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92f3bb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae2419a expref: -99 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.844462:0:19500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8600/0xb25dda4f4e92f3c2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.844878:0:19500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8600/0xb25dda4f4e92f3c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.844893:0:19500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8600/0xb25dda4f4e92f3c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740533.844906:0:19500:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1790740533.845604:0:19500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8600/0xb25dda4f4e92f3c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.845618:0:19500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8600/0xb25dda4f4e92f3c2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.845636:0:19500:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8600/0xb25dda4f4e92f3c2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.845642:0:19500:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc8600 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740533.845647:0:19500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8600/0xb25dda4f4e92f3c2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.845656:0:19500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8600/0xb25dda4f4e92f3c2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.845669:0:19500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98dcaf045300) 00010000:00010000:3.0:1790740533.845684:0:19500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790740533.845689:0:19500:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8600/0xb25dda4f4e92f3c2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.845696:0:19500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8600/0xb25dda4f4e92f3c2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.846152:0:19500:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92f3bb lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae2419a expref: 30 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.846165:0:19500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98dcaf045000) 00010000:00010000:3.0:1790740533.846167:0:19500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790740533.846172:0:19500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92f3bb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae2419a expref: 30 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.846183:0:19500:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc9800, rc 0) 00000100:00100000:3.0:1790740533.846254:0:19500:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e31bfdb-0682-4acb-9750-d1df4d991489+29:15644:x1877727001056000:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 1962us (2289us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1790740533.846263:0:19500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 51 00000100:00100000:0.0:1790740533.857669:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740533.858074:0:17166:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001056128 00000100:00100000:1.0:1790740533.858085:0:17166:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001056128 00000100:00100000:1.0:1790740533.858156:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 52 00000100:00100000:1.0:1790740533.858168:0:17166:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e31bfdb-0682-4acb-9750-d1df4d991489+29:15644:x1877727001056128:12345-192.168.204.3@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790740533.858222:0:17166:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790740533.858347:0:17166:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e31bfdb-0682-4acb-9750-d1df4d991489+29:15644:x1877727001056128:12345-192.168.204.3@tcp:53:lhsmtool_posix.0 Request processed in 182us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740533.858356:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 52 00000100:00100000:0.0:1790740533.861831:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740533.865382:0:17167:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001056384 00000100:00100000:2.0:1790740533.865399:0:17167:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001056384 00000100:00100000:2.0:1790740533.865548:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 53 00000100:00100000:2.0:1790740533.865559:0:17167:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e31bfdb-0682-4acb-9750-d1df4d991489+29:15644:x1877727001056384:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790740533.865580:0:17167:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740533.865601:0:17167:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80031e00/0xb25dda4f4e92f3d0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae241a1 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790740533.866022:0:17167:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6:0x0], count =28 00000004:00080000:2.0:1790740533.866057:0:17167:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x6:0x0]+28 in llog 00000004:00080000:2.0:1790740533.866082:0:17167:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:2.0:1790740533.866228:0:17167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80031a00/0xb25dda4f4e92f3d7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.866242:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80031a00/0xb25dda4f4e92f3d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.866253:0:17167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80031a00/0xb25dda4f4e92f3d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.866310:0:17167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80031e00/0xb25dda4f4e92f3d0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae241a1 expref: 32 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.866347:0:17167:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80031a00/0xb25dda4f4e92f3d7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae241a1 expref: 31 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.866357:0:17167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98dcaf045700) 00010000:00010000:2.0:1790740533.866360:0:17167:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790740533.866363:0:17167:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dc80031a00, rc 0) 00000100:00100000:2.0:1790740533.866440:0:17167:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e31bfdb-0682-4acb-9750-d1df4d991489+31:15644:x1877727001056384:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 883us (4618us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1790740533.866447:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 53 00000100:00100000:0.0:1790740533.873526:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740533.873670:0:17166:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001056640 00000100:00100000:1.0:1790740533.873688:0:17166:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001056640 00000100:00100000:1.0:1790740533.873824:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 54 00000100:00100000:1.0:1790740533.873835:0:17166:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcb5df1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e31bfdb-0682-4acb-9750-d1df4d991489+31:15644:x1877727001056640:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790740533.873929:0:17166:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740533.873956:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80031a00/0xb25dda4f4e92f3d7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae241a1 expref: 31 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740533.873975:0:17166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98dcaf045700) 00010000:00010000:1.0:1790740533.874002:0:17166:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790740533.874025:0:17166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92f3e5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740533.874097:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92f3e5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740533.874106:0:17166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92f3e5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740533.874122:0:17166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92f3ec lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x336d0843 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740533.874129:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92f3ec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x336d0843 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740533.874135:0:17166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92f3ec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x336d0843 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740533.874183:0:17166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92f3e5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740533.874190:0:17166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92f3e5 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740533.874197:0:17166:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92f3e5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740533.874208:0:17166:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc45800 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740533.874213:0:17166:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92f3e5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740533.874219:0:17166:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92f3e5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740533.874227:0:17166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98dcaf045e00) 00010000:00010000:1.0:1790740533.874230:0:17166:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740533.874234:0:17166:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92f3e5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740533.874239:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92f3e5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740533.874250:0:17166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92f3ec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x336d0843 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740533.874256:0:17166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92f3ec lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x336d0843 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740533.874262:0:17166:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92f3ec lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x336d0843 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740533.874267:0:17166:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc45400 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740533.874269:0:17166:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92f3ec lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x336d0843 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740533.874274:0:17166:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92f3ec lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x336d0843 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740533.874293:0:17166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x336d0843 (ffff98dcaec70300) 00010000:00010000:1.0:1790740533.874295:0:17166:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740533.874298:0:17166:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92f3ec lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x336d0843 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740533.874304:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45400/0xb25dda4f4e92f3ec lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x336d0843 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740533.874387:0:17166:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcb5df1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e31bfdb-0682-4acb-9750-d1df4d991489+30:15644:x1877727001056640:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 Request processed in 554us (875us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790740533.874394:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 54 00000100:00100000:0.0:1790740533.877702:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740533.878129:0:19500:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001056768 00000100:00100000:3.0:1790740533.878144:0:19500:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001056768 00000100:00100000:3.0:1790740533.878217:0:19500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 55 00000100:00100000:3.0:1790740533.878228:0:19500:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e31bfdb-0682-4acb-9750-d1df4d991489+30:15644:x1877727001056768:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790740533.878256:0:19500:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740533.878284:0:19500:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92f3f3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae241a8 expref: -99 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.878333:0:19500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8600/0xb25dda4f4e92f3fa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.878368:0:19500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8600/0xb25dda4f4e92f3fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.878383:0:19500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8600/0xb25dda4f4e92f3fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.878551:0:19500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92f3f3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae241a8 expref: 32 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.878573:0:19500:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8600/0xb25dda4f4e92f3fa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae241a8 expref: 31 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.878583:0:19500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98dcb1666600) 00010000:00010000:3.0:1790740533.878587:0:19500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790740533.878591:0:19500:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc8600, rc 0) 00000100:00100000:3.0:1790740533.878672:0:19500:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e31bfdb-0682-4acb-9750-d1df4d991489+31:15644:x1877727001056768:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 446us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740533.878680:0:19500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 55 00000100:00100000:0.0:1790740533.885886:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740533.886007:0:17165:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001057024 00000100:00100000:2.0:1790740533.886024:0:17165:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001057024 00000100:00100000:2.0:1790740533.886160:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 56 00000100:00100000:2.0:1790740533.886173:0:17165:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e31bfdb-0682-4acb-9750-d1df4d991489+31:15644:x1877727001057024:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790740533.886267:0:17165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80031e00/0xb25dda4f4e92f401 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.886287:0:17165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80031e00/0xb25dda4f4e92f401 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.886300:0:17165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80031e00/0xb25dda4f4e92f401 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790740533.886492:0:17165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1790740533.886502:0:17165:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 605172469929ns, next at 606172467363ns, rc = 0 00000004:00010000:2.0:1790740533.886568:0:17165:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001a3ce48b reply state 0000000040c7f347 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80031e00/0xb25dda4f4e92f401 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.886598:0:17165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80031e00/0xb25dda4f4e92f401 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.886606:0:17165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98dcb1666600) 00010000:00010000:2.0:1790740533.886609:0:17165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1790740533.886613:0:17165:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790740533.886724:0:17165:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e31bfdb-0682-4acb-9750-d1df4d991489+33:15644:x1877727001057024:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 Request processed in 553us (854us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1790740533.886743:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 56 00000100:00100000:0.0:1790740533.895165:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740533.895672:0:19500:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001057152 00000100:00100000:3.0:1790740533.895687:0:19500:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001057152 00000100:00100000:3.0:1790740533.895778:0:19500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 57 00000100:00100000:3.0:1790740533.895804:0:19500:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e31bfdb-0682-4acb-9750-d1df4d991489+33:15644:x1877727001057152:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790740533.895853:0:19500:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740533.895882:0:19500:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92f408 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae241af expref: -99 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.895968:0:19500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92f408 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae241af expref: 34 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.896005:0:19500:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92f408 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae241af expref: 34 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.896431:0:19500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98dcb1666600) 00010000:00010000:3.0:1790740533.896437:0:19500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790740533.896443:0:19500:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc9c00, rc 0) 00000100:00100000:3.0:1790740533.896533:0:19500:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e31bfdb-0682-4acb-9750-d1df4d991489+34:15644:x1877727001057152:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 731us (1380us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740533.896542:0:19500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 57 00000100:00100000:3.0:1790740533.904749:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740533.905268:0:18675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001057280 00000100:00100000:0.0:1790740533.905282:0:18675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001057280 00000100:00100000:0.0:1790740533.905414:0:18675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 25 00000100:00100000:0.0:1790740533.905428:0:18675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8e31bfdb-0682-4acb-9750-d1df4d991489+5:2402:x1877727001057280:12345-192.168.204.3@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1790740533.906312:0:18675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8e31bfdb-0682-4acb-9750-d1df4d991489+6:2402:x1877727001057280:12345-192.168.204.3@tcp:2:lhsmtool_posix.0 Request processed in 882us (1573us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1790740533.906324:0:18675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 25 00000100:00080000:3.0:1790740533.910198:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790740533.914345:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740533.914513:0:17169:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001057536 00000100:00100000:2.0:1790740533.914527:0:17169:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001057536 00000100:00100000:2.0:1790740533.914606:0:17169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 9 00000100:00100000:2.0:1790740533.914618:0:17169:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8e31bfdb-0682-4acb-9750-d1df4d991489+34:15644:x1877727001057536:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790740533.915931:0:17169:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8e31bfdb-0682-4acb-9750-d1df4d991489+35:15644:x1877727001057536:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 Request processed in 1305us (1593us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1790740533.915945:0:17169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 9 00000100:00100000:1.0:1790740533.930239:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740533.930686:0:17165:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001057792 00000100:00100000:2.0:1790740533.930700:0:17165:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001057792 00000100:00100000:2.0:1790740533.930804:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 58 00000100:00100000:2.0:1790740533.930817:0:17165:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e31bfdb-0682-4acb-9750-d1df4d991489+35:15644:x1877727001057792:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790740533.930990:0:17165:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e31bfdb-0682-4acb-9750-d1df4d991489+35:15644:x1877727001057792:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 Request processed in 175us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740533.930998:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 58 00000100:00100000:2.0:1790740533.934524:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740533.936164:0:17167:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001057920 00000100:00100000:0.0:1790740533.936183:0:17167:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001057920 00000100:00100000:0.0:1790740533.936272:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 59 00000100:00100000:0.0:1790740533.936284:0:17167:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaefd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e31bfdb-0682-4acb-9750-d1df4d991489+35:15644:x1877727001057920:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790740533.936311:0:17167:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740533.936351:0:17167:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342e00/0xb25dda4f4e92f40f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae241b6 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740533.936464:0:17167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342800/0xb25dda4f4e92f416 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740533.936483:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342800/0xb25dda4f4e92f416 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740533.936498:0:17167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342800/0xb25dda4f4e92f416 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790740533.936567:0:17167:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790740533.936594:0:17167:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342800/0xb25dda4f4e92f416 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740533.936627:0:17167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342e00/0xb25dda4f4e92f40f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae241b6 expref: 37 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740533.936649:0:17167:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342800/0xb25dda4f4e92f416 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae241b6 expref: 36 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740533.936680:0:17167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98dcb1666600) 00010000:00010000:0.0:1790740533.936684:0:17167:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1790740533.936688:0:17167:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98db82342800, rc 0) 00000100:00100000:0.0:1790740533.936805:0:17167:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaefd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e31bfdb-0682-4acb-9750-d1df4d991489+36:15644:x1877727001057920:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 523us (2296us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740533.936813:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 59 00000100:00100000:1.0:1790740533.942230:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740533.942343:0:18673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001058048 00000100:00100000:2.0:1790740533.942377:0:18673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001058048 00000100:00100000:2.0:1790740533.942464:0:18673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 26 00000100:00100000:2.0:1790740533.942478:0:18673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83eea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8e31bfdb-0682-4acb-9750-d1df4d991489+6:2402:x1877727001058048:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790740533.942506:0:18673:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740533.942536:0:18673:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee3ffd1f/0xb25dda4f4e92f41d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae241bd expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790740533.942571:0:18673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abc8836, blocks: 0x0 00010000:00010000:2.0:1790740533.942598:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=605s v=(0 0) 00010000:00010000:2.0:1790740533.942604:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740533.942616:0:18673:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee3ffd1f/0xb25dda4f4e92f41d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae241bd expref: 7 pid: 18673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.942640:0:18673:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ee3ffd1f/0xb25dda4f4e92f41d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae241bd expref: 7 pid: 18673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.942668:0:18673:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dc80030e00, rc 0) 00000100:00100000:2.0:1790740533.942746:0:18673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83eea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8e31bfdb-0682-4acb-9750-d1df4d991489+7:2402:x1877727001058048:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 271us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740533.942762:0:18673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 26 00000100:00100000:2.0:1790740533.954542:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740533.954637:0:17165:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001058304 00000100:00100000:0.0:1790740533.954650:0:17165:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001058304 00000100:00100000:0.0:1790740533.954714:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 60 00000100:00100000:0.0:1790740533.954724:0:17165:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaefdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e31bfdb-0682-4acb-9750-d1df4d991489+36:15644:x1877727001058304:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790740533.954899:0:17165:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaefdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e31bfdb-0682-4acb-9750-d1df4d991489+36:15644:x1877727001058304:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 Request processed in 176us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740533.954907:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 60 00000100:00100000:0.0:1790740533.967693:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740533.975241:0:17167:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001058432 00000100:00100000:2.0:1790740533.975264:0:17167:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001058432 00000100:00100000:2.0:1790740533.975373:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 61 00000100:00100000:2.0:1790740533.975388:0:17167:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e31bfdb-0682-4acb-9750-d1df4d991489+36:15644:x1877727001058432:12345-192.168.204.3@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1790740533.984434:0:17146:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:1.0:1790740533.984465:0:17146:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:1.0:1790740533.984545:0:17146:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:1.0:1790740533.984801:0:17167:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e31bfdb-0682-4acb-9750-d1df4d991489+19:15644:x1877727001058432:12345-192.168.204.3@tcp:44:lhsmtool_posix.0 Request processed in 9400us (17107us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740533.984817:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 61 00010000:00010000:3.0:1790740533.987393:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98db82343e00/0xb25dda4f4e92f2aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.987429:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db82343e00/0xb25dda4f4e92f2aa lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.987439:0:3624:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98db82343e00/0xb25dda4f4e92f2aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.987446:0:3624:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db82343e00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:3.0:1790740533.987451:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db82343e00/0xb25dda4f4e92f2aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.987459:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db82343e00/0xb25dda4f4e92f2aa lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.987480:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98dcaf045e00) 00010000:00010000:3.0:1790740533.987502:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1790740533.987508:0:3624:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98db82343e00/0xb25dda4f4e92f2aa lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740533.987514:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db82343e00/0xb25dda4f4e92f2aa lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740533.988488:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790740533.988511:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022108160:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1790740533.988601:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740533.990001:0:18674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022108160 00000100:00100000:1.0:1790740533.990016:0:18674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022108160 00000100:00100000:1.0:1790740533.990136:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790740533.990146:0:18674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877727022108160:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1790740533.990328:0:18674:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1790740533.990332:0:18674:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1790740533.990335:0:18674:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1790740533.990337:0:18674:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1790740534 -> 1790740534 00002000:00010000:1.0:1790740533.990357:0:18674:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1790740533.990461:0:18674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1877727022108160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 315us (1859us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1790740533.990470:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000004:00080000:1.0:1790740533.990535:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98db844c2d80/2, rc 0, transno 8589934596 00000100:00100000:1.0:1790740533.990542:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877727022108160:0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1790740533.990888:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790740533.991956:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740533.992130:0:18673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001058560 00000100:00100000:0.0:1790740533.992141:0:18673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001058560 00000100:00100000:0.0:1790740533.992199:0:18673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 28 00000100:00100000:0.0:1790740533.992209:0:18673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8e31bfdb-0682-4acb-9750-d1df4d991489+7:2403:x1877727001058560:12345-192.168.204.3@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1790740533.992327:0:18673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8e31bfdb-0682-4acb-9750-d1df4d991489+7:2403:x1877727001058560:12345-192.168.204.3@tcp:16:lhsmtool_posix.0 Request processed in 119us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740533.992334:0:18673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 28 00010000:00010000:2.0:1790740533.993373:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060600/0xb25dda4f4e92f256 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.993416:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060600/0xb25dda4f4e92f256 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.993426:0:3625:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060600/0xb25dda4f4e92f256 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.993433:0:3625:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf060600 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740533.993438:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060600/0xb25dda4f4e92f256 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.993447:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060600/0xb25dda4f4e92f256 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.993466:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98dcaf045500) 00010000:00010000:2.0:1790740533.993469:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740533.993474:0:3625:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060600/0xb25dda4f4e92f256 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.993480:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf060600/0xb25dda4f4e92f256 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.993513:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061400/0xb25dda4f4e92f25d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.993519:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061400/0xb25dda4f4e92f25d lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.993525:0:3625:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061400/0xb25dda4f4e92f25d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.993530:0:3625:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf061400 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740533.993539:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061400/0xb25dda4f4e92f25d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.993545:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061400/0xb25dda4f4e92f25d lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.993554:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98dcaf045e00) 00010000:00010000:2.0:1790740533.993557:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740533.993560:0:3625:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061400/0xb25dda4f4e92f25d lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.993566:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061400/0xb25dda4f4e92f25d lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.993582:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061e00/0xb25dda4f4e92f305 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.993588:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061e00/0xb25dda4f4e92f305 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.993593:0:3625:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061e00/0xb25dda4f4e92f305 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.993598:0:3625:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcaf061e00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740533.993601:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061e00/0xb25dda4f4e92f305 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.993607:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061e00/0xb25dda4f4e92f305 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.993614:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff98dcaf045800) 00010000:00010000:2.0:1790740533.993617:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740533.993626:0:3625:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061e00/0xb25dda4f4e92f305 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.993632:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061e00/0xb25dda4f4e92f305 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.993647:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92f38a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.993654:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92f38a lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.993659:0:3625:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92f38a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.993664:0:3625:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc8200 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740533.993666:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92f38a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.993671:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92f38a lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.993679:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98dcaf045300) 00010000:00010000:2.0:1790740533.993681:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740533.993684:0:3625:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92f38a lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.993689:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92f38a lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.993701:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80031e00/0xb25dda4f4e92f401 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.993718:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80031e00/0xb25dda4f4e92f401 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.993724:0:3625:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80031e00/0xb25dda4f4e92f401 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.993729:0:3625:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dc80031e00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:2.0:1790740533.993732:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80031e00/0xb25dda4f4e92f401 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.993737:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80031e00/0xb25dda4f4e92f401 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.993745:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98dcb1666600) 00010000:00010000:2.0:1790740533.993747:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790740533.993750:0:3625:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80031e00/0xb25dda4f4e92f401 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740533.993768:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80031e00/0xb25dda4f4e92f401 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740533.995593:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740533.995909:0:17165:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001058816 00000100:00100000:0.0:1790740533.995924:0:17165:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001058816 00000100:00100000:0.0:1790740533.996006:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 62 00000100:00100000:0.0:1790740533.996019:0:17165:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbfc74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e31bfdb-0682-4acb-9750-d1df4d991489+15:15644:x1877727001058816:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790740533.996147:0:17165:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740533.996182:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342800/0xb25dda4f4e92f416 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae241b6 expref: 15 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740533.996204:0:17165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98dcb1666600) 00010000:00010000:0.0:1790740533.996209:0:17165:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790740533.996253:0:17165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342e00/0xb25dda4f4e92f424 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740533.996271:0:17165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342e00/0xb25dda4f4e92f424 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740533.996284:0:17165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342e00/0xb25dda4f4e92f424 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790740533.996481:0:17165:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b6079f34 reply state 0000000096cb2617 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342e00/0xb25dda4f4e92f424 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740533.996496:0:17165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342e00/0xb25dda4f4e92f424 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740533.996502:0:17165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98dcb1666600) 00010000:00010000:0.0:1790740533.996505:0:17165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790740533.996508:0:17165:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790740533.996641:0:17165:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbfc74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e31bfdb-0682-4acb-9750-d1df4d991489+16:15644:x1877727001058816:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 Request processed in 624us (1059us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1790740533.996650:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 62 00000100:00100000:3.0:1790740534.011200:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740534.011485:0:18674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001058944 00000100:00100000:1.0:1790740534.011502:0:18674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001058944 00000100:00100000:1.0:1790740534.011587:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 29 00000100:00100000:1.0:1790740534.011599:0:18674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8e31bfdb-0682-4acb-9750-d1df4d991489+7:2403:x1877727001058944:12345-192.168.204.3@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1790740534.011817:0:18674:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1790740534.011821:0:18674:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1790740533 00002000:00010000:1.0:1790740534.011823:0:18674:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1790740533 00002000:00010000:1.0:1790740534.011826:0:18674:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1790740534 -> 1790740533 00002000:00010000:1.0:1790740534.011829:0:18674:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1790740534.011922:0:18674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8e31bfdb-0682-4acb-9750-d1df4d991489+8:2403:x1877727001058944:12345-192.168.204.3@tcp:2:lhsmtool_posix.0 Request processed in 324us (737us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1790740534.011938:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 29 00000100:00100000:3.0:1790740534.024498:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740534.024704:0:18673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001059072 00000100:00100000:0.0:1790740534.024719:0:18673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001059072 00000100:00100000:0.0:1790740534.024805:0:18673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 30 00000100:00100000:0.0:1790740534.024835:0:18673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8e31bfdb-0682-4acb-9750-d1df4d991489+8:2402:x1877727001059072:12345-192.168.204.3@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1790740534.024908:0:18673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000043cc564f/0xb25dda4f4e92f42b lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740534.024932:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740534.024938:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740534.024945:0:18673:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043cc564f/0xb25dda4f4e92f42b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740534.024962:0:18673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043cc564f/0xb25dda4f4e92f42b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740534.024996:0:18673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000043cc564f/0xb25dda4f4e92f42b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740534.025007:0:18673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043cc564f/0xb25dda4f4e92f42b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740534.025018:0:18673:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043cc564f/0xb25dda4f4e92f42b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740534.025026:0:18673:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db82342800 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:0.0:1790740534.025081:0:18673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043cc564f/0xb25dda4f4e92f42b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740534.025092:0:18673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043cc564f/0xb25dda4f4e92f42b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740534.025118:0:18673:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043cc564f/0xb25dda4f4e92f42b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740534.025125:0:18673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043cc564f/0xb25dda4f4e92f42b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740534.025227:0:18673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8e31bfdb-0682-4acb-9750-d1df4d991489+8:2402:x1877727001059072:12345-192.168.204.3@tcp:1:lhsmtool_posix.0 Request processed in 394us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740534.025236:0:18673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 30 00000100:00100000:3.0:1790740534.030445:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740534.035488:0:19500:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001059328 00000100:00100000:2.0:1790740534.035512:0:19500:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001059328 00000100:00100000:2.0:1790740534.035606:0:19500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 63 00000100:00100000:2.0:1790740534.035618:0:19500:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e31bfdb-0682-4acb-9750-d1df4d991489+16:15644:x1877727001059328:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1790740534.035740:0:19500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80031e00/0xb25dda4f4e92f432 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740534.035765:0:19500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92f383 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24185 expref: 16 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740534.035816:0:19500:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80031e00/0xb25dda4f4e92f432 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740534.035865:0:19500:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92f383 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24185 expref: 16 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740534.035882:0:19500:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92f383 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24185 expref: 16 pid: 17167 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740534.035901:0:19500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefd8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19500:1877727022108288:192.168.204.3@tcp:104: 00000100:00100000:2.0:1790740534.036058:0:19500:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82e52840 going to sleep for 11 seconds 00000100:00100000:3.0:1790740534.039387:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1790740534.039451:0:17153:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001059456 00000100:00100000:0.0:1790740534.039465:0:17153:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001059456 00010000:00010000:0.0:1790740534.039519:0:17153:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92f383 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24185 expref: 17 pid: 17167 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740534.039574:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 19 00000100:00100000:0.0:1790740534.039585:0:17153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e31bfdb-0682-4acb-9750-d1df4d991489+17:2402:x1877727001059456:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790740534.039606:0:17153:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740534.039615:0:17153:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92f383 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24185 expref: 17 pid: 17167 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740534.039631:0:17153:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92f383 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24185 expref: 17 pid: 17167 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740534.039659:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98dcaf045300) 00010000:00010000:0.0:1790740534.039666:0:17153:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44a00/0xb25dda4f4e92f39f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24193 expref: 17 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740534.039698:0:17153:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80031e00/0xb25dda4f4e92f432 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740534.039707:0:17153:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80031e00/0xb25dda4f4e92f432 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740534.039717:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80031e00/0xb25dda4f4e92f432 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740534.039742:0:17153:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740534.039826:0:17153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e31bfdb-0682-4acb-9750-d1df4d991489+17:2402:x1877727001059456:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 242us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740534.039835:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 19 00010000:00010000:2.0:1790740534.040230:0:19500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcaf061800/0xb25dda4f4e92f383 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24185 expref: 16 pid: 17167 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740534.040250:0:19500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefd8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19500:1877727022108288:192.168.204.3@tcp:104: 00010000:00010000:2.0:1790740534.040276:0:19500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80031e00/0xb25dda4f4e92f432 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740534.040287:0:19500:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80031e00/0xb25dda4f4e92f432 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740534.040294:0:19500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80031e00/0xb25dda4f4e92f432 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740534.040573:0:19500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80030800/0xb25dda4f4e92f439 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740534.040587:0:19500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92f408 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae241af expref: 16 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740534.040603:0:19500:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80030800/0xb25dda4f4e92f439 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740534.040637:0:19500:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92f408 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae241af expref: 16 pid: 19500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740534.040651:0:19500:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92f408 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae241af expref: 16 pid: 19500 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740534.040667:0:19500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefd8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19500:1877727022108416:192.168.204.3@tcp:104: 00000100:00100000:2.0:1790740534.043660:0:19500:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db82e52180 going to sleep for 11 seconds 00000100:00100000:3.0:1790740534.046981:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740534.047175:0:19500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefd8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19500:1877727022108416:192.168.204.3@tcp:104: 00010000:00010000:2.0:1790740534.047216:0:19500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80030800/0xb25dda4f4e92f439 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740534.047389:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001059584 00000100:00100000:1.0:1790740534.047408:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001059584 00010000:00010000:1.0:1790740534.047462:0:17151:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92f408 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae241af expref: 17 pid: 19500 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740534.047512:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 20 00000100:00100000:1.0:1790740534.047523:0:17151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e31bfdb-0682-4acb-9750-d1df4d991489+17:2402:x1877727001059584:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740534.047546:0:17151:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740534.047577:0:17151:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92f408 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae241af expref: 17 pid: 19500 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.047593:0:17151:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92f408 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae241af expref: 17 pid: 19500 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.047624:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9c00/0xb25dda4f4e92f408 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae241af expref: 17 pid: 19500 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.047644:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98dcb1666600) 00010000:00010000:1.0:1790740534.047649:0:17151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80030800/0xb25dda4f4e92f439 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.047662:0:17151:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80030800/0xb25dda4f4e92f439 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.047672:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80030800/0xb25dda4f4e92f439 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.047704:0:17151:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790740534.047753:0:19500:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80030800/0xb25dda4f4e92f439 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740534.047762:0:19500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80030800/0xb25dda4f4e92f439 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740534.047863:0:17151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e31bfdb-0682-4acb-9750-d1df4d991489+16:2402:x1877727001059584:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 327us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740534.047873:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 20 00000001:00080000:0.0:1790740534.047948:0:19500:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1790740534.048247:0:19500:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1790740534.048293:0:19500:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1790740534.048436:0:19500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:19500:1877727022108544:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1790740534.048512:0:19500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740534.048600:0:19500:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dc9853a900 going to sleep for 11 seconds 00000100:00100000:2.0:1790740534.050548:0:17907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022108544 00000100:00100000:2.0:1790740534.050568:0:17907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022108544 00000100:00100000:2.0:1790740534.050663:0:17907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790740534.050676:0:17907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db844c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:19500:x1877727022108544:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1790740534.050896:0:17907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db844c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:19500:x1877727022108544:12345-0@lo:1000:mdt00_003.0 Request processed in 222us (2383us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740534.050905:0:17907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790740534.053571:0:19500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:19500:1877727022108544:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1790740534.053893:0:19500:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1790740534.054010:0:19500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db82330380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:19500:1877727022108672:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1790740534.057316:0:19500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740534.057387:0:19500:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83ff4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790740534.057432:0:17171:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022108672 00000100:00100000:0.0:1790740534.057448:0:17171:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022108672 00000100:00100000:0.0:1790740534.057527:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790740534.057539:0:17171:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc884b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:19500:x1877727022108672:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1790740534.057864:0:17171:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc884b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:19500:x1877727022108672:12345-0@lo:1000:mdt00_003.0 Request processed in 325us (557us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1790740534.057875:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790740534.058153:0:19500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db82330380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:19500:1877727022108672:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1790740534.058234:0:19500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80030800/0xb25dda4f4e92f439 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.058248:0:19500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80030800/0xb25dda4f4e92f439 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.058257:0:19500:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80030800/0xb25dda4f4e92f439 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.058264:0:19500:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dc80030800 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740534.058270:0:19500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80030800/0xb25dda4f4e92f439 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.058280:0:19500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80030800/0xb25dda4f4e92f439 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.058299:0:19500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98dcb1666600) 00010000:00010000:1.0:1790740534.058303:0:19500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790740534.058308:0:19500:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80030800/0xb25dda4f4e92f439 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.058314:0:19500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80030800/0xb25dda4f4e92f439 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.058356:0:19500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342400/0xb25dda4f4e92f398 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.058362:0:19500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342400/0xb25dda4f4e92f398 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.058368:0:19500:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342400/0xb25dda4f4e92f398 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.058384:0:19500:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db82342400 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740534.058387:0:19500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342400/0xb25dda4f4e92f398 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.058394:0:19500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342400/0xb25dda4f4e92f398 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.058416:0:19500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98dcaf045300) 00010000:00010000:1.0:1790740534.058418:0:19500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790740534.058427:0:19500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44a00/0xb25dda4f4e92f39f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24193 expref: 19 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.058441:0:19500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44a00/0xb25dda4f4e92f39f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24193 expref: 19 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.058452:0:19500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44a00/0xb25dda4f4e92f39f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24193 expref: 19 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.058527:0:19500:0:(ldlm_lockd.c:1085:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc44a00/0xb25dda4f4e92f39f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae24193 expref: 19 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740534.058544:0:19500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19500:1877727022108800:192.168.204.3@tcp:105: 00000100:00100000:1.0:1790740534.058646:0:19500:0:(client.c:2716:ptlrpc_set_wait()) set ffff98db83ff4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790740534.061686:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740534.061866:0:17168:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001059712 00000100:00100000:2.0:1790740534.061879:0:17168:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001059712 00000100:00100000:2.0:1790740534.061960:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 10 00000100:00100000:2.0:1790740534.061973:0:17168:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbbcb3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8e31bfdb-0682-4acb-9750-d1df4d991489+20:15643:x1877727001059712:12345-192.168.204.3@tcp:49:dd.0 00000100:00100000:2.0:1790740534.062205:0:17168:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbbcb3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8e31bfdb-0682-4acb-9750-d1df4d991489+20:15643:x1877727001059712:12345-192.168.204.3@tcp:49:dd.0 Request processed in 233us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740534.062213:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 10 00000100:00100000:3.0:1790740534.064616:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740534.064671:0:17165:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001059840 00000100:00100000:3.0:1790740534.064683:0:17165:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001059840 00000100:00100000:3.0:1790740534.064750:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 64 00000100:00100000:3.0:1790740534.064760:0:17165:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e31bfdb-0682-4acb-9750-d1df4d991489+20:15643:x1877727001059840:12345-192.168.204.3@tcp:101:dd.0 00010000:00010000:3.0:1790740534.064787:0:17165:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740534.064816:0:17165:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92f440 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4d71ea1eae241c4 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740534.064877:0:17165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92f447 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740534.064918:0:17165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80031e00/0xb25dda4f4e92f432 lrc: 2/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740534.064930:0:17165:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92f447 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740534.064959:0:17165:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80031e00/0xb25dda4f4e92f432 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740534.064997:0:17165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92f447 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740534.067210:0:19500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19500:1877727022108800:192.168.204.3@tcp:105: 00010000:00010000:1.0:1790740534.067254:0:19500:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342400/0xb25dda4f4e92f398 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.067292:0:19500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98db82342400/0xb25dda4f4e92f398 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 17167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.067337:0:19500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92f44e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.067354:0:19500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92f44e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.067366:0:19500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92f44e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.067378:0:19500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92f44e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.067384:0:19500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92f44e lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.067390:0:19500:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92f44e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.067396:0:19500:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcbfc45800 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740534.067411:0:19500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92f44e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.067419:0:19500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92f44e lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.067432:0:19500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98dcaf045300) 00010000:00010000:1.0:1790740534.067435:0:19500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740534.067438:0:19500:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92f44e lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.067449:0:19500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcbfc45800/0xb25dda4f4e92f44e lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.067462:0:19500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80031e00/0xb25dda4f4e92f432 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.067468:0:19500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80031e00/0xb25dda4f4e92f432 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.067473:0:19500:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80031e00/0xb25dda4f4e92f432 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.067479:0:19500:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dc80031e00 already unused, calling callback (ffffffffc19674f0) 00010000:00010000:1.0:1790740534.067482:0:19500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80031e00/0xb25dda4f4e92f432 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.067488:0:19500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80031e00/0xb25dda4f4e92f432 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.067496:0:19500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98dcaf045300) 00010000:00010000:1.0:1790740534.067499:0:19500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790740534.067502:0:19500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92f447 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.067510:0:19500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92f447 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.067516:0:19500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92f447 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.067553:0:19500:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80031e00/0xb25dda4f4e92f432 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.067565:0:19500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80031e00/0xb25dda4f4e92f432 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 19500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740534.067803:0:19500:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e31bfdb-0682-4acb-9750-d1df4d991489+21:15644:x1877727001059328:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 Request processed in 32186us (37372us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1790740534.067815:0:19500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 63 00000020:00080000:1.0:1790740534.067823:0:19500:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1790740534.067932:0:17201:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1790740534.067938:0:17201:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790740534.067958:0:17201:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1790740534.067967:0:17201:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1790740534.068440:0:17165:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92f447 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740534.068451:0:17165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92f447 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740534.068608:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc9800/0xb25dda4f4e92f440 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae241c4 expref: 21 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740534.068627:0:17165:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98dcb5dc8200/0xb25dda4f4e92f447 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae241c4 expref: 20 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740534.068636:0:17165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98dcaf045300) 00010000:00010000:3.0:1790740534.068639:0:17165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790740534.068643:0:17165:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98dcb5dc8200, rc 0) 00000100:00100000:3.0:1790740534.068708:0:17165:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e31bfdb-0682-4acb-9750-d1df4d991489+20:15643:x1877727001059840:12345-192.168.204.3@tcp:101:dd.0 Request processed in 3948us (4106us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740534.068731:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 64 00000100:00100000:3.0:1790740534.081145:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740534.084239:0:17168:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001060096 00000100:00100000:2.0:1790740534.084261:0:17168:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001060096 00000100:00100000:2.0:1790740534.084436:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 11 00000100:00100000:2.0:1790740534.084450:0:17168:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcbd5f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8e31bfdb-0682-4acb-9750-d1df4d991489+20:15644:x1877727001060096:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1790740534.086159:0:17168:0:(mdd_object.c:4180:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1790740534.086701:0:17168:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1790740534.086772:0:17168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80030000/0xb25dda4f4e92f455 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740534.086798:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80030000/0xb25dda4f4e92f455 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740534.087456:0:17168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80030000/0xb25dda4f4e92f455 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740534.087472:0:17168:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80030000/0xb25dda4f4e92f455 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740534.087480:0:17168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80030000/0xb25dda4f4e92f455 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740534.087488:0:17168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80030000/0xb25dda4f4e92f455 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740534.088996:0:17168:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790740534.089205:0:17168:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcbd5f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8e31bfdb-0682-4acb-9750-d1df4d991489+22:15644:x1877727001060096:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 Request processed in 4750us (8067us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1790740534.089219:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 11 00000020:00080000:2.0:1790740534.089228:0:17168:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790740534.095480:0:17154:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740534.095504:0:17154:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80030000/0xb25dda4f4e92f455 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740534.095521:0:17154:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dc80030000 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:3.0:1790740534.095528:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80030000/0xb25dda4f4e92f455 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740534.095544:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80030000/0xb25dda4f4e92f455 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740534.095575:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98dcb1666600) 00010000:00010000:3.0:1790740534.095579:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790740534.095586:0:17154:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80030000/0xb25dda4f4e92f455 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740534.095594:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98dc80030000/0xb25dda4f4e92f455 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740534.095624:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740534.095627:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740534.095629:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740534.290275:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740534.290352:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740534.290488:0:18679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001060352 00000100:00100000:3.0:1790740534.290502:0:18679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001060352 00000100:00100000:3.0:1790740534.290601:0:18679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001060224 00000100:00100000:3.0:1790740534.290605:0:18679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001060224 00000100:00100000:3.0:1790740534.290630:0:18679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 0 00000100:00100000:3.0:1790740534.290641:0:18679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaefd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8e31bfdb-0682-4acb-9750-d1df4d991489+9:2405:x1877727001060352:12345-192.168.204.3@tcp:4:dd.0 00010000:00010000:3.0:1790740534.290706:0:18679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047b67b4f/0xb25dda4f4e92f45c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740534.290734:0:18679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee3ffd1f/0xb25dda4f4e92f41d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae241bd expref: 9 pid: 18673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740534.290744:0:18679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790740534.290749:0:18679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790740534.290755:0:18679:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047b67b4f/0xb25dda4f4e92f45c lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740534.290803:0:18679:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ee3ffd1f/0xb25dda4f4e92f41d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae241bd expref: 9 pid: 18673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740534.290834:0:18679:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ee3ffd1f/0xb25dda4f4e92f41d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae241bd expref: 9 pid: 18673 timeout: 705 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740534.290852:0:18679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:18679:1877727022108928:192.168.204.3@tcp:104: 00000100:00100000:3.0:1790740534.290966:0:18679:0:(client.c:2716:ptlrpc_set_wait()) set ffff98dcad2adb40 going to sleep for 11 seconds 00000100:00100000:3.0:1790740534.295696:0:18679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:18679:1877727022108928:192.168.204.3@tcp:104: 00010000:00010000:3.0:1790740534.295757:0:18679:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000047b67b4f/0xb25dda4f4e92f45c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740534.297386:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1790740534.297978:0:17152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001060480 00000100:00100000:1.0:1790740534.298001:0:17152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001060480 00010000:00010000:1.0:1790740534.298086:0:17152:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ee3ffd1f/0xb25dda4f4e92f41d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae241bd expref: 10 pid: 18673 timeout: 705 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740534.298143:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 21 00000100:00100000:1.0:1790740534.298155:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaefda300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e31bfdb-0682-4acb-9750-d1df4d991489+10:2403:x1877727001060480:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740534.298177:0:17152:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740534.298206:0:17152:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ee3ffd1f/0xb25dda4f4e92f41d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae241bd expref: 10 pid: 18673 timeout: 705 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.298223:0:17152:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ee3ffd1f/0xb25dda4f4e92f41d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae241bd expref: 10 pid: 18673 timeout: 705 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.298258:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee3ffd1f/0xb25dda4f4e92f41d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.3@tcp remote: 0xe4d71ea1eae241bd expref: 10 pid: 18673 timeout: 705 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.298281:0:17152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790740534.298306:0:17152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790740534.298665:0:17152:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000047b67b4f/0xb25dda4f4e92f45c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.298680:0:17152:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047b67b4f/0xb25dda4f4e92f45c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.298774:0:17152:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740534.298885:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaefda300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e31bfdb-0682-4acb-9750-d1df4d991489+9:2403:x1877727001060480:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 730us (1510us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740534.298895:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 21 00010000:00010000:3.0:1790740534.300203:0:18679:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000047b67b4f/0xb25dda4f4e92f45c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740534.300247:0:18679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047b67b4f/0xb25dda4f4e92f45c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740534.378482:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877727022109440:0@lo:400:kworker.0 00000100:00100000:0.0:1790740534.378582:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740534.378630:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877727022109952:0@lo:400:kworker.0 00000100:00100000:0.0:1790740534.378664:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740534.378686:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1877727022110464:0@lo:400:kworker.0 00000100:00100000:0.0:1790740534.378710:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740534.378738:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1790740534.378745:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3640:1877727022109056:0@lo:400:kworker.0 00000100:00100000:0.0:1790740534.378775:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740534.378806:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022109568:0@lo:400:kworker.0 00000100:00100000:0.0:1790740534.378832:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740534.378851:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1877727022110080:0@lo:400:kworker.0 00000100:00100000:0.0:1790740534.378873:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740534.378906:0:17161:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022109056 00000100:00100000:0.0:1790740534.378916:0:17161:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022109056 00000100:00100000:0.0:1790740534.378973:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1790740534.378983:0:17161:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83b42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+24:3640:x1877727022109056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740534.379075:0:17161:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83b42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0847d467-2c8f-428f-ab2a-50e9cfba84d8+24:3640:x1877727022109056:12345-0@lo:400:kworker.0 Request processed in 92us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740534.379083:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1790740534.379121:0:17170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022109568 00000100:00100000:0.0:1790740534.379125:0:17170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022109568 00000100:00100000:0.0:1790740534.379163:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790740534.379169:0:17170:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022109568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740534.379207:0:17170:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877727022109568:12345-0@lo:400:kworker.0 Request processed in 38us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740534.379214:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790740534.379255:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0847d467-2c8f-428f-ab2a-50e9cfba84d8:3640:1877727022109056:0@lo:400:kworker.0 00000100:00100000:0.0:1790740534.379270:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877727022109568:0@lo:400:kworker.0 00000100:00100000:0.0:1790740534.379300:0:17166:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022109440 00000100:00100000:0.0:1790740534.379304:0:17166:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022109440 00000100:00100000:0.0:1790740534.379326:0:17166:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022109952 00000100:00100000:0.0:1790740534.379329:0:17166:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022109952 00000100:00100000:0.0:1790740534.379341:0:17166:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022110464 00000100:00100000:0.0:1790740534.379344:0:17166:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022110464 00000100:00080000:0.0:1790740534.379371:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790740534.379387:0:17166:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022110080 00000100:00100000:0.0:1790740534.379390:0:17166:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022110080 00000100:00080000:0.0:1790740534.379416:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790740534.379447:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790740534.379456:0:17166:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877727022109440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740534.379510:0:17166:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877727022109440:12345-0@lo:400:kworker.0 Request processed in 56us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740534.379517:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790740534.379530:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790740534.379536:0:17166:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877727022109952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740534.379570:0:17166:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877727022109952:12345-0@lo:400:kworker.0 Request processed in 34us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740534.379576:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790740534.379595:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1790740534.379601:0:17166:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877727022110464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740534.379631:0:17166:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877727022110464:12345-0@lo:400:kworker.0 Request processed in 31us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740534.379636:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1790740534.379648:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790740534.379653:0:17166:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877727022110080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740534.379681:0:17166:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877727022110080:12345-0@lo:400:kworker.0 Request processed in 27us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740534.379687:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790740534.379712:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1877727022110080:0@lo:400:kworker.0 00000100:00100000:0.0:1790740534.379723:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877727022109440:0@lo:400:kworker.0 00000100:00100000:0.0:1790740534.379733:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877727022109952:0@lo:400:kworker.0 00010000:00080000:0.0:1790740534.379748:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83d90380 x1877727022110464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740550 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740534.379757:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1877727022110464:0@lo:400:kworker.0 00000100:00100000:2.0:1790740534.380593:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022109184:0@lo:400:kworker.0 00000100:00100000:0.0:1790740534.380626:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790740534.380636:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022110592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790740534.380706:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db844c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022109312:0@lo:400:kworker.0 00000100:00100000:0.0:1790740534.380762:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740534.380978:0:19777:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022110592 00000100:00100000:3.0:1790740534.380985:0:19777:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022110592 00000100:00100000:3.0:1790740534.381057:0:19777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790740534.381067:0:19777:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1877727022110592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790740534.381094:0:19777:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 4218880 granted 25591488 pending 3485696 free 3923513344 avail 3691991040 00000100:00100000:3.0:1790740534.381157:0:19777:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1877727022110592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740534.381163:0:19777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790740534.381223:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022110592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790740534.393303:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740534.393402:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022109696:0@lo:400:kworker.0 00000100:00100000:2.0:1790740534.393490:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740534.393516:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1877727022110208:0@lo:400:kworker.0 00000100:00100000:2.0:1790740534.393551:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740534.393591:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbd5fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022110720:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790740534.393620:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740534.393678:0:18676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022110720 00000100:00100000:2.0:1790740534.393688:0:18676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022110720 00000100:00100000:1.0:1790740534.393698:0:18674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022109696 00000100:00100000:1.0:1790740534.393702:0:18674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022109696 00000100:00100000:3.0:1790740534.393893:0:17166:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022110208 00000100:00100000:3.0:1790740534.393899:0:17166:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022110208 00000100:00100000:2.0:1790740534.393973:0:18676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790740534.393984:0:18676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaefdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022110720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790740534.394016:0:18676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 4218880 granted 25591488 pending 3485696 free 3923513344 avail 3691991040 00000100:00100000:2.0:1790740534.394087:0:18676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaefdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022110720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740534.394096:0:18676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790740534.395603:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740534.395813:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022109824:0@lo:400:kworker.0 00000100:00100000:0.0:1790740534.395859:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740534.395881:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1877727022110336:0@lo:400:kworker.0 00000100:00100000:0.0:1790740534.395929:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740534.395981:0:18675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022109312 00000100:00100000:0.0:1790740534.395990:0:18675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022109312 00000100:00100000:3.0:1790740534.397329:0:17166:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022110336 00000100:00100000:3.0:1790740534.397341:0:17166:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022110336 00000100:00100000:3.0:1790740534.397379:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790740534.397400:0:17166:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaefd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877727022110208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740534.397495:0:17166:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaefd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877727022110208:12345-0@lo:400:kworker.0 Request processed in 106us (3943us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740534.397504:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790740534.397533:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790740534.397539:0:17166:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1877727022110336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740534.397565:0:18674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022109824 00000100:00100000:1.0:1790740534.397570:0:18674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022109824 00000100:00100000:3.0:1790740534.397576:0:17166:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1877727022110336:12345-0@lo:400:kworker.0 Request processed in 39us (1647us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740534.397587:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790740534.397589:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790740534.397594:0:18674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaefdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022109696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740534.397620:0:17907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022109184 00000100:00100000:3.0:1790740534.397625:0:17907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022109184 00000100:00100000:1.0:1790740534.397633:0:18674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaefdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877727022109696:12345-0@lo:400:kworker.0 Request processed in 41us (4144us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740534.397639:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790740534.397653:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790740534.397659:0:18674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022109824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740534.397689:0:18674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022109824:12345-0@lo:400:kworker.0 Request processed in 30us (1829us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740534.397696:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790740534.397837:0:17907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790740534.397846:0:17907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaefda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022109184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740534.397897:0:17907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaefda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1877727022109184:12345-0@lo:400:kworker.0 Request processed in 53us (4607us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740534.397904:0:17907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790740534.398129:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbd5fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022110720:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790740534.398134:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022109824:0@lo:400:kworker.0 00000100:00100000:3.0:1790740534.398143:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877727022109184:0@lo:400:kworker.0 00000100:00100000:3.0:1790740534.398155:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877727022109696:0@lo:400:kworker.0 00000100:00100000:1.0:1790740534.398155:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1877727022110336:0@lo:400:kworker.0 00010000:00080000:3.0:1790740534.398170:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98db83d93800 x1877727022110208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740550 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740534.398182:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1877727022110208:0@lo:400:kworker.0 00000100:00080000:2.0:1790740534.398524:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790740534.398531:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790740534.398536:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790740534.398539:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790740534.409432:0:18675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790740534.409454:0:18675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022109312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740534.409597:0:18675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022109312:12345-0@lo:400:kworker.0 Request processed in 149us (14000us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740534.409605:0:18675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790740534.409693:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db844c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022109312:0@lo:400:kworker.0 00000001:00080000:1.0:1790740534.419613:0:19487:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:1.0:1790740534.419645:0:19487:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:0.0:1790740534.421388:0:18679:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:0.0:1790740534.421407:0:18679:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1790740533 -> 1790740534 00002000:00010000:0.0:1790740534.421410:0:18679:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1790740533 -> 1790740534 00002000:00010000:0.0:1790740534.421413:0:18679:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:0.0:1790740534.421444:0:18679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047b67b4f/0xb25dda4f4e92f45c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740534.421468:0:18679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000047b67b4f/0xb25dda4f4e92f45c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740534.421480:0:18679:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000047b67b4f/0xb25dda4f4e92f45c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740534.421489:0:18679:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98dcb5dc9800 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:0.0:1790740534.421495:0:18679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000047b67b4f/0xb25dda4f4e92f45c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740534.421896:0:18679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000047b67b4f/0xb25dda4f4e92f45c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740534.421922:0:18679:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000047b67b4f/0xb25dda4f4e92f45c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740534.421931:0:18679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047b67b4f/0xb25dda4f4e92f45c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740534.423895:0:18679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaefd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8e31bfdb-0682-4acb-9750-d1df4d991489+6:2405:x1877727001060352:12345-192.168.204.3@tcp:4:dd.0 Request processed in 133240us (133623us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1790740534.423917:0:18679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 0 00000100:00100000:0.0:1790740534.424303:0:18679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 1 00000100:00100000:0.0:1790740534.424321:0:18679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaefd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8e31bfdb-0682-4acb-9750-d1df4d991489+5:2405:x1877727001060224:12345-192.168.204.3@tcp:4:dd.0 00002000:00010000:0.0:1790740534.424384:0:18679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 7654321, mtime: 0x6abc8836, atime: 0x6abc8835, ctime: 0x6abc8836, blocks: 0x1a68 00010000:00010000:0.0:1790740534.424405:0:18679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a03d0007/0xb25dda4f4e92f463 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740534.424426:0:18679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=605s v=(0 0) 00010000:00010000:0.0:1790740534.424431:0:18679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740534.424438:0:18679:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a03d0007/0xb25dda4f4e92f463 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740534.424457:0:18679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a03d0007/0xb25dda4f4e92f463 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740534.442444:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1790740534.528875:0:19487:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:1.0:1790740534.531264:0:18679:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:1.0:1790740534.531312:0:18679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a03d0007/0xb25dda4f4e92f463 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.531330:0:18679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a03d0007/0xb25dda4f4e92f463 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.531341:0:18679:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a03d0007/0xb25dda4f4e92f463 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.531350:0:18679:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff98db82342000 already unused, calling callback (ffffffffc0d26ac0) 00010000:00010000:1.0:1790740534.531356:0:18679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a03d0007/0xb25dda4f4e92f463 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.531367:0:18679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a03d0007/0xb25dda4f4e92f463 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.531401:0:18679:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a03d0007/0xb25dda4f4e92f463 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740534.531410:0:18679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a03d0007/0xb25dda4f4e92f463 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740534.531586:0:18679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaefd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8e31bfdb-0682-4acb-9750-d1df4d991489+5:2405:x1877727001060224:12345-192.168.204.3@tcp:4:dd.0 Request processed in 107265us (241226us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1790740534.531620:0:18679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 1 00000100:00100000:0.0:1790740534.890444:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcaefd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022110848:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790740534.890556:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740534.890743:0:18677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022110848 00000100:00100000:3.0:1790740534.890757:0:18677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022110848 00000100:00100000:3.0:1790740534.893964:0:18677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790740534.894000:0:18677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022110848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790740534.894070:0:18677:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1790740534.894190:0:18677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877727022110848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 209us (3634us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740534.894206:0:18677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790740534.894348:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcaefd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877727022110848:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790740535.408793:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790740535.408842:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022110976:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790740535.408944:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740535.409117:0:17171:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022110976 00000100:00100000:0.0:1790740535.409130:0:17171:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022110976 00000100:00100000:0.0:1790740535.409217:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790740535.409230:0:17171:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaefd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022110976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790740535.409285:0:17171:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1790740535.409383:0:17171:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaefd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877727022110976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 143us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740535.409392:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790740535.409454:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877727022110976:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1790740535.467382:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740535.916690:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790740535.916720:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98db83d90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022111104:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790740535.916818:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740535.916878:0:17170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022111104 00000100:00100000:0.0:1790740535.916888:0:17170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022111104 00000100:00100000:0.0:1790740535.916944:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790740535.916954:0:17170:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727022111104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790740535.916998:0:17170:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790740535.917075:0:17170:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1877727022111104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 122us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740535.917083:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790740535.917166:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98db83d90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877727022111104:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790740536.229764:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740536.229816:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740536.229849:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740536.229875:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740536.230417:0:17160:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001060608 00000100:00100000:3.0:1790740536.230432:0:17160:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001060608 00000100:00100000:3.0:1790740536.230505:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 170 00000100:00100000:3.0:1790740536.230517:0:17160:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83b43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b6742f8-8cda-45db-8c52-3634e9260d75+13:2404:x1877727001060608:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740536.230630:0:17160:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83b43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b6742f8-8cda-45db-8c52-3634e9260d75+13:2404:x1877727001060608:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 116us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740536.230639:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 170 00000100:00100000:3.0:1790740536.230699:0:17166:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001060864 00000100:00100000:3.0:1790740536.230703:0:17166:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001060864 00000100:00100000:3.0:1790740536.230750:0:17166:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001061376 00000100:00100000:3.0:1790740536.230753:0:17166:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001061376 00000100:00100000:3.0:1790740536.230777:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 71 00000100:00100000:3.0:1790740536.230885:0:17166:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaefd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e31bfdb-0682-4acb-9750-d1df4d991489+5:2404:x1877727001060864:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740536.230935:0:17166:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaefd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e31bfdb-0682-4acb-9750-d1df4d991489+5:2404:x1877727001060864:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 152us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740536.230942:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 71 00000100:00100000:3.0:1790740536.230957:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 72 00000100:00100000:3.0:1790740536.230963:0:17166:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83ee9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4dca2668-e8ad-455d-9a0a-ed2d1013e863+5:2404:x1877727001061376:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740536.230987:0:17166:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83ee9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4dca2668-e8ad-455d-9a0a-ed2d1013e863+5:2404:x1877727001061376:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 24us (1111us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740536.230993:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 72 00000100:00080000:3.0:1790740536.231012:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790740536.231074:0:19778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001061120 00000100:00100000:3.0:1790740536.231078:0:19778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001061120 00000100:00100000:3.0:1790740536.231116:0:19778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 25 00000100:00100000:3.0:1790740536.231123:0:19778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dcaefd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8e31bfdb-0682-4acb-9750-d1df4d991489+5:2404:x1877727001061120:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740536.231175:0:19778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dcaefd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8e31bfdb-0682-4acb-9750-d1df4d991489+5:2404:x1877727001061120:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 52us (1324us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740536.231182:0:19778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 25 00000100:00080000:3.0:1790740536.231204:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790740536.231398:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740536.231496:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740536.231525:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740536.231568:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1790740536.232090:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1790740536.232337:0:18675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001061632 00000100:00100000:3.0:1790740536.232346:0:18675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001061632 00000100:00100000:3.0:1790740536.232412:0:18675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001060992 00000100:00100000:3.0:1790740536.232416:0:18675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001060992 00000100:00100000:3.0:1790740536.232432:0:18675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001061504 00000100:00100000:3.0:1790740536.232435:0:18675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001061504 00000100:00100000:3.0:1790740536.232454:0:18675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 26 00000100:00100000:3.0:1790740536.232462:0:18675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db82331f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4dca2668-e8ad-455d-9a0a-ed2d1013e863+5:2404:x1877727001061632:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740536.232528:0:18675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db82331f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4dca2668-e8ad-455d-9a0a-ed2d1013e863+5:2404:x1877727001061632:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 67us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740536.232536:0:18675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 26 00000100:00100000:3.0:1790740536.232558:0:18675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 27 00000100:00100000:3.0:1790740536.232564:0:18675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc884b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8e31bfdb-0682-4acb-9750-d1df4d991489+5:2404:x1877727001060992:12345-192.168.204.3@tcp:400:kworker.0 00000100:00080000:2.0:1790740536.232978:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790740536.232984:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790740536.233808:0:18675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc884b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8e31bfdb-0682-4acb-9750-d1df4d991489+5:2404:x1877727001060992:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 29us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740536.233826:0:18675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 27 00000100:00100000:3.0:1790740536.233870:0:18675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 28 00000100:00100000:3.0:1790740536.233884:0:18675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4dca2668-e8ad-455d-9a0a-ed2d1013e863+5:2404:x1877727001061504:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740536.234062:0:18675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4dca2668-e8ad-455d-9a0a-ed2d1013e863+5:2404:x1877727001061504:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 183us (1973us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740536.234069:0:18675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 28 00000100:00100000:3.0:1790740536.234110:0:19500:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001060736 00000100:00100000:3.0:1790740536.234118:0:19500:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001060736 00000100:00100000:3.0:1790740536.234169:0:19500:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727001061248 00000100:00100000:3.0:1790740536.234173:0:19500:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727001061248 00000100:00100000:3.0:1790740536.234196:0:19500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 73 00000100:00100000:3.0:1790740536.234203:0:19500:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc884b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e31bfdb-0682-4acb-9750-d1df4d991489+22:2404:x1877727001060736:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740536.234242:0:19500:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc884b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e31bfdb-0682-4acb-9750-d1df4d991489+22:2404:x1877727001060736:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 40us (2746us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740536.234248:0:19500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 73 00000100:00100000:3.0:1790740536.234262:0:19500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 74 00000100:00100000:3.0:1790740536.234267:0:19500:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db8468d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4dca2668-e8ad-455d-9a0a-ed2d1013e863+6:2404:x1877727001061248:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1790740536.234315:0:19500:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db8468d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4dca2668-e8ad-455d-9a0a-ed2d1013e863+6:2404:x1877727001061248:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 47us (2746us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740536.234321:0:19500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 74 00000100:00080000:3.0:1790740536.234353:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1790740536.490275:0:20344:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:0.0:1790740536.498429:0:17155:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790740536.690621:0:17922:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1790740536.939967:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790740536.940003:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98dcbfe2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022111232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790740536.940130:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740536.940574:0:19777:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727022111232 00000100:00100000:1.0:1790740536.940586:0:19777:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727022111232 00000100:00080000:3.0:1790740536.940749:0:17162:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790740536.940849:0:19777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790740536.940862:0:19777:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff98db83e1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022111232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790740536.940903:0:19777:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1790740536.940979:0:19777:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff98db83e1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877727022111232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740536.940987:0:19777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790740536.941318:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98dcbfe2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877727022111232:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790740537.514687:0:17154:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 42877 lines, 42877 kept, 0 dropped, 0 bad.